Jun 17 05:31:40 devstack cinder-volume[81228]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81228) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 17 05:31:40 devstack cinder-volume[81228]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81228) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 17 05:31:40 devstack cinder-volume[81228]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81228) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 17 05:31:41 devstack cinder-volume[81228]: INFO dbcounter [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] Registered counter for database cinder Jun 17 05:31:41 devstack cinder-volume[81228]: DEBUG oslo_db.sqlalchemy.engines [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81228) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 17 05:31:41 devstack cinder-volume[81228]: DEBUG dbcounter [-] [81228] Writer thread running {{(pid=81228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 17 05:31:41 devstack cinder-volume[81228]: INFO cinder.rpc [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 17 05:31:41 devstack cinder-volume[81228]: INFO cinder.rpc [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 17 05:31:41 devstack cinder-volume[81228]: DEBUG oslo_db.sqlalchemy.engines [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81228) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 17 05:31:41 devstack cinder-volume[81228]: INFO cinder.volume.manager [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] Determined volume DB was empty at startup. Jun 17 05:31:41 devstack cinder-volume[81228]: DEBUG cinder.volume.manager [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81228) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 17 05:31:41 devstack cinder-volume[81228]: INFO cinder.volume.manager [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 17 05:31:41 devstack cinder-volume[81228]: WARNING stevedore.named [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 17 05:31:41 devstack cinder-volume[81228]: WARNING castellan.key_manager [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 17 05:31:41 devstack cinder-volume[81228]: WARNING cinder.keymgr.conf_key_mgr [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 17 05:31:41 devstack cinder-volume[81228]: DEBUG cinder.volume.drivers.lvm [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=81228) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_concurrency.processutils [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=81228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_concurrency.processutils [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] CMD "cinder-rtstool verify" returned: 0 in 0.471s {{(pid=81228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_db.sqlalchemy.engines [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81228) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 17 05:31:42 devstack cinder-volume[81228]: INFO cinder.rpc [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jun 17 05:31:42 devstack cinder-volume[81228]: INFO cinder.rpc [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jun 17 05:31:42 devstack cinder-volume[81228]: WARNING stevedore.named [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 17 05:31:42 devstack cinder-volume[81228]: WARNING castellan.key_manager [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 17 05:31:42 devstack cinder-volume[81228]: INFO cinder.volume.manager [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_db.sqlalchemy.engines [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81228) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 17 05:31:42 devstack cinder-volume[81228]: INFO oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] Starting 1 workers Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] Started child 81395 {{(pid=81228) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] Full set of CONF: {{(pid=81228) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] ******************************************************************************** {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] Configuration options gathered from: {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] ================================================================================ {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] allow_availability_zone_fallback = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] allow_compression_on_image_upload = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] allowed_direct_url_schemes = [] {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] api_rate_limit = True {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] auth_strategy = keystone {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81395]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] az_cache_duration = 3600 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backend_availability_zone = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backend_host = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backend_name = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backend_stats_polling_interval = 60 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backup_api_class = cinder.backup.api.API {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backup_name_template = backup-%s {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backup_use_same_host = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backup_use_temp_snapshot = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] chap_password = **** {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] chap_username = {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] cinder_internal_tenant_project_id = 92cae3803bb64654a8e42489ab88cc18 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] cinder_internal_tenant_user_id = 9307061b8c134c5f8a030f9bbae77b19 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] cloned_volume_same_az = True {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] cluster = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] compression_format = gzip {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] compute_api_class = cinder.compute.nova.API {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] config_dir = [] {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] config_source = [] {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] control_exchange = openstack {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] debug = True {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] default_availability_zone = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] default_group_type = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] default_volume_type = lvmdriver-1 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] disk_geometry = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] driver_client_cert = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] driver_client_cert_key = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] driver_data_namespace = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] driver_ssl_cert_path = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] driver_ssl_cert_verify = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] driver_use_ssl = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] enable_force_upload = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] enable_new_services = True {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] enable_unsupported_driver = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] enabled_backends = ['lvmdriver-1'] {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] enforce_multipath_for_image_xfer = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] filter_function = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] glance_api_insecure = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] glance_api_servers = ['http://192.168.122.134/image'] {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] glance_api_ssl_compression = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] glance_ca_certificates_file = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] glance_catalog_info = image:glance:publicURL {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] glance_certfile = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] glance_keyfile = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] glance_num_retries = 3 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] glance_request_timeout = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] goodness_function = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] graceful_shutdown_timeout = 5 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] group_api_class = cinder.group.api.API {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] host = devstack {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] image_compress_on_upload = True {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] image_conversion_address_space_limit = 1 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] image_conversion_cpu_limit = 60 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] image_conversion_disable = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] image_upload_use_cinder_backend = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] image_upload_use_internal_tenant = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] image_volume_cache_enabled = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] image_volume_cache_max_count = 0 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] image_volume_cache_max_size_gb = 0 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] init_host_max_objects_retrieval = 0 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] instance_format = [instance: %(uuid)s] {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] iscsi_target_flags = {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] iscsi_write_cache = on {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] iser_helper = tgtadm {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] iser_ip_address = 192.168.122.134 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] iser_port = 3260 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] log_color = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81395]: INFO cinder.volume.manager [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jun 17 05:31:42 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] log_config_append = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] log_dir = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] log_file = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] log_options = True {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] log_rotate_interval = 1 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] log_rotate_interval_type = days {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] log_rotation_type = none {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack sudo[81460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] max_age = 0 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] max_logfile_count = 30 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] max_logfile_size_mb = 200 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] max_over_subscription_ratio = 20.0 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] message_reap_interval = 86400 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack sudo[81460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] message_ttl = 2592000 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] migration_create_volume_timeout_secs = 300 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] monkey_patch = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] monkey_patch_modules = [] {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] my_ip = 192.168.122.134 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] no_snapshot_gb_quota = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] num_iser_scan_tries = 3 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] num_shell_tries = 3 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] num_volume_device_scan_tries = 3 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] nvmeof_conn_info_version = 1 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] nvmet_ns_id = 10 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] nvmet_port_id = 1 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] osapi_max_limit = 1000 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] osapi_volume_ext_list = [] {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] osapi_volume_listen = 0.0.0.0 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] osapi_volume_listen_port = 8776 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] osapi_volume_use_ssl = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] osapi_volume_workers = 2 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] per_volume_size_limit = -1 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] periodic_fuzzy_delay = 60 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] periodic_interval = 60 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] project_id_regex = [0-9a-f\-]+ {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] public_endpoint = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] publish_errors = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] quota_backup_gigabytes = 1000 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] quota_backups = 10 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] quota_gigabytes = 1000 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] quota_groups = 10 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] quota_snapshots = 10 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] quota_volumes = 10 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] rate_limit_burst = 0 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] rate_limit_except_level = CRITICAL {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] rate_limit_interval = 0 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] reinit_driver_count = 3 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] replication_device = **** {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] report_discard_supported = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] report_interval = 120 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] reservation_clean_interval = 86400 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] reservation_expire = 86400 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] reserved_image_namespaces = [] {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] reserved_percentage = 0 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] rpc_response_timeout = 120 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] run_external_periodic_tasks = True {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:42 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] scst_target_driver = iscsi {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] scst_target_iqn_name = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] service_down_time = 720 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] shell_completion = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] snapshot_name_template = snapshot-%s {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:43 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.055s {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] snapshot_same_host = True {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] split_loggers = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] state_path = /opt/stack/data/cinder {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] storage_availability_zone = nova {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:43 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] storage_protocol = iSCSI {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] syslog_log_facility = LOG_USER {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] target_helper = lioadm {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] target_ip_address = 192.168.122.134 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] target_port = 3260 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] target_protocol = iscsi {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] target_secondary_ip_addresses = [] {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] trace_flags = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] transfer_api_class = cinder.transfer.api.API {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] transport_url = **** {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] until_refresh = 0 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] use_chap_auth = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] use_default_quota_class = True {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] use_journal = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] use_json = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] use_multipath_for_image_xfer = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] use_stderr = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] use_syslog = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] verify_glance_signatures = enabled {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] volume_api_class = cinder.volume.api.API {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] volume_backend_name = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] volume_clear = zero {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] volume_clear_ionice = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] volume_clear_size = 0 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] volume_copy_bps_limit = 0 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] volume_dd_blocksize = 1M {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] volume_name_template = volume-%s {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] volume_service_inithost_offload = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] volume_usage_audit_period = month {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] zoning_mode = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] oslo_concurrency.disable_process_locking = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] keystone_authtoken.admin_password = **** {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] keystone_authtoken.admin_token = **** {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] keystone_authtoken.admin_user = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] keystone_authtoken.auth_admin_prefix = {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] keystone_authtoken.auth_port = 35357 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] keystone_authtoken.auth_protocol = https {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] keystone_authtoken.auth_section = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] keystone_authtoken.auth_type = password {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] keystone_authtoken.auth_uri = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] keystone_authtoken.auth_version = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:31:43 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] keystone_authtoken.cache = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] keystone_authtoken.certfile = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] keystone_authtoken.delay_auth_decision = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] keystone_authtoken.http_connect_timeout = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] keystone_authtoken.identity_uri = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] keystone_authtoken.include_service_catalog = True {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] keystone_authtoken.insecure = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] keystone_authtoken.interface = public {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] keystone_authtoken.keyfile = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] keystone_authtoken.memcache_password = {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] keystone_authtoken.memcache_username = {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] keystone_authtoken.region_name = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] keystone_authtoken.service_token_roles_required = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] keystone_authtoken.service_type = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] keystone_authtoken.token_cache_time = 300 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.134/identity {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] cache.backend = dogpile.cache.null {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] cache.backend_argument = **** {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] cache.backend_expiration_time = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] cache.config_prefix = cache.oslo {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] cache.debug_cache_backend = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] cache.enable_retry_client = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] cache.enable_socket_keepalive = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] cache.enabled = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] cache.enforce_fips_mode = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] cache.expiration_time = 600 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] cache.hashclient_retry_attempts = 2 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] cache.memcache_dead_retry = 300 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] cache.memcache_pool_maxsize = 10 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] cache.memcache_sasl_enabled = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] cache.password = **** {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] cache.proxies = [] {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] cache.redis_db = 0 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] cache.redis_sentinel_service_name = mymaster {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] cache.redis_server = localhost:6379 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] cache.retry_attempts = 2 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] cache.retry_delay = 0.0 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] cache.socket_keepalive_count = 1 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] cache.socket_keepalive_idle = 1 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] cache.socket_keepalive_interval = 1 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] cache.socket_timeout = 1.0 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] cache.tls_allowed_ciphers = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] cache.tls_cafile = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] cache.tls_certfile = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] cache.tls_enabled = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] cache.tls_keyfile = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] cache.username = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] database.asyncio_connection = **** {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] database.asyncio_slave_connection = **** {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] database.backend = sqlalchemy {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] database.connection = **** {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] database.connection_debug = 0 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] database.connection_parameters = {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] database.connection_recycle_time = 3600 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] database.connection_trace = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] database.db_inc_retry_interval = True {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] database.db_max_retries = 20 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] database.db_max_retry_interval = 10 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] database.db_retry_interval = 1 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] database.max_overflow = 50 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] database.max_pool_size = 5 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] database.max_retries = 10 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] database.mysql_wsrep_sync_wait = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] database.pool_timeout = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] database.retry_interval = 10 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] database.slave_connection = **** {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] database.sqlite_synchronous = True {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] database.synchronous_reader = True {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] database.use_db_reconnect = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] profiler.connection_string = messaging:// {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] profiler.enabled = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] profiler.es_doc_type = notification {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] profiler.es_scroll_size = 10000 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] profiler.es_scroll_time = 2m {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] profiler.filter_error_trace = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] profiler.hmac_keys = **** {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] profiler.sentinel_service_name = mymaster {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] profiler.socket_timeout = 0.1 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] profiler.trace_requests = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] profiler.trace_sqlalchemy = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] profiler_jaeger.process_tags = {} {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] profiler_jaeger.service_name_prefix = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] profiler_otlp.service_name_prefix = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] oslo_policy.enforce_new_defaults = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: WARNING oslo_config.cfg [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] oslo_policy.enforce_scope = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] oslo_policy.policy_default_rule = default {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] oslo_policy.policy_file = policy.yaml {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] oslo_policy.remote_timeout = 60.0 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] coordination.backend_url = **** {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] privsep_osbrick.group = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] privsep_osbrick.helper_command = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] privsep_osbrick.user = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] cinder_sys_admin.group = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] cinder_sys_admin.helper_command = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] cinder_sys_admin.user = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] service_user.auth_section = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] service_user.auth_type = password {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] service_user.cafile = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] service_user.certfile = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] service_user.collect_timing = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] service_user.insecure = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] service_user.keyfile = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] service_user.send_service_user_token = True {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] service_user.split_loggers = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] service_user.timeout = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] glance.auth_section = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] glance.auth_type = password {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] glance.certfile = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] glance.collect_timing = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] glance.insecure = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] glance.keyfile = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] glance.region_name = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] glance.split_loggers = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] glance.timeout = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backend_defaults.backend_availability_zone = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backend_defaults.chap_password = **** {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backend_defaults.chap_username = {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backend_defaults.disk_geometry = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backend_defaults.driver_client_cert = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backend_defaults.driver_client_cert_key = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backend_defaults.driver_data_namespace = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backend_defaults.driver_use_ssl = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backend_defaults.enable_unsupported_driver = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backend_defaults.extra_capabilities = {} {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backend_defaults.filter_function = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backend_defaults.goodness_function = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backend_defaults.iscsi_target_flags = {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backend_defaults.iscsi_write_cache = on {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backend_defaults.iser_helper = tgtadm {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backend_defaults.iser_ip_address = 192.168.122.134 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backend_defaults.iser_port = 3260 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backend_defaults.lvm_mirrors = 0 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backend_defaults.lvm_share_target = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backend_defaults.lvm_type = auto {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backend_defaults.num_shell_tries = 3 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backend_defaults.nvmet_port_id = 1 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backend_defaults.replication_device = **** {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backend_defaults.report_discard_supported = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backend_defaults.reserved_percentage = 0 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backend_defaults.scst_target_driver = iscsi {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backend_defaults.scst_target_iqn_name = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backend_defaults.storage_protocol = iSCSI {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backend_defaults.target_helper = tgtadm {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backend_defaults.target_ip_address = 192.168.122.134 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backend_defaults.target_port = 3260 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backend_defaults.target_protocol = iscsi {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backend_defaults.trace_flags = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backend_defaults.unique_fqdn_network = True {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backend_defaults.use_chap_auth = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backend_defaults.volume_backend_name = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backend_defaults.volume_clear = zero {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backend_defaults.volume_clear_ionice = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backend_defaults.volume_clear_size = 0 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backend_defaults.volume_group = cinder-volumes {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] oslo_reports.file_event_handler = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] oslo_reports.log_dir = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] lvmdriver-1.backend_availability_zone = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] lvmdriver-1.backend_host = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] lvmdriver-1.chap_password = **** {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] lvmdriver-1.chap_username = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] lvmdriver-1.chiscsi_conf = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] lvmdriver-1.disk_geometry = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] lvmdriver-1.driver_client_cert = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] lvmdriver-1.driver_data_namespace = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] lvmdriver-1.driver_use_ssl = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] lvmdriver-1.extra_capabilities = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] lvmdriver-1.filter_function = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] lvmdriver-1.goodness_function = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] lvmdriver-1.iser_helper = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] lvmdriver-1.iser_ip_address = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] lvmdriver-1.iser_port = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] lvmdriver-1.iser_target_prefix = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] lvmdriver-1.lvm_conf_file = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] lvmdriver-1.lvm_mirrors = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] lvmdriver-1.lvm_share_target = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] lvmdriver-1.lvm_type = auto {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] lvmdriver-1.num_shell_tries = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] lvmdriver-1.nvmet_port_id = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] lvmdriver-1.replication_device = **** {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] lvmdriver-1.report_discard_supported = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] lvmdriver-1.reserved_percentage = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] lvmdriver-1.scst_target_driver = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] lvmdriver-1.storage_protocol = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] lvmdriver-1.target_helper = lioadm {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] lvmdriver-1.target_ip_address = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] lvmdriver-1.target_port = 3260 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] lvmdriver-1.target_protocol = iscsi {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] lvmdriver-1.trace_flags = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] lvmdriver-1.use_chap_auth = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] lvmdriver-1.volume_clear = zero {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] lvmdriver-1.volume_clear_size = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] lvmdriver-1.volumes_dir = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] oslo_messaging_rabbit.ssl = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] oslo_messaging_rabbit.ssl_version = {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] oslo_messaging_notifications.driver = [] {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] oslo_messaging_notifications.retry = -1 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] oslo_messaging_notifications.transport_url = **** {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] key_manager.fixed_key = **** {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] barbican.barbican_api_version = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] barbican.barbican_endpoint = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] barbican.barbican_endpoint_type = public {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] barbican.barbican_region_name = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] barbican.cafile = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] barbican.certfile = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] barbican.collect_timing = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] barbican.insecure = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] barbican.keyfile = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] barbican.number_of_retries = 60 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] barbican.retry_delay = 1 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] barbican.send_service_user_token = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] barbican.split_loggers = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] barbican.timeout = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] barbican.verify_ssl = True {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] barbican.verify_ssl_path = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] barbican_service_user.auth_section = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] barbican_service_user.auth_type = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] barbican_service_user.cafile = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] barbican_service_user.certfile = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] barbican_service_user.collect_timing = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] barbican_service_user.insecure = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] barbican_service_user.keyfile = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] barbican_service_user.split_loggers = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] barbican_service_user.timeout = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] vault.approle_role_id = **** {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] vault.approle_secret_id = **** {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] vault.kv_mountpoint = secret {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] vault.kv_path = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] vault.kv_version = 2 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] vault.namespace = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] vault.root_token_id = **** {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] vault.ssl_ca_crt_file = None {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] vault.timeout = 60.0 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] vault.use_ssl = False {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:31:43 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] ******************************************************************************** {{(pid=81228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Jun 17 05:31:43 devstack sudo[81460]: pam_unix(sudo:session): session closed for user root Jun 17 05:31:43 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.769s {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:31:43 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:31:43 devstack sudo[81685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 17 05:31:43 devstack sudo[81685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:31:44 devstack sudo[81685]: pam_unix(sudo:session): session closed for user root Jun 17 05:31:44 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.637s {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:31:44 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 05:31:44 devstack cinder-volume[81395]: INFO cinder.brick.local_dev.lvm [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jun 17 05:31:44 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:31:44 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:31:44 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:31:44 devstack sudo[81881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 17 05:31:44 devstack sudo[81881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:31:44 devstack sudo[81881]: pam_unix(sudo:session): session closed for user root Jun 17 05:31:44 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.705s {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:31:44 devstack cinder-volume[81395]: DEBUG cinder.brick.local_dev.lvm [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=81395) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jun 17 05:31:44 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:31:45 devstack sudo[82018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 17 05:31:45 devstack sudo[82018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:31:45 devstack sudo[82018]: pam_unix(sudo:session): session closed for user root Jun 17 05:31:45 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.976s {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:31:45 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:31:45 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:31:45 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:31:46 devstack sudo[82167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 17 05:31:46 devstack sudo[82167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:31:47 devstack sudo[82167]: pam_unix(sudo:session): session closed for user root Jun 17 05:31:47 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.025s {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:31:47 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:31:47 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:31:47 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:31:47 devstack sudo[82172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jun 17 05:31:47 devstack sudo[82172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:31:47 devstack sudo[82172]: pam_unix(sudo:session): session closed for user root Jun 17 05:31:47 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.614s {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:31:47 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:31:47 devstack sudo[82182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 17 05:31:47 devstack sudo[82182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:31:48 devstack sudo[82182]: pam_unix(sudo:session): session closed for user root Jun 17 05:31:48 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.613s {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:31:48 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:31:48 devstack sudo[82187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 17 05:31:48 devstack sudo[82187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:31:48 devstack sudo[82187]: pam_unix(sudo:session): session closed for user root Jun 17 05:31:48 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.622s {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:31:48 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:31:48 devstack sudo[82191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 17 05:31:48 devstack sudo[82191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:31:49 devstack sudo[82191]: pam_unix(sudo:session): session closed for user root Jun 17 05:31:49 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.606s {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:31:49 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:31:49 devstack sudo[82195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 17 05:31:49 devstack sudo[82195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:31:50 devstack sudo[82195]: pam_unix(sudo:session): session closed for user root Jun 17 05:31:50 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.791s {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:31:50 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:31:50 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:31:50 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:31:50 devstack sudo[82200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 17 05:31:50 devstack sudo[82200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:31:51 devstack sudo[82200]: pam_unix(sudo:session): session closed for user root Jun 17 05:31:51 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.839s {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:31:51 devstack cinder-volume[81395]: INFO cinder.volume.drivers.lvm [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jun 17 05:31:51 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:31:51 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:31:51 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:31:51 devstack sudo[82243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 17 05:31:51 devstack sudo[82243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:31:51 devstack sudo[82243]: pam_unix(sudo:session): session closed for user root Jun 17 05:31:51 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.632s {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:31:51 devstack cinder-volume[81395]: DEBUG cinder.volume.drivers.lvm [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] Updating volume stats {{(pid=81395) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 17 05:31:51 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:31:51 devstack sudo[82326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 17 05:31:51 devstack sudo[82326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:31:52 devstack sudo[82326]: pam_unix(sudo:session): session closed for user root Jun 17 05:31:52 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.622s {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:31:52 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:31:52 devstack sudo[82424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 17 05:31:52 devstack sudo[82424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:31:52 devstack cinder-volume[81228]: DEBUG dbcounter [-] [81228] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=81228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:31:53 devstack sudo[82424]: pam_unix(sudo:session): session closed for user root Jun 17 05:31:53 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.590s {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:31:53 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:31:53 devstack sudo[82471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 17 05:31:53 devstack sudo[82471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:31:53 devstack sudo[82471]: pam_unix(sudo:session): session closed for user root Jun 17 05:31:53 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.592s {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:31:53 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:31:53 devstack sudo[82474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 17 05:31:53 devstack sudo[82474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:31:54 devstack sudo[82474]: pam_unix(sudo:session): session closed for user root Jun 17 05:31:54 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.581s {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:31:54 devstack cinder-volume[81395]: INFO cinder.volume.driver [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] Driver hasn't implemented _init_vendor_properties() Jun 17 05:31:54 devstack cinder-volume[81395]: DEBUG cinder.volume.driver [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81395) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 17 05:31:54 devstack cinder-volume[81395]: DEBUG oslo_db.sqlalchemy.engines [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81395) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 17 05:31:54 devstack cinder-volume[81395]: DEBUG dbcounter [-] [81395] Writer thread running {{(pid=81395) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 17 05:31:54 devstack cinder-volume[81395]: DEBUG cinder.db.sqlalchemy.api [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] Building query based on filter {{(pid=81395) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3979}} Jun 17 05:31:54 devstack cinder-volume[81395]: DEBUG cinder.image.image_utils [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81395) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 17 05:31:54 devstack cinder-volume[81395]: INFO cinder.keymgr.migration [None req-5d18cbde-c034-4436-a7f8-ffa352498f97 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 17 05:31:54 devstack cinder-volume[81395]: DEBUG cinder.volume.drivers.lvm [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] Updating volume stats {{(pid=81395) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 17 05:31:54 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:31:54 devstack sudo[82481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 17 05:31:54 devstack sudo[82481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:31:54 devstack sudo[82481]: pam_unix(sudo:session): session closed for user root Jun 17 05:31:54 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.577s {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:31:54 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:31:54 devstack sudo[82484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 17 05:31:54 devstack sudo[82484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:31:55 devstack sudo[82484]: pam_unix(sudo:session): session closed for user root Jun 17 05:31:55 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.588s {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:31:55 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:31:55 devstack sudo[82487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 17 05:31:55 devstack sudo[82487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:31:56 devstack sudo[82487]: pam_unix(sudo:session): session closed for user root Jun 17 05:31:56 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.583s {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:31:56 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:31:56 devstack sudo[82490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 17 05:31:56 devstack sudo[82490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:31:56 devstack sudo[82490]: pam_unix(sudo:session): session closed for user root Jun 17 05:31:56 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.597s {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:31:56 devstack cinder-volume[81395]: DEBUG cinder.manager [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] Notifying Schedulers of capabilities ... {{(pid=81395) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:31:56 devstack cinder-volume[81395]: INFO cinder.volume.manager [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] Driver initialization completed successfully. Jun 17 05:31:56 devstack cinder-volume[81395]: INFO cinder.manager [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] Initiating service 2 cleanup Jun 17 05:31:56 devstack cinder-volume[81395]: INFO cinder.manager [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] Service 2 cleanup completed. Jun 17 05:31:56 devstack cinder-volume[81395]: DEBUG cinder.service [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] Creating RPC server for service cinder-volume {{(pid=81395) start /opt/stack/cinder/cinder/service.py:231}} Jun 17 05:31:56 devstack cinder-volume[81395]: DEBUG cinder.service [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81395) start /opt/stack/cinder/cinder/service.py:237}} Jun 17 05:31:56 devstack cinder-volume[81395]: INFO cinder.volume.manager [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jun 17 05:31:56 devstack cinder-volume[81395]: DEBUG cinder.volume.drivers.lvm [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] Updating volume stats {{(pid=81395) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 17 05:31:56 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:31:56 devstack sudo[82495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 17 05:31:56 devstack sudo[82495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:31:57 devstack sudo[82495]: pam_unix(sudo:session): session closed for user root Jun 17 05:31:57 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.622s {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:31:57 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:31:57 devstack sudo[82502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 17 05:31:57 devstack sudo[82502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:31:58 devstack sudo[82502]: pam_unix(sudo:session): session closed for user root Jun 17 05:31:58 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.658s {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:31:58 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:31:58 devstack sudo[82506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 17 05:31:58 devstack sudo[82506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:31:58 devstack sudo[82506]: pam_unix(sudo:session): session closed for user root Jun 17 05:31:58 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.630s {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:31:58 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:31:58 devstack sudo[82563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 17 05:31:58 devstack sudo[82563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:31:59 devstack sudo[82563]: pam_unix(sudo:session): session closed for user root Jun 17 05:31:59 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.598s {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:31:59 devstack cinder-volume[81395]: INFO cinder.volume.manager [None req-60e17f6d-6149-498c-92ee-d664d7a33c74 None None] Driver post RPC initialization completed successfully. Jun 17 05:32:06 devstack cinder-volume[81395]: DEBUG dbcounter [-] [81395] Writing DB stats cinder:SELECT=4 {{(pid=81395) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:32:09 devstack cinder-volume[81395]: DEBUG dbcounter [-] [81395] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=81395) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:32:24 devstack cinder-volume[81395]: DEBUG oslo_service.periodic_task [None req-731cad7e-243d-4739-8eee-d4357ed26e5c None None] Running periodic task VolumeManager._thread_info {{(pid=81395) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 05:32:24 devstack cinder-volume[81395]: DEBUG cinder.volume.manager [None req-731cad7e-243d-4739-8eee-d4357ed26e5c None None] thread count: 6 {{(pid=81395) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 17 05:32:24 devstack cinder-volume[81395]: DEBUG cinder.volume.manager [None req-731cad7e-243d-4739-8eee-d4357ed26e5c None None] thread info: [<_MainThread(MainThread, started 128799966036096)>, , , , , ] {{(pid=81395) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 17 05:33:24 devstack cinder-volume[81395]: DEBUG oslo_service.periodic_task [None req-731cad7e-243d-4739-8eee-d4357ed26e5c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81395) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 05:33:24 devstack cinder-volume[81395]: DEBUG cinder.volume.drivers.lvm [None req-731cad7e-243d-4739-8eee-d4357ed26e5c None None] Updating volume stats {{(pid=81395) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 17 05:33:24 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-731cad7e-243d-4739-8eee-d4357ed26e5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:33:24 devstack sudo[87273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 17 05:33:24 devstack sudo[87273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:33:24 devstack sudo[87273]: pam_unix(sudo:session): session closed for user root Jun 17 05:33:24 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-731cad7e-243d-4739-8eee-d4357ed26e5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.594s {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:33:24 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-731cad7e-243d-4739-8eee-d4357ed26e5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:33:24 devstack sudo[87276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 17 05:33:24 devstack sudo[87276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:33:25 devstack sudo[87276]: pam_unix(sudo:session): session closed for user root Jun 17 05:33:25 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-731cad7e-243d-4739-8eee-d4357ed26e5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.592s {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:33:25 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-731cad7e-243d-4739-8eee-d4357ed26e5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:33:25 devstack sudo[87279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 17 05:33:25 devstack sudo[87279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:33:26 devstack sudo[87279]: pam_unix(sudo:session): session closed for user root Jun 17 05:33:26 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-731cad7e-243d-4739-8eee-d4357ed26e5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.579s {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:33:26 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-731cad7e-243d-4739-8eee-d4357ed26e5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:33:26 devstack sudo[87283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 17 05:33:26 devstack sudo[87283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:33:26 devstack sudo[87283]: pam_unix(sudo:session): session closed for user root Jun 17 05:33:26 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-731cad7e-243d-4739-8eee-d4357ed26e5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.580s {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:33:26 devstack cinder-volume[81395]: DEBUG cinder.manager [None req-731cad7e-243d-4739-8eee-d4357ed26e5c None None] Notifying Schedulers of capabilities ... {{(pid=81395) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:33:26 devstack cinder-volume[81395]: DEBUG oslo_service.periodic_task [None req-731cad7e-243d-4739-8eee-d4357ed26e5c None None] Running periodic task VolumeManager._thread_info {{(pid=81395) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 05:33:26 devstack cinder-volume[81395]: DEBUG cinder.volume.manager [None req-731cad7e-243d-4739-8eee-d4357ed26e5c None None] thread count: 6 {{(pid=81395) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 17 05:33:26 devstack cinder-volume[81395]: DEBUG cinder.volume.manager [None req-731cad7e-243d-4739-8eee-d4357ed26e5c None None] thread info: [<_MainThread(MainThread, started 128799966036096)>, , , , , ] {{(pid=81395) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 17 05:34:09 devstack cinder-volume[81395]: DEBUG dbcounter [-] [81395] Writing DB stats cinder:SELECT=1 {{(pid=81395) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:34:09 devstack cinder-volume[81395]: DEBUG dbcounter [-] [81395] Writing DB stats cinder:UPDATE=1 {{(pid=81395) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:34:24 devstack cinder-volume[81395]: DEBUG oslo_service.periodic_task [None req-731cad7e-243d-4739-8eee-d4357ed26e5c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81395) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 05:34:24 devstack cinder-volume[81395]: DEBUG cinder.volume.drivers.lvm [None req-731cad7e-243d-4739-8eee-d4357ed26e5c None None] Updating volume stats {{(pid=81395) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 17 05:34:24 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-731cad7e-243d-4739-8eee-d4357ed26e5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:34:24 devstack sudo[87713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 17 05:34:24 devstack sudo[87713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:34:24 devstack sudo[87713]: pam_unix(sudo:session): session closed for user root Jun 17 05:34:24 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-731cad7e-243d-4739-8eee-d4357ed26e5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.588s {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:34:24 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-731cad7e-243d-4739-8eee-d4357ed26e5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:34:24 devstack sudo[87723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 17 05:34:24 devstack sudo[87723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:34:25 devstack sudo[87723]: pam_unix(sudo:session): session closed for user root Jun 17 05:34:25 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-731cad7e-243d-4739-8eee-d4357ed26e5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.582s {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:34:25 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-731cad7e-243d-4739-8eee-d4357ed26e5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:34:25 devstack sudo[87733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 17 05:34:25 devstack sudo[87733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:34:26 devstack sudo[87733]: pam_unix(sudo:session): session closed for user root Jun 17 05:34:26 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-731cad7e-243d-4739-8eee-d4357ed26e5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.580s {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:34:26 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-731cad7e-243d-4739-8eee-d4357ed26e5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:34:26 devstack sudo[87736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 17 05:34:26 devstack sudo[87736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:34:26 devstack sudo[87736]: pam_unix(sudo:session): session closed for user root Jun 17 05:34:26 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-731cad7e-243d-4739-8eee-d4357ed26e5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.590s {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:34:26 devstack cinder-volume[81395]: DEBUG cinder.manager [None req-731cad7e-243d-4739-8eee-d4357ed26e5c None None] Notifying Schedulers of capabilities ... {{(pid=81395) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:34:26 devstack cinder-volume[81395]: DEBUG oslo_service.periodic_task [None req-731cad7e-243d-4739-8eee-d4357ed26e5c None None] Running periodic task VolumeManager._thread_info {{(pid=81395) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 05:34:26 devstack cinder-volume[81395]: DEBUG cinder.volume.manager [None req-731cad7e-243d-4739-8eee-d4357ed26e5c None None] thread count: 6 {{(pid=81395) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 17 05:34:26 devstack cinder-volume[81395]: DEBUG cinder.volume.manager [None req-731cad7e-243d-4739-8eee-d4357ed26e5c None None] thread info: [<_MainThread(MainThread, started 128799966036096)>, , , , , ] {{(pid=81395) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 17 05:35:24 devstack cinder-volume[81395]: DEBUG oslo_service.periodic_task [None req-731cad7e-243d-4739-8eee-d4357ed26e5c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81395) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 05:35:24 devstack cinder-volume[81395]: DEBUG cinder.volume.drivers.lvm [None req-731cad7e-243d-4739-8eee-d4357ed26e5c None None] Updating volume stats {{(pid=81395) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 17 05:35:24 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-731cad7e-243d-4739-8eee-d4357ed26e5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:35:24 devstack sudo[89929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 17 05:35:24 devstack sudo[89929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:35:24 devstack sudo[89929]: pam_unix(sudo:session): session closed for user root Jun 17 05:35:24 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-731cad7e-243d-4739-8eee-d4357ed26e5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.592s {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:35:24 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-731cad7e-243d-4739-8eee-d4357ed26e5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:35:24 devstack sudo[89933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 17 05:35:24 devstack sudo[89933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:35:25 devstack sudo[89933]: pam_unix(sudo:session): session closed for user root Jun 17 05:35:25 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-731cad7e-243d-4739-8eee-d4357ed26e5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.569s {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:35:25 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-731cad7e-243d-4739-8eee-d4357ed26e5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:35:25 devstack sudo[89947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 17 05:35:25 devstack sudo[89947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:35:26 devstack sudo[89947]: pam_unix(sudo:session): session closed for user root Jun 17 05:35:26 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-731cad7e-243d-4739-8eee-d4357ed26e5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.581s {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:35:26 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-731cad7e-243d-4739-8eee-d4357ed26e5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:35:26 devstack sudo[89973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 17 05:35:26 devstack sudo[89973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:35:26 devstack sudo[89973]: pam_unix(sudo:session): session closed for user root Jun 17 05:35:26 devstack cinder-volume[81395]: DEBUG oslo_concurrency.processutils [None req-731cad7e-243d-4739-8eee-d4357ed26e5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.578s {{(pid=81395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:35:26 devstack cinder-volume[81395]: DEBUG cinder.manager [None req-731cad7e-243d-4739-8eee-d4357ed26e5c None None] Notifying Schedulers of capabilities ... {{(pid=81395) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:36:09 devstack cinder-volume[81395]: DEBUG dbcounter [-] [81395] Writing DB stats cinder:SELECT=1 {{(pid=81395) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:36:09 devstack cinder-volume[81395]: DEBUG dbcounter [-] [81395] Writing DB stats cinder:UPDATE=1 {{(pid=81395) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:36:18 devstack cinder-volume[81228]: INFO oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] Caught SIGTERM, stopping children Jun 17 05:36:18 devstack cinder-volume[81228]: DEBUG oslo_concurrency.lockutils [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] Acquiring lock "singleton_lock" {{(pid=81228) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 17 05:36:18 devstack cinder-volume[81228]: DEBUG oslo_concurrency.lockutils [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] Acquired lock "singleton_lock" {{(pid=81228) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 17 05:36:18 devstack cinder-volume[81228]: DEBUG oslo_concurrency.lockutils [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] Releasing lock "singleton_lock" {{(pid=81228) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 17 05:36:18 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] Stop services. {{(pid=81228) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 17 05:36:18 devstack cinder-volume[81228]: DEBUG oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] Killing children. {{(pid=81228) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 17 05:36:18 devstack cinder-volume[81228]: INFO oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] Waiting on 1 children to exit Jun 17 05:36:21 devstack cinder-volume[81395]: DEBUG oslo_concurrency.lockutils [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] Acquiring lock "singleton_lock" {{(pid=81395) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 17 05:36:21 devstack cinder-volume[81395]: DEBUG oslo_concurrency.lockutils [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] Acquired lock "singleton_lock" {{(pid=81395) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 17 05:36:21 devstack cinder-volume[81395]: DEBUG oslo_concurrency.lockutils [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] Releasing lock "singleton_lock" {{(pid=81395) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 17 05:36:21 devstack cinder-volume[81395]: WARNING amqp [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 17 05:36:21 devstack cinder-volume[81395]: WARNING amqp [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 17 05:36:21 devstack cinder-volume[81228]: INFO oslo_service.backend._eventlet.service [None req-af88a398-b285-475f-a77f-983f8fea6a65 None None] Child 81395 exited with status 0 Jun 17 05:36:24 devstack cinder-volume[91110]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=91110) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 17 05:36:24 devstack cinder-volume[91110]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=91110) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 17 05:36:24 devstack cinder-volume[91110]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=91110) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 17 05:36:24 devstack cinder-volume[91110]: INFO dbcounter [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] Registered counter for database cinder Jun 17 05:36:24 devstack cinder-volume[91110]: DEBUG oslo_db.sqlalchemy.engines [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91110) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 17 05:36:24 devstack cinder-volume[91110]: DEBUG dbcounter [-] [91110] Writer thread running {{(pid=91110) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 17 05:36:25 devstack cinder-volume[91110]: INFO cinder.rpc [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 17 05:36:25 devstack cinder-volume[91110]: INFO cinder.rpc [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_db.sqlalchemy.engines [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91110) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 17 05:36:25 devstack cinder-volume[91110]: INFO cinder.volume.manager [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] Determined volume DB was empty at startup. Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG cinder.volume.manager [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] Cinder Volume DB check: vol_db_empty=True {{(pid=91110) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 17 05:36:25 devstack cinder-volume[91110]: INFO cinder.volume.manager [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 17 05:36:25 devstack cinder-volume[91110]: WARNING stevedore.named [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 17 05:36:25 devstack cinder-volume[91110]: WARNING castellan.key_manager [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 17 05:36:25 devstack cinder-volume[91110]: WARNING cinder.keymgr.conf_key_mgr [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 17 05:36:25 devstack cinder-volume[91110]: INFO cinder.volume.manager [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_db.sqlalchemy.engines [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91110) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 17 05:36:25 devstack cinder-volume[91110]: INFO oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] Starting 1 workers Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] Started child 91316 {{(pid=91110) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] Full set of CONF: {{(pid=91110) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] ******************************************************************************** {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] Configuration options gathered from: {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] ================================================================================ {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] allow_availability_zone_fallback = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] allow_compression_on_image_upload = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] allowed_direct_url_schemes = [] {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] api_rate_limit = True {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] auth_strategy = keystone {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_availability_zone = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_host = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_name = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_stats_polling_interval = 60 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backup_api_class = cinder.backup.api.API {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backup_name_template = backup-%s {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backup_use_same_host = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backup_use_temp_snapshot = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] chap_password = **** {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] chap_username = {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] cinder_internal_tenant_project_id = 92cae3803bb64654a8e42489ab88cc18 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] cinder_internal_tenant_user_id = 9307061b8c134c5f8a030f9bbae77b19 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] cluster = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] compression_format = gzip {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] compute_api_class = cinder.compute.nova.API {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] config_dir = [] {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] config_source = [] {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] control_exchange = openstack {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] debug = True {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] default_availability_zone = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91316]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] default_group_type = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] default_volume_type = QuobyteHD {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] disk_geometry = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] driver_client_cert = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] driver_client_cert_key = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] driver_data_namespace = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] driver_ssl_cert_path = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] driver_ssl_cert_verify = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] driver_use_ssl = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] enable_new_services = True {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] enable_unsupported_driver = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] enabled_backends = ['QuobyteHD'] {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] enforce_multipath_for_image_xfer = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] filter_function = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] glance_api_insecure = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] glance_api_servers = ['http://192.168.122.134/image'] {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] glance_api_ssl_compression = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] glance_ca_certificates_file = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] glance_catalog_info = image:glance:publicURL {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] glance_certfile = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] glance_keyfile = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] glance_num_retries = 3 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] glance_request_timeout = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] goodness_function = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] graceful_shutdown_timeout = 5 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] group_api_class = cinder.group.api.API {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] host = devstack {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] image_compress_on_upload = True {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] image_conversion_address_space_limit = 1 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] image_conversion_cpu_limit = 60 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] image_conversion_disable = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] image_upload_use_cinder_backend = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] image_upload_use_internal_tenant = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] image_volume_cache_enabled = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] image_volume_cache_max_count = 0 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] image_volume_cache_max_size_gb = 0 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] init_host_max_objects_retrieval = 0 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] instance_format = [instance: %(uuid)s] {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] iscsi_target_flags = {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] iscsi_write_cache = on {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] iser_helper = tgtadm {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] iser_ip_address = 192.168.122.134 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] iser_port = 3260 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91316]: INFO cinder.volume.manager [None req-b3b1b870-9e5f-498a-936a-db72dac85289 None None] Starting volume driver QuobyteDriver (1.1.14) Jun 17 05:36:25 devstack cinder-volume[91316]: DEBUG cinder.volume.drivers.remotefs [None req-b3b1b870-9e5f-498a-936a-db72dac85289 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=91316) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] log_color = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] log_config_append = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] log_dir = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] log_file = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] log_options = True {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] log_rotate_interval = 1 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] log_rotate_interval_type = days {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] log_rotation_type = none {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] max_age = 0 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] max_logfile_count = 30 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] max_logfile_size_mb = 200 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] max_over_subscription_ratio = 20.0 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] message_reap_interval = 86400 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] message_ttl = 2592000 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] migration_create_volume_timeout_secs = 300 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] monkey_patch = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] monkey_patch_modules = [] {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] my_ip = 192.168.122.134 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] no_snapshot_gb_quota = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] num_iser_scan_tries = 3 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] num_shell_tries = 3 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] num_volume_device_scan_tries = 3 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] nvmeof_conn_info_version = 1 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] nvmet_ns_id = 10 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] nvmet_port_id = 1 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] osapi_max_limit = 1000 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] osapi_volume_ext_list = [] {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] osapi_volume_listen = 0.0.0.0 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] osapi_volume_listen_port = 8776 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] osapi_volume_use_ssl = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] osapi_volume_workers = 2 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] per_volume_size_limit = -1 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] periodic_fuzzy_delay = 60 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] periodic_interval = 60 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] project_id_regex = [0-9a-f\-]+ {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] public_endpoint = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] publish_errors = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] quota_backup_gigabytes = 1000 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] quota_backups = 10 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] quota_gigabytes = 1000 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] quota_groups = 10 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] quota_snapshots = 10 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] quota_volumes = 10 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] rate_limit_burst = 0 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] rate_limit_except_level = CRITICAL {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] rate_limit_interval = 0 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] reinit_driver_count = 3 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] replication_device = **** {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] report_discard_supported = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] report_interval = 120 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] reservation_clean_interval = 86400 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] reservation_expire = 86400 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] reserved_image_namespaces = [] {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] reserved_percentage = 0 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] rpc_response_timeout = 120 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] run_external_periodic_tasks = True {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] scst_target_driver = iscsi {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] scst_target_iqn_name = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] service_down_time = 720 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] shell_completion = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] snapshot_name_template = snapshot-%s {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] split_loggers = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] state_path = /opt/stack/data/cinder {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] storage_availability_zone = nova {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] storage_protocol = iSCSI {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] syslog_log_facility = LOG_USER {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] target_helper = lioadm {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] target_ip_address = 192.168.122.134 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] target_port = 3260 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] target_protocol = iscsi {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] target_secondary_ip_addresses = [] {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] trace_flags = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] transfer_api_class = cinder.transfer.api.API {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] transport_url = **** {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] until_refresh = 0 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] use_chap_auth = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] use_default_quota_class = True {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] use_journal = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] use_json = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] use_multipath_for_image_xfer = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] use_stderr = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] use_syslog = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] verify_glance_signatures = enabled {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] volume_api_class = cinder.volume.api.API {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] volume_backend_name = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] volume_clear = zero {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] volume_clear_ionice = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] volume_clear_size = 0 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] volume_copy_bps_limit = 0 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] volume_dd_blocksize = 1M {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] volume_name_template = volume-%s {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] volume_service_inithost_offload = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] volume_usage_audit_period = month {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] zoning_mode = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] oslo_concurrency.disable_process_locking = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] os_brick.lightos_discovery_client_address = localhost {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] os_brick.wait_mpath_device_interval = 1 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] keystone_authtoken.admin_password = **** {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] keystone_authtoken.admin_tenant_name = admin {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] keystone_authtoken.admin_token = **** {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] keystone_authtoken.admin_user = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] keystone_authtoken.auth_admin_prefix = {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] keystone_authtoken.auth_port = 35357 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] keystone_authtoken.auth_protocol = https {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] keystone_authtoken.auth_section = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] keystone_authtoken.auth_type = password {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] keystone_authtoken.auth_uri = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] keystone_authtoken.auth_version = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] keystone_authtoken.cache = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] keystone_authtoken.certfile = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] keystone_authtoken.delay_auth_decision = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] keystone_authtoken.http_connect_timeout = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] keystone_authtoken.identity_uri = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] keystone_authtoken.include_service_catalog = True {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] keystone_authtoken.insecure = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] keystone_authtoken.interface = public {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] keystone_authtoken.keyfile = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] keystone_authtoken.memcache_password = {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] keystone_authtoken.memcache_secret_key = **** {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] keystone_authtoken.memcache_security_strategy = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] keystone_authtoken.memcache_username = {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] keystone_authtoken.region_name = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] keystone_authtoken.service_token_roles_required = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] keystone_authtoken.service_type = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] keystone_authtoken.token_cache_time = 300 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.134/identity {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] cache.backend = dogpile.cache.null {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] cache.backend_argument = **** {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] cache.backend_expiration_time = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] cache.config_prefix = cache.oslo {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] cache.debug_cache_backend = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] cache.enable_retry_client = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] cache.enable_socket_keepalive = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] cache.enabled = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] cache.enforce_fips_mode = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] cache.expiration_time = 600 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] cache.hashclient_dead_timeout = 60.0 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] cache.hashclient_retry_attempts = 2 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] cache.hashclient_retry_timeout = 1.0 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] cache.memcache_dead_retry = 300 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] cache.memcache_pool_maxsize = 10 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] cache.memcache_sasl_enabled = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] cache.memcache_servers = ['localhost:11211'] {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] cache.password = **** {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] cache.proxies = [] {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] cache.redis_db = 0 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] cache.redis_sentinel_service_name = mymaster {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] cache.redis_server = localhost:6379 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] cache.retry_attempts = 2 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] cache.retry_delay = 0.0 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] cache.socket_keepalive_count = 1 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] cache.socket_keepalive_idle = 1 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] cache.socket_keepalive_interval = 1 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] cache.socket_timeout = 1.0 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] cache.tls_allowed_ciphers = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] cache.tls_cafile = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] cache.tls_certfile = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] cache.tls_enabled = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] cache.tls_keyfile = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] cache.username = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] database.asyncio_connection = **** {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] database.asyncio_slave_connection = **** {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] database.backend = sqlalchemy {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] database.connection = **** {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] database.connection_debug = 0 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] database.connection_parameters = {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] database.connection_recycle_time = 3600 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] database.connection_trace = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] database.db_inc_retry_interval = True {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] database.db_max_retries = 20 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] database.db_max_retry_interval = 10 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] database.db_retry_interval = 1 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] database.max_overflow = 50 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] database.max_pool_size = 5 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] database.max_retries = 10 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] database.mysql_sql_mode = TRADITIONAL {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] database.mysql_wsrep_sync_wait = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] database.pool_timeout = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] database.retry_interval = 10 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] database.slave_connection = **** {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] database.sqlite_synchronous = True {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] database.synchronous_reader = True {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] database.use_db_reconnect = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] oslo_messaging_metrics.metrics_process_name = {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] profiler.connection_string = messaging:// {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] profiler.enabled = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] profiler.es_doc_type = notification {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] profiler.es_scroll_size = 10000 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] profiler.es_scroll_time = 2m {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] profiler.filter_error_trace = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] profiler.hmac_keys = **** {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] profiler.sentinel_service_name = mymaster {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] profiler.socket_timeout = 0.1 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] profiler.trace_requests = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] profiler.trace_sqlalchemy = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] profiler_jaeger.process_tags = {} {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] profiler_jaeger.service_name_prefix = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] profiler_otlp.service_name_prefix = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] oslo_policy.enforce_new_defaults = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: WARNING oslo_config.cfg [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] oslo_policy.enforce_scope = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] oslo_policy.policy_default_rule = default {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] oslo_policy.policy_file = policy.yaml {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] oslo_policy.remote_timeout = 60.0 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] coordination.backend_url = **** {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] privsep_osbrick.capabilities = [21, 2] {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] privsep_osbrick.group = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] privsep_osbrick.helper_command = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] privsep_osbrick.log_daemon_traceback = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] privsep_osbrick.thread_pool_size = 4 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] privsep_osbrick.user = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] cinder_sys_admin.group = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] cinder_sys_admin.helper_command = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] cinder_sys_admin.user = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] service_user.auth_section = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] service_user.auth_type = password {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] service_user.cafile = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] service_user.certfile = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] service_user.collect_timing = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] service_user.insecure = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] service_user.keyfile = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] service_user.send_service_user_token = True {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] service_user.split_loggers = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] service_user.timeout = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] glance.auth_section = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] glance.auth_type = password {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] glance.certfile = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] glance.collect_timing = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] glance.insecure = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] glance.keyfile = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] glance.region_name = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] glance.split_loggers = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] glance.timeout = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.backend_availability_zone = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.chap_password = **** {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.chap_username = {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.disk_geometry = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.driver_client_cert = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.driver_client_cert_key = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.driver_data_namespace = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.driver_ssl_cert_path = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91316]: DEBUG cinder.volume.drivers.quobyte [None req-b3b1b870-9e5f-498a-936a-db72dac85289 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=91316) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 17 05:36:25 devstack cinder-volume[91316]: WARNING cinder.volume.drivers.quobyte [None req-b3b1b870-9e5f-498a-936a-db72dac85289 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 17 05:36:25 devstack cinder-volume[91316]: WARNING cinder.volume.drivers.quobyte [None req-b3b1b870-9e5f-498a-936a-db72dac85289 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.driver_use_ssl = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.enable_unsupported_driver = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91316]: DEBUG oslo_concurrency.processutils [None req-b3b1b870-9e5f-498a-936a-db72dac85289 None None] Running cmd (subprocess): mount.quobyte {{(pid=91316) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.extra_capabilities = {} {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.filter_function = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.goodness_function = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.image_volume_cache_enabled = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.iscsi_target_flags = {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.iscsi_write_cache = on {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.iser_helper = tgtadm {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.iser_ip_address = 192.168.122.134 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.iser_port = 3260 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.nas_host = {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.nas_login = admin {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.nas_mount_options = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.nas_password = **** {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.nas_private_key = {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.nas_secure_file_operations = auto {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.nas_share_path = {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.nas_ssh_port = 22 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.nas_volume_prov_type = thin {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.num_shell_tries = 3 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.nvmet_ns_id = 10 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.nvmet_port_id = 1 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.quobyte_client_cfg = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.quobyte_volume_url = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.replication_device = **** {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.report_discard_supported = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.reserved_percentage = 0 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.scst_target_driver = iscsi {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.scst_target_iqn_name = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.storage_protocol = iSCSI {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.target_helper = tgtadm {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.target_ip_address = 192.168.122.134 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.target_port = 3260 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.target_protocol = iscsi {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.trace_flags = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.unique_fqdn_network = True {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.use_chap_auth = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.volume_backend_name = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.volume_clear = zero {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.volume_clear_ionice = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.volume_clear_size = 0 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] oslo_reports.file_event_handler = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] oslo_reports.log_dir = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.backend_availability_zone = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.backend_host = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.chap_password = **** {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.chap_username = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.chiscsi_conf = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.disk_geometry = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.driver_client_cert = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.driver_client_cert_key = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.driver_data_namespace = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.driver_use_ssl = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.enable_unsupported_driver = True {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.extra_capabilities = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.filter_function = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.goodness_function = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.iscsi_target_flags = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.iscsi_write_cache = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.iser_helper = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.iser_ip_address = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.iser_port = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.iser_target_prefix = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.nas_host = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.nas_login = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.nas_mount_options = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.nas_password = **** {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.nas_private_key = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.nas_secure_file_operations = false {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.nas_share_path = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.nas_ssh_port = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.nas_volume_prov_type = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.num_iser_scan_tries = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.num_shell_tries = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.nvmet_ns_id = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.nvmet_port_id = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.replication_device = **** {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.report_discard_supported = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.reserved_percentage = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.scst_target_driver = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.scst_target_iqn_name = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.storage_protocol = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.target_helper = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.target_ip_address = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.target_port = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.target_prefix = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.target_protocol = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.trace_flags = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.unique_fqdn_network = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.use_chap_auth = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.volume_clear = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.volume_clear_ionice = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.volume_clear_size = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.volume_dd_blocksize = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] QuobyteHD.volumes_dir = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] oslo_messaging_rabbit.hostname = devstack {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] oslo_messaging_rabbit.ssl = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] oslo_messaging_rabbit.ssl_version = {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] oslo_messaging_notifications.driver = [] {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] oslo_messaging_notifications.retry = -1 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] oslo_messaging_notifications.transport_url = **** {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] key_manager.fixed_key = **** {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] barbican.barbican_api_version = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack quobyte-client[91326]: Reading configuration file: /etc/quobyte/client.cfg Jun 17 05:36:25 devstack quobyte-client[91326]: Invalid parameters found, error: missing mount point. Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] barbican.barbican_endpoint = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] barbican.barbican_endpoint_type = public {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] barbican.barbican_region_name = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] barbican.cafile = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack quobyte-client[91326]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jun 17 05:36:25 devstack cinder-volume[91316]: DEBUG oslo_concurrency.processutils [None req-b3b1b870-9e5f-498a-936a-db72dac85289 None None] CMD "mount.quobyte" returned: 1 in 0.133s {{(pid=91316) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:36:25 devstack cinder-volume[91316]: DEBUG oslo_concurrency.lockutils [None req-b3b1b870-9e5f-498a-936a-db72dac85289 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91316) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:36:25 devstack cinder-volume[91316]: DEBUG oslo_concurrency.lockutils [None req-b3b1b870-9e5f-498a-936a-db72dac85289 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91316) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:36:25 devstack cinder-volume[91316]: DEBUG cinder.volume.drivers.quobyte [None req-b3b1b870-9e5f-498a-936a-db72dac85289 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=91316) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:36:25 devstack quobyte-client[91326]: Failed to parse all commandline parameters, please use -h/--help to see available options. Jun 17 05:36:25 devstack cinder-volume[91316]: INFO cinder.volume.drivers.quobyte [None req-b3b1b870-9e5f-498a-936a-db72dac85289 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f ... Jun 17 05:36:25 devstack cinder-volume[91316]: DEBUG oslo_concurrency.processutils [None req-b3b1b870-9e5f-498a-936a-db72dac85289 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 -c /etc/quobyte/client-cinder.cfg {{(pid=91316) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] barbican.certfile = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] barbican.collect_timing = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] barbican.insecure = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] barbican.keyfile = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] barbican.number_of_retries = 60 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] barbican.retry_delay = 1 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] barbican.send_service_user_token = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] barbican.split_loggers = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] barbican.timeout = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] barbican.verify_ssl = True {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] barbican.verify_ssl_path = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] barbican_service_user.auth_section = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] barbican_service_user.auth_type = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] barbican_service_user.cafile = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] barbican_service_user.certfile = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] barbican_service_user.collect_timing = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] barbican_service_user.insecure = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] barbican_service_user.keyfile = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] barbican_service_user.split_loggers = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] barbican_service_user.timeout = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] vault.approle_role_id = **** {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] vault.approle_secret_id = **** {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] vault.kv_mountpoint = secret {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] vault.kv_path = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] vault.kv_version = 2 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] vault.namespace = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] vault.root_token_id = **** {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] vault.ssl_ca_crt_file = None {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] vault.timeout = 60.0 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] vault.use_ssl = False {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:25 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] ******************************************************************************** {{(pid=91110) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Jun 17 05:36:25 devstack sudo[91327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 -c /etc/quobyte/client-cinder.cfg Jun 17 05:36:25 devstack sudo[91327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:36:26 devstack sudo[91327]: pam_unix(sudo:session): session closed for user root Jun 17 05:36:26 devstack cinder-volume[91316]: DEBUG oslo_concurrency.processutils [None req-b3b1b870-9e5f-498a-936a-db72dac85289 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.790s {{(pid=91316) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:36:26 devstack cinder-volume[91316]: INFO cinder.volume.drivers.quobyte [None req-b3b1b870-9e5f-498a-936a-db72dac85289 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f succeeded Jun 17 05:36:26 devstack cinder-volume[91316]: DEBUG cinder.volume.drivers.quobyte [None req-b3b1b870-9e5f-498a-936a-db72dac85289 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=91316) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:36:26 devstack cinder-volume[91316]: DEBUG oslo_concurrency.lockutils [None req-b3b1b870-9e5f-498a-936a-db72dac85289 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.801s {{(pid=91316) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:36:26 devstack cinder-volume[91316]: DEBUG oslo_concurrency.processutils [None req-b3b1b870-9e5f-498a-936a-db72dac85289 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=91316) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:36:26 devstack sudo[91400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:36:26 devstack sudo[91400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:36:27 devstack sudo[91400]: pam_unix(sudo:session): session closed for user root Jun 17 05:36:27 devstack cinder-volume[91316]: DEBUG oslo_concurrency.processutils [None req-b3b1b870-9e5f-498a-936a-db72dac85289 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.586s {{(pid=91316) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:36:27 devstack cinder-volume[91316]: INFO cinder.volume.driver [None req-b3b1b870-9e5f-498a-936a-db72dac85289 None None] Driver hasn't implemented _init_vendor_properties() Jun 17 05:36:27 devstack cinder-volume[91316]: DEBUG cinder.volume.driver [None req-b3b1b870-9e5f-498a-936a-db72dac85289 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7578506469727, 'free_capacity_gb': 1775.7578506469727, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=91316) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 17 05:36:27 devstack cinder-volume[91316]: DEBUG oslo_db.sqlalchemy.engines [None req-b3b1b870-9e5f-498a-936a-db72dac85289 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91316) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 17 05:36:27 devstack cinder-volume[91316]: DEBUG dbcounter [-] [91316] Writer thread running {{(pid=91316) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 17 05:36:27 devstack cinder-volume[91316]: DEBUG cinder.db.sqlalchemy.api [None req-b3b1b870-9e5f-498a-936a-db72dac85289 None None] Building query based on filter {{(pid=91316) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3979}} Jun 17 05:36:27 devstack cinder-volume[91316]: DEBUG cinder.image.image_utils [None req-b3b1b870-9e5f-498a-936a-db72dac85289 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=91316) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 17 05:36:27 devstack cinder-volume[91316]: INFO cinder.keymgr.migration [None req-550ba207-d3a6-4359-b9d1-fd779f478800 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 17 05:36:27 devstack cinder-volume[91316]: DEBUG oslo_concurrency.lockutils [None req-b3b1b870-9e5f-498a-936a-db72dac85289 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91316) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:36:27 devstack cinder-volume[91316]: DEBUG oslo_concurrency.lockutils [None req-b3b1b870-9e5f-498a-936a-db72dac85289 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91316) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:36:27 devstack cinder-volume[91316]: DEBUG cinder.volume.drivers.quobyte [None req-b3b1b870-9e5f-498a-936a-db72dac85289 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=91316) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:36:27 devstack cinder-volume[91316]: DEBUG cinder.volume.drivers.quobyte [None req-b3b1b870-9e5f-498a-936a-db72dac85289 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=91316) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:36:27 devstack cinder-volume[91316]: DEBUG oslo_concurrency.lockutils [None req-b3b1b870-9e5f-498a-936a-db72dac85289 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91316) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:36:27 devstack cinder-volume[91316]: DEBUG oslo_concurrency.processutils [None req-b3b1b870-9e5f-498a-936a-db72dac85289 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=91316) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:36:27 devstack sudo[91403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:36:27 devstack sudo[91403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:36:27 devstack sudo[91403]: pam_unix(sudo:session): session closed for user root Jun 17 05:36:27 devstack cinder-volume[91316]: DEBUG oslo_concurrency.processutils [None req-b3b1b870-9e5f-498a-936a-db72dac85289 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.594s {{(pid=91316) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:36:27 devstack cinder-volume[91316]: DEBUG cinder.manager [None req-b3b1b870-9e5f-498a-936a-db72dac85289 None None] Notifying Schedulers of capabilities ... {{(pid=91316) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:36:27 devstack cinder-volume[91316]: INFO cinder.volume.manager [None req-b3b1b870-9e5f-498a-936a-db72dac85289 None None] Driver initialization completed successfully. Jun 17 05:36:27 devstack cinder-volume[91316]: INFO cinder.manager [None req-b3b1b870-9e5f-498a-936a-db72dac85289 None None] Initiating service 3 cleanup Jun 17 05:36:27 devstack cinder-volume[91316]: INFO cinder.manager [None req-b3b1b870-9e5f-498a-936a-db72dac85289 None None] Service 3 cleanup completed. Jun 17 05:36:27 devstack cinder-volume[91316]: DEBUG cinder.service [None req-b3b1b870-9e5f-498a-936a-db72dac85289 None None] Creating RPC server for service cinder-volume {{(pid=91316) start /opt/stack/cinder/cinder/service.py:231}} Jun 17 05:36:27 devstack cinder-volume[91316]: DEBUG cinder.service [None req-b3b1b870-9e5f-498a-936a-db72dac85289 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=91316) start /opt/stack/cinder/cinder/service.py:237}} Jun 17 05:36:28 devstack cinder-volume[91316]: INFO cinder.volume.manager [None req-b3b1b870-9e5f-498a-936a-db72dac85289 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 17 05:36:28 devstack cinder-volume[91316]: DEBUG oslo_concurrency.lockutils [None req-b3b1b870-9e5f-498a-936a-db72dac85289 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91316) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:36:28 devstack cinder-volume[91316]: DEBUG oslo_concurrency.lockutils [None req-b3b1b870-9e5f-498a-936a-db72dac85289 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91316) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:36:28 devstack cinder-volume[91316]: DEBUG cinder.volume.drivers.quobyte [None req-b3b1b870-9e5f-498a-936a-db72dac85289 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=91316) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:36:28 devstack cinder-volume[91316]: DEBUG cinder.volume.drivers.quobyte [None req-b3b1b870-9e5f-498a-936a-db72dac85289 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=91316) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:36:28 devstack cinder-volume[91316]: DEBUG oslo_concurrency.lockutils [None req-b3b1b870-9e5f-498a-936a-db72dac85289 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91316) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:36:28 devstack cinder-volume[91316]: DEBUG oslo_concurrency.processutils [None req-b3b1b870-9e5f-498a-936a-db72dac85289 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=91316) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:36:28 devstack sudo[91409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:36:28 devstack sudo[91409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:36:28 devstack sudo[91409]: pam_unix(sudo:session): session closed for user root Jun 17 05:36:28 devstack cinder-volume[91316]: DEBUG oslo_concurrency.processutils [None req-b3b1b870-9e5f-498a-936a-db72dac85289 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.689s {{(pid=91316) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:36:28 devstack cinder-volume[91316]: INFO cinder.volume.manager [None req-b3b1b870-9e5f-498a-936a-db72dac85289 None None] Driver post RPC initialization completed successfully. Jun 17 05:36:32 devstack cinder-volume[91316]: DEBUG oslo_concurrency.lockutils [None req-acb0ffb2-3c21-4fb9-987a-bec80fe09ca4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91316) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:36:32 devstack cinder-volume[91316]: DEBUG oslo_concurrency.lockutils [None req-acb0ffb2-3c21-4fb9-987a-bec80fe09ca4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91316) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:36:32 devstack cinder-volume[91316]: DEBUG cinder.volume.drivers.quobyte [None req-acb0ffb2-3c21-4fb9-987a-bec80fe09ca4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=91316) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:36:32 devstack cinder-volume[91316]: DEBUG cinder.volume.drivers.quobyte [None req-acb0ffb2-3c21-4fb9-987a-bec80fe09ca4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=91316) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:36:32 devstack cinder-volume[91316]: DEBUG oslo_concurrency.lockutils [None req-acb0ffb2-3c21-4fb9-987a-bec80fe09ca4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91316) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:36:32 devstack cinder-volume[91316]: DEBUG oslo_concurrency.processutils [None req-acb0ffb2-3c21-4fb9-987a-bec80fe09ca4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=91316) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:36:32 devstack sudo[91577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:36:32 devstack sudo[91577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:36:33 devstack sudo[91577]: pam_unix(sudo:session): session closed for user root Jun 17 05:36:33 devstack cinder-volume[91316]: DEBUG oslo_concurrency.processutils [None req-acb0ffb2-3c21-4fb9-987a-bec80fe09ca4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.550s {{(pid=91316) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:36:33 devstack cinder-volume[91316]: DEBUG cinder.manager [None req-acb0ffb2-3c21-4fb9-987a-bec80fe09ca4 None None] Notifying Schedulers of capabilities ... {{(pid=91316) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:36:35 devstack cinder-volume[91110]: DEBUG dbcounter [-] [91110] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=91110) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:36:36 devstack cinder-volume[91110]: INFO oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] Caught SIGTERM, stopping children Jun 17 05:36:36 devstack cinder-volume[91110]: DEBUG oslo_concurrency.lockutils [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] Acquiring lock "singleton_lock" {{(pid=91110) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 17 05:36:36 devstack cinder-volume[91110]: DEBUG oslo_concurrency.lockutils [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] Acquired lock "singleton_lock" {{(pid=91110) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 17 05:36:36 devstack cinder-volume[91110]: DEBUG oslo_concurrency.lockutils [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] Releasing lock "singleton_lock" {{(pid=91110) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 17 05:36:36 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] Stop services. {{(pid=91110) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 17 05:36:36 devstack cinder-volume[91110]: DEBUG oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] Killing children. {{(pid=91110) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 17 05:36:36 devstack cinder-volume[91110]: INFO oslo_service.backend._eventlet.service [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] Waiting on 1 children to exit Jun 17 05:36:38 devstack cinder-volume[91316]: DEBUG dbcounter [-] [91316] Writing DB stats cinder:SELECT=2 {{(pid=91316) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:36:38 devstack cinder-volume[91316]: DEBUG dbcounter [-] [91316] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=91316) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:36:41 devstack cinder-volume[91316]: DEBUG oslo_concurrency.lockutils [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] Acquiring lock "singleton_lock" {{(pid=91316) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 17 05:36:41 devstack cinder-volume[91316]: DEBUG oslo_concurrency.lockutils [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] Acquired lock "singleton_lock" {{(pid=91316) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 17 05:36:41 devstack cinder-volume[91316]: DEBUG oslo_concurrency.lockutils [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] Releasing lock "singleton_lock" {{(pid=91316) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 17 05:36:41 devstack cinder-volume[91316]: WARNING amqp [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 17 05:36:41 devstack cinder-volume[91316]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jun 17 05:36:41 devstack cinder-volume[91316]: WARNING amqp [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 17 05:36:41 devstack cinder-volume[91316]: WARNING amqp [None req-17ad930e-c637-429e-ba41-4e57025c7b9d None None] Received method (50, 41) during closing channel 1. This method will be ignored Jun 17 05:36:44 devstack cinder-volume[91806]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=91806) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 17 05:36:44 devstack cinder-volume[91806]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=91806) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 17 05:36:44 devstack cinder-volume[91806]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=91806) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 17 05:36:44 devstack cinder-volume[91806]: INFO dbcounter [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] Registered counter for database cinder Jun 17 05:36:44 devstack cinder-volume[91806]: DEBUG oslo_db.sqlalchemy.engines [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91806) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG dbcounter [-] [91806] Writer thread running {{(pid=91806) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 17 05:36:45 devstack cinder-volume[91806]: INFO cinder.rpc [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 17 05:36:45 devstack cinder-volume[91806]: INFO cinder.rpc [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_db.sqlalchemy.engines [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91806) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 17 05:36:45 devstack cinder-volume[91806]: INFO cinder.volume.manager [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] Determined volume DB was empty at startup. Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG cinder.volume.manager [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=91806) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 17 05:36:45 devstack cinder-volume[91806]: WARNING stevedore.named [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 17 05:36:45 devstack cinder-volume[91806]: WARNING castellan.key_manager [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 17 05:36:45 devstack cinder-volume[91806]: WARNING cinder.keymgr.conf_key_mgr [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 17 05:36:45 devstack cinder-volume[91806]: INFO cinder.volume.manager [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_db.sqlalchemy.engines [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91806) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 17 05:36:45 devstack cinder-volume[91806]: INFO oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] Starting 1 workers Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] Started child 92083 {{(pid=91806) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] Full set of CONF: {{(pid=91806) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] ******************************************************************************** {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] Configuration options gathered from: {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] ================================================================================ {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] allow_availability_zone_fallback = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[92083]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] allow_compression_on_image_upload = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] allowed_direct_url_schemes = [] {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] api_rate_limit = True {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] auth_strategy = keystone {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_availability_zone = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_host = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_name = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_stats_polling_interval = 60 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backup_api_class = cinder.backup.api.API {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backup_name_template = backup-%s {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backup_use_same_host = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backup_use_temp_snapshot = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] chap_password = **** {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] chap_username = {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] cinder_internal_tenant_project_id = 92cae3803bb64654a8e42489ab88cc18 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] cinder_internal_tenant_user_id = 9307061b8c134c5f8a030f9bbae77b19 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] cluster = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] compression_format = gzip {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] compute_api_class = cinder.compute.nova.API {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] config_dir = [] {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] config_source = [] {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] control_exchange = openstack {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] debug = True {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] default_availability_zone = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] default_group_type = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] default_volume_type = QuobyteHD {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] disk_geometry = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] driver_client_cert = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] driver_client_cert_key = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] driver_data_namespace = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] driver_ssl_cert_path = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] driver_ssl_cert_verify = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] driver_use_ssl = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] enable_new_services = True {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] enable_unsupported_driver = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] enabled_backends = ['QuobyteHD'] {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] enforce_multipath_for_image_xfer = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] filter_function = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] glance_api_insecure = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] glance_api_servers = ['http://192.168.122.134/image'] {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] glance_api_ssl_compression = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] glance_ca_certificates_file = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] glance_catalog_info = image:glance:publicURL {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] glance_certfile = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] glance_keyfile = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] glance_num_retries = 3 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] glance_request_timeout = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] goodness_function = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] graceful_shutdown_timeout = 5 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] group_api_class = cinder.group.api.API {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] host = devstack {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] image_compress_on_upload = True {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] image_conversion_address_space_limit = 1 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] image_conversion_cpu_limit = 60 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] image_conversion_disable = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] image_upload_use_cinder_backend = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] image_upload_use_internal_tenant = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] image_volume_cache_enabled = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] image_volume_cache_max_count = 0 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] image_volume_cache_max_size_gb = 0 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] init_host_max_objects_retrieval = 0 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] instance_format = [instance: %(uuid)s] {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] iscsi_target_flags = {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] iscsi_write_cache = on {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] iser_helper = tgtadm {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] iser_ip_address = 192.168.122.134 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] iser_port = 3260 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] log_color = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] log_config_append = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] log_dir = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] log_file = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] log_options = True {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] log_rotate_interval = 1 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-3b51bc74-e49a-4013-92c4-1bdd04faab1a None None] Starting volume driver QuobyteDriver (1.1.14) Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] log_rotate_interval_type = days {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] log_rotation_type = none {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-3b51bc74-e49a-4013-92c4-1bdd04faab1a None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=92083) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] max_age = 0 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] max_logfile_count = 30 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] max_logfile_size_mb = 200 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] max_over_subscription_ratio = 20.0 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] message_reap_interval = 86400 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] message_ttl = 2592000 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] migration_create_volume_timeout_secs = 300 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] monkey_patch = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] monkey_patch_modules = [] {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] my_ip = 192.168.122.134 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] no_snapshot_gb_quota = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] num_iser_scan_tries = 3 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] num_shell_tries = 3 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] num_volume_device_scan_tries = 3 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] nvmeof_conn_info_version = 1 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] nvmet_ns_id = 10 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] nvmet_port_id = 1 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] osapi_max_limit = 1000 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] osapi_volume_ext_list = [] {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] osapi_volume_listen = 0.0.0.0 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] osapi_volume_listen_port = 8776 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] osapi_volume_use_ssl = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] osapi_volume_workers = 2 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] per_volume_size_limit = -1 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] periodic_fuzzy_delay = 60 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] periodic_interval = 60 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] project_id_regex = [0-9a-f\-]+ {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] public_endpoint = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] publish_errors = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] quota_backup_gigabytes = 1000 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] quota_backups = 10 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] quota_gigabytes = 1000 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] quota_groups = 10 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] quota_snapshots = 10 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] quota_volumes = 10 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] rate_limit_burst = 0 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] rate_limit_except_level = CRITICAL {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] rate_limit_interval = 0 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] reinit_driver_count = 3 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] replication_device = **** {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] report_discard_supported = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] report_interval = 120 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] reservation_clean_interval = 86400 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] reservation_expire = 86400 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] reserved_image_namespaces = [] {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] reserved_percentage = 0 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] rpc_response_timeout = 120 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] run_external_periodic_tasks = True {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] scst_target_driver = iscsi {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] scst_target_iqn_name = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] service_down_time = 720 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] shell_completion = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] snapshot_name_template = snapshot-%s {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] split_loggers = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] state_path = /opt/stack/data/cinder {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] storage_availability_zone = nova {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] storage_protocol = iSCSI {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] syslog_log_facility = LOG_USER {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] target_helper = lioadm {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] target_ip_address = 192.168.122.134 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] target_port = 3260 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] target_protocol = iscsi {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] target_secondary_ip_addresses = [] {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] trace_flags = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] transfer_api_class = cinder.transfer.api.API {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] transport_url = **** {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] until_refresh = 0 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] use_chap_auth = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] use_default_quota_class = True {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] use_journal = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] use_json = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] use_multipath_for_image_xfer = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] use_stderr = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] use_syslog = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] verify_glance_signatures = enabled {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] volume_api_class = cinder.volume.api.API {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] volume_backend_name = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] volume_clear = zero {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] volume_clear_ionice = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] volume_clear_size = 0 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] volume_copy_bps_limit = 0 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] volume_dd_blocksize = 1M {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] volume_name_template = volume-%s {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] volume_service_inithost_offload = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] volume_usage_audit_period = month {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] zoning_mode = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] oslo_concurrency.disable_process_locking = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] keystone_authtoken.admin_password = **** {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] keystone_authtoken.admin_token = **** {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] keystone_authtoken.admin_user = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] keystone_authtoken.auth_admin_prefix = {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] keystone_authtoken.auth_port = 35357 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] keystone_authtoken.auth_protocol = https {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] keystone_authtoken.auth_section = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] keystone_authtoken.auth_type = password {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] keystone_authtoken.auth_uri = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] keystone_authtoken.auth_version = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] keystone_authtoken.cache = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] keystone_authtoken.certfile = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] keystone_authtoken.delay_auth_decision = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] keystone_authtoken.http_connect_timeout = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] keystone_authtoken.identity_uri = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] keystone_authtoken.include_service_catalog = True {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] keystone_authtoken.insecure = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] keystone_authtoken.interface = public {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] keystone_authtoken.keyfile = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] keystone_authtoken.memcache_password = {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] keystone_authtoken.memcache_username = {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] keystone_authtoken.region_name = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] keystone_authtoken.service_token_roles_required = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] keystone_authtoken.service_type = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] keystone_authtoken.token_cache_time = 300 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.134/identity {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] cache.backend = dogpile.cache.null {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] cache.backend_argument = **** {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] cache.backend_expiration_time = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] cache.config_prefix = cache.oslo {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] cache.debug_cache_backend = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] cache.enable_retry_client = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] cache.enable_socket_keepalive = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] cache.enabled = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] cache.enforce_fips_mode = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] cache.expiration_time = 600 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] cache.hashclient_retry_attempts = 2 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] cache.memcache_dead_retry = 300 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] cache.memcache_pool_maxsize = 10 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] cache.memcache_sasl_enabled = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] cache.password = **** {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] cache.proxies = [] {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] cache.redis_db = 0 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] cache.redis_sentinel_service_name = mymaster {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] cache.redis_server = localhost:6379 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] cache.retry_attempts = 2 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] cache.retry_delay = 0.0 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] cache.socket_keepalive_count = 1 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] cache.socket_keepalive_idle = 1 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] cache.socket_keepalive_interval = 1 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] cache.socket_timeout = 1.0 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] cache.tls_allowed_ciphers = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] cache.tls_cafile = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] cache.tls_certfile = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] cache.tls_enabled = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] cache.tls_keyfile = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] cache.username = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] database.asyncio_connection = **** {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] database.asyncio_slave_connection = **** {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] database.backend = sqlalchemy {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] database.connection = **** {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] database.connection_debug = 0 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] database.connection_parameters = {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] database.connection_recycle_time = 3600 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] database.connection_trace = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] database.db_inc_retry_interval = True {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] database.db_max_retries = 20 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] database.db_max_retry_interval = 10 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-3b51bc74-e49a-4013-92c4-1bdd04faab1a None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=92083) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 17 05:36:45 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.quobyte [None req-3b51bc74-e49a-4013-92c4-1bdd04faab1a None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 17 05:36:45 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.quobyte [None req-3b51bc74-e49a-4013-92c4-1bdd04faab1a None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] database.db_retry_interval = 1 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] database.max_overflow = 50 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] database.max_pool_size = 5 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-3b51bc74-e49a-4013-92c4-1bdd04faab1a None None] Running cmd (subprocess): mount.quobyte {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] database.max_retries = 10 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] database.mysql_wsrep_sync_wait = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] database.pool_timeout = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] database.retry_interval = 10 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] database.slave_connection = **** {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] database.sqlite_synchronous = True {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] database.synchronous_reader = True {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] database.use_db_reconnect = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] profiler.connection_string = messaging:// {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] profiler.enabled = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] profiler.es_doc_type = notification {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] profiler.es_scroll_size = 10000 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] profiler.es_scroll_time = 2m {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] profiler.filter_error_trace = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] profiler.hmac_keys = **** {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] profiler.sentinel_service_name = mymaster {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] profiler.socket_timeout = 0.1 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] profiler.trace_requests = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] profiler.trace_sqlalchemy = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] profiler_jaeger.process_tags = {} {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] profiler_jaeger.service_name_prefix = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] profiler_otlp.service_name_prefix = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] oslo_policy.enforce_new_defaults = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: WARNING oslo_config.cfg [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] oslo_policy.enforce_scope = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] oslo_policy.policy_default_rule = default {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] oslo_policy.policy_file = policy.yaml {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] oslo_policy.remote_timeout = 60.0 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] coordination.backend_url = **** {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] privsep_osbrick.group = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] privsep_osbrick.helper_command = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] privsep_osbrick.user = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] cinder_sys_admin.group = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] cinder_sys_admin.helper_command = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] cinder_sys_admin.user = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] service_user.auth_section = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] service_user.auth_type = password {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] service_user.cafile = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] service_user.certfile = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] service_user.collect_timing = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] service_user.insecure = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] service_user.keyfile = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] service_user.send_service_user_token = True {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] service_user.split_loggers = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] service_user.timeout = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] glance.auth_section = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] glance.auth_type = password {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] glance.certfile = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] glance.collect_timing = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] glance.insecure = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] glance.keyfile = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] glance.region_name = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] glance.split_loggers = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] glance.timeout = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.backend_availability_zone = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.chap_password = **** {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.chap_username = {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.disk_geometry = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.driver_client_cert = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.driver_client_cert_key = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.driver_data_namespace = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.driver_use_ssl = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.enable_unsupported_driver = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.extra_capabilities = {} {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.filter_function = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.goodness_function = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.iscsi_target_flags = {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.iscsi_write_cache = on {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.iser_helper = tgtadm {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.iser_ip_address = 192.168.122.134 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.iser_port = 3260 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.nas_host = {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.nas_login = admin {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.nas_mount_options = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.nas_password = **** {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.nas_private_key = {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.nas_share_path = {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.nas_ssh_port = 22 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.num_shell_tries = 3 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.nvmet_port_id = 1 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.quobyte_client_cfg = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.quobyte_volume_url = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.replication_device = **** {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.report_discard_supported = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.reserved_percentage = 0 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.scst_target_driver = iscsi {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.scst_target_iqn_name = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.storage_protocol = iSCSI {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.target_helper = tgtadm {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.target_ip_address = 192.168.122.134 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.target_port = 3260 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.target_protocol = iscsi {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.trace_flags = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.unique_fqdn_network = True {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.use_chap_auth = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.volume_backend_name = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.volume_clear = zero {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.volume_clear_ionice = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.volume_clear_size = 0 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] oslo_reports.file_event_handler = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] oslo_reports.log_dir = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.backend_availability_zone = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.backend_host = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.chap_password = **** {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.chap_username = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.chiscsi_conf = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.disk_geometry = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.driver_client_cert = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.driver_client_cert_key = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.driver_data_namespace = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.driver_use_ssl = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.extra_capabilities = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.filter_function = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.goodness_function = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.iscsi_target_flags = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.iscsi_write_cache = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.iser_helper = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.iser_ip_address = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.iser_port = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.iser_target_prefix = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.nas_host = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.nas_login = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.nas_mount_options = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.nas_password = **** {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.nas_private_key = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.nas_share_path = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.nas_ssh_port = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.num_shell_tries = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack quobyte-client[92085]: Reading configuration file: /etc/quobyte/client.cfg Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.nvmet_ns_id = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.nvmet_port_id = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack quobyte-client[92085]: Invalid parameters found, error: missing mount point. Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack quobyte-client[92085]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.replication_device = **** {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack quobyte-client[92085]: Failed to parse all commandline parameters, please use -h/--help to see available options. Jun 17 05:36:45 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-3b51bc74-e49a-4013-92c4-1bdd04faab1a None None] CMD "mount.quobyte" returned: 1 in 0.073s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.report_discard_supported = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.reserved_percentage = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.scst_target_driver = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-3b51bc74-e49a-4013-92c4-1bdd04faab1a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.storage_protocol = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-3b51bc74-e49a-4013-92c4-1bdd04faab1a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.target_helper = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-3b51bc74-e49a-4013-92c4-1bdd04faab1a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.target_ip_address = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.target_port = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.target_prefix = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.target_protocol = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.trace_flags = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.unique_fqdn_network = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.use_chap_auth = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.volume_clear = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.volume_clear_ionice = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.volume_clear_size = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] QuobyteHD.volumes_dir = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-3b51bc74-e49a-4013-92c4-1bdd04faab1a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-3b51bc74-e49a-4013-92c4-1bdd04faab1a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-3b51bc74-e49a-4013-92c4-1bdd04faab1a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] oslo_messaging_rabbit.ssl = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] oslo_messaging_rabbit.ssl_version = {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] oslo_messaging_notifications.driver = [] {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] oslo_messaging_notifications.retry = -1 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] oslo_messaging_notifications.transport_url = **** {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] key_manager.fixed_key = **** {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] barbican.barbican_api_version = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] barbican.barbican_endpoint = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] barbican.barbican_endpoint_type = public {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] barbican.barbican_region_name = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] barbican.cafile = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] barbican.certfile = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] barbican.collect_timing = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] barbican.insecure = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] barbican.keyfile = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] barbican.number_of_retries = 60 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] barbican.retry_delay = 1 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] barbican.send_service_user_token = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] barbican.split_loggers = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] barbican.timeout = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] barbican.verify_ssl = True {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] barbican.verify_ssl_path = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] barbican_service_user.auth_section = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] barbican_service_user.auth_type = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] barbican_service_user.cafile = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] barbican_service_user.certfile = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] barbican_service_user.collect_timing = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] barbican_service_user.insecure = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] barbican_service_user.keyfile = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] barbican_service_user.split_loggers = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] barbican_service_user.timeout = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] vault.approle_role_id = **** {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] vault.approle_secret_id = **** {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] vault.kv_mountpoint = secret {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] vault.kv_path = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] vault.kv_version = 2 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] vault.namespace = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] vault.root_token_id = **** {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] vault.ssl_ca_crt_file = None {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] vault.timeout = 60.0 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] vault.use_ssl = False {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 05:36:45 devstack cinder-volume[91806]: DEBUG oslo_service.backend._eventlet.service [None req-c6ff1f04-cd95-46b9-bf37-62563381a7b3 None None] ******************************************************************************** {{(pid=91806) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Jun 17 05:36:45 devstack sudo[92086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:36:45 devstack sudo[92086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:36:46 devstack sudo[92086]: pam_unix(sudo:session): session closed for user root Jun 17 05:36:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-3b51bc74-e49a-4013-92c4-1bdd04faab1a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.583s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:36:46 devstack cinder-volume[92083]: INFO cinder.volume.driver [None req-3b51bc74-e49a-4013-92c4-1bdd04faab1a None None] Driver hasn't implemented _init_vendor_properties() Jun 17 05:36:46 devstack cinder-volume[92083]: DEBUG cinder.volume.driver [None req-3b51bc74-e49a-4013-92c4-1bdd04faab1a None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7578506469727, 'free_capacity_gb': 1775.7578506469727, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=92083) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 17 05:36:46 devstack cinder-volume[92083]: DEBUG oslo_db.sqlalchemy.engines [None req-3b51bc74-e49a-4013-92c4-1bdd04faab1a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92083) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 17 05:36:46 devstack cinder-volume[92083]: DEBUG dbcounter [-] [92083] Writer thread running {{(pid=92083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 17 05:36:46 devstack cinder-volume[92083]: DEBUG cinder.db.sqlalchemy.api [None req-3b51bc74-e49a-4013-92c4-1bdd04faab1a None None] Building query based on filter {{(pid=92083) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3979}} Jun 17 05:36:46 devstack cinder-volume[92083]: DEBUG cinder.image.image_utils [None req-3b51bc74-e49a-4013-92c4-1bdd04faab1a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=92083) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 17 05:36:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-3b51bc74-e49a-4013-92c4-1bdd04faab1a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:36:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-3b51bc74-e49a-4013-92c4-1bdd04faab1a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:36:46 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-3b51bc74-e49a-4013-92c4-1bdd04faab1a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:36:46 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-3b51bc74-e49a-4013-92c4-1bdd04faab1a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:36:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-3b51bc74-e49a-4013-92c4-1bdd04faab1a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:36:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-3b51bc74-e49a-4013-92c4-1bdd04faab1a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:36:46 devstack cinder-volume[92083]: INFO cinder.keymgr.migration [None req-5c551bde-e129-41a5-9bf3-55aa2e7aae33 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 17 05:36:46 devstack sudo[92094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:36:46 devstack sudo[92094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:36:46 devstack sudo[92094]: pam_unix(sudo:session): session closed for user root Jun 17 05:36:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-3b51bc74-e49a-4013-92c4-1bdd04faab1a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.588s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:36:46 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-3b51bc74-e49a-4013-92c4-1bdd04faab1a None None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:36:46 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-3b51bc74-e49a-4013-92c4-1bdd04faab1a None None] Driver initialization completed successfully. Jun 17 05:36:46 devstack cinder-volume[92083]: INFO cinder.manager [None req-3b51bc74-e49a-4013-92c4-1bdd04faab1a None None] Initiating service 3 cleanup Jun 17 05:36:46 devstack cinder-volume[92083]: INFO cinder.manager [None req-3b51bc74-e49a-4013-92c4-1bdd04faab1a None None] Service 3 cleanup completed. Jun 17 05:36:46 devstack cinder-volume[92083]: DEBUG cinder.service [None req-3b51bc74-e49a-4013-92c4-1bdd04faab1a None None] Creating RPC server for service cinder-volume {{(pid=92083) start /opt/stack/cinder/cinder/service.py:231}} Jun 17 05:36:46 devstack cinder-volume[92083]: DEBUG cinder.service [None req-3b51bc74-e49a-4013-92c4-1bdd04faab1a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=92083) start /opt/stack/cinder/cinder/service.py:237}} Jun 17 05:36:46 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-3b51bc74-e49a-4013-92c4-1bdd04faab1a None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 17 05:36:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-3b51bc74-e49a-4013-92c4-1bdd04faab1a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:36:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-3b51bc74-e49a-4013-92c4-1bdd04faab1a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:36:46 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-3b51bc74-e49a-4013-92c4-1bdd04faab1a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:36:46 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-3b51bc74-e49a-4013-92c4-1bdd04faab1a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:36:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-3b51bc74-e49a-4013-92c4-1bdd04faab1a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:36:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-3b51bc74-e49a-4013-92c4-1bdd04faab1a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:36:47 devstack sudo[92124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:36:47 devstack sudo[92124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:36:47 devstack sudo[92124]: pam_unix(sudo:session): session closed for user root Jun 17 05:36:47 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-3b51bc74-e49a-4013-92c4-1bdd04faab1a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.585s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:36:47 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-3b51bc74-e49a-4013-92c4-1bdd04faab1a None None] Driver post RPC initialization completed successfully. Jun 17 05:36:55 devstack cinder-volume[91806]: DEBUG dbcounter [-] [91806] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=91806) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:36:56 devstack cinder-volume[92083]: DEBUG dbcounter [-] [92083] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=92083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:36:57 devstack cinder-volume[92083]: DEBUG dbcounter [-] [92083] Writing DB stats cinder:SELECT=2 {{(pid=92083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:37:27 devstack cinder-volume[92083]: DEBUG oslo_service.periodic_task [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running periodic task VolumeManager._thread_info {{(pid=92083) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 05:37:27 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] thread count: 6 {{(pid=92083) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 17 05:37:27 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] thread info: [<_MainThread(MainThread, started 133483869905024)>, , , , , ] {{(pid=92083) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 17 05:37:44 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-6801a191-df35-454c-8d0f-2a97af317c57 tempest-TaggedAttachmentsTest-1347861742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:37:44 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6801a191-df35-454c-8d0f-2a97af317c57 tempest-TaggedAttachmentsTest-1347861742 None] Flow 'volume_create_manager' (d514e2fb-5a39-4ceb-94f2-f970ac25fbbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:37:44 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6801a191-df35-454c-8d0f-2a97af317c57 tempest-TaggedAttachmentsTest-1347861742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb261804-2ce4-49fa-a248-63e30b35b645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:37:44 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6801a191-df35-454c-8d0f-2a97af317c57 tempest-TaggedAttachmentsTest-1347861742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb261804-2ce4-49fa-a248-63e30b35b645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:37:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1545786485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e1b9db3-e9d0-4900-b87f-95245c4066e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b4582c302d4465eb266891ff53c1af4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:37:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:37:44Z,use_quota=True,user_id='a73fee34d85b4106993413aafbcf395d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:37:44 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6801a191-df35-454c-8d0f-2a97af317c57 tempest-TaggedAttachmentsTest-1347861742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f92d1f0-bd34-4dfe-896f-b8bc5ad81eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:37:44 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6801a191-df35-454c-8d0f-2a97af317c57 tempest-TaggedAttachmentsTest-1347861742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f92d1f0-bd34-4dfe-896f-b8bc5ad81eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:37:44 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6801a191-df35-454c-8d0f-2a97af317c57 tempest-TaggedAttachmentsTest-1347861742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85d81483-3516-49bc-af66-2129f09bcc46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:37:44 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6801a191-df35-454c-8d0f-2a97af317c57 tempest-TaggedAttachmentsTest-1347861742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85d81483-3516-49bc-af66-2129f09bcc46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e1b9db3-e9d0-4900-b87f-95245c4066e9', 'volume_name': 'volume-3e1b9db3-e9d0-4900-b87f-95245c4066e9', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:37:44 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6801a191-df35-454c-8d0f-2a97af317c57 tempest-TaggedAttachmentsTest-1347861742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16c815e3-ef9f-42d9-b9ea-34157bdb24d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:37:44 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6801a191-df35-454c-8d0f-2a97af317c57 tempest-TaggedAttachmentsTest-1347861742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16c815e3-ef9f-42d9-b9ea-34157bdb24d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:37:44 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6801a191-df35-454c-8d0f-2a97af317c57 tempest-TaggedAttachmentsTest-1347861742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1e3a637-6c4c-4d97-a26e-b67667dade74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:37:44 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-6801a191-df35-454c-8d0f-2a97af317c57 tempest-TaggedAttachmentsTest-1347861742 None] Volume 3e1b9db3-e9d0-4900-b87f-95245c4066e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e1b9db3-e9d0-4900-b87f-95245c4066e9', 'volume_size': 1} Jun 17 05:37:44 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-6801a191-df35-454c-8d0f-2a97af317c57 tempest-TaggedAttachmentsTest-1347861742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:37:44 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-6801a191-df35-454c-8d0f-2a97af317c57 tempest-TaggedAttachmentsTest-1347861742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:37:44 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-6801a191-df35-454c-8d0f-2a97af317c57 tempest-TaggedAttachmentsTest-1347861742 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:37:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1545786485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e1b9db3-e9d0-4900-b87f-95245c4066e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b4582c302d4465eb266891ff53c1af4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:37:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:37:44Z,use_quota=True,user_id='a73fee34d85b4106993413aafbcf395d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:37:44 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-6801a191-df35-454c-8d0f-2a97af317c57 tempest-TaggedAttachmentsTest-1347861742 None] Creating volume 3e1b9db3-e9d0-4900-b87f-95245c4066e9 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:37:44 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-6801a191-df35-454c-8d0f-2a97af317c57 tempest-TaggedAttachmentsTest-1347861742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:37:44 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-6801a191-df35-454c-8d0f-2a97af317c57 tempest-TaggedAttachmentsTest-1347861742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:37:44 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-6801a191-df35-454c-8d0f-2a97af317c57 tempest-TaggedAttachmentsTest-1347861742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:37:44 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-6801a191-df35-454c-8d0f-2a97af317c57 tempest-TaggedAttachmentsTest-1347861742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:37:44 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-6801a191-df35-454c-8d0f-2a97af317c57 tempest-TaggedAttachmentsTest-1347861742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:37:44 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-6801a191-df35-454c-8d0f-2a97af317c57 tempest-TaggedAttachmentsTest-1347861742 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:37:44 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-6801a191-df35-454c-8d0f-2a97af317c57 tempest-TaggedAttachmentsTest-1347861742 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:37:44 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6801a191-df35-454c-8d0f-2a97af317c57 tempest-TaggedAttachmentsTest-1347861742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-3e1b9db3-e9d0-4900-b87f-95245c4066e9 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:37:44 devstack sudo[92345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-3e1b9db3-e9d0-4900-b87f-95245c4066e9 1073741824 Jun 17 05:37:44 devstack sudo[92345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:37:46 devstack sudo[92345]: pam_unix(sudo:session): session closed for user root Jun 17 05:37:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6801a191-df35-454c-8d0f-2a97af317c57 tempest-TaggedAttachmentsTest-1347861742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-3e1b9db3-e9d0-4900-b87f-95245c4066e9 1073741824" returned: 0 in 2.001s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:37:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6801a191-df35-454c-8d0f-2a97af317c57 tempest-TaggedAttachmentsTest-1347861742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-3e1b9db3-e9d0-4900-b87f-95245c4066e9 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:37:46 devstack sudo[92751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-3e1b9db3-e9d0-4900-b87f-95245c4066e9 Jun 17 05:37:46 devstack sudo[92751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:37:47 devstack sudo[92751]: pam_unix(sudo:session): session closed for user root Jun 17 05:37:47 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6801a191-df35-454c-8d0f-2a97af317c57 tempest-TaggedAttachmentsTest-1347861742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-3e1b9db3-e9d0-4900-b87f-95245c4066e9" returned: 0 in 1.255s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:37:47 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-6801a191-df35-454c-8d0f-2a97af317c57 tempest-TaggedAttachmentsTest-1347861742 None] <== create_volume: return (3402ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:37:47 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-6801a191-df35-454c-8d0f-2a97af317c57 tempest-TaggedAttachmentsTest-1347861742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.407s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:37:47 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6801a191-df35-454c-8d0f-2a97af317c57 tempest-TaggedAttachmentsTest-1347861742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1e3a637-6c4c-4d97-a26e-b67667dade74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e1b9db3-e9d0-4900-b87f-95245c4066e9', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:37:47 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6801a191-df35-454c-8d0f-2a97af317c57 tempest-TaggedAttachmentsTest-1347861742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dfa1efb-b9a5-4fb1-9f7a-f40a1e548cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:37:47 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-6801a191-df35-454c-8d0f-2a97af317c57 tempest-TaggedAttachmentsTest-1347861742 None] Volume volume-3e1b9db3-e9d0-4900-b87f-95245c4066e9 (3e1b9db3-e9d0-4900-b87f-95245c4066e9): created successfully Jun 17 05:37:47 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6801a191-df35-454c-8d0f-2a97af317c57 tempest-TaggedAttachmentsTest-1347861742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dfa1efb-b9a5-4fb1-9f7a-f40a1e548cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:37:47 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6801a191-df35-454c-8d0f-2a97af317c57 tempest-TaggedAttachmentsTest-1347861742 None] Flow 'volume_create_manager' (d514e2fb-5a39-4ceb-94f2-f970ac25fbbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:37:47 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-6801a191-df35-454c-8d0f-2a97af317c57 tempest-TaggedAttachmentsTest-1347861742 None] Created volume successfully. Jun 17 05:37:52 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc3de191-465f-49ec-ae56-a19ffd03fd82 tempest-DeleteServersTestJSON-357910647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:37:52 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-bc3de191-465f-49ec-ae56-a19ffd03fd82 tempest-DeleteServersTestJSON-357910647 None] Flow 'volume_create_manager' (e0c076d3-602f-4ffe-95e8-e3f5f8019ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:37:52 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-bc3de191-465f-49ec-ae56-a19ffd03fd82 tempest-DeleteServersTestJSON-357910647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33435080-2627-40bf-9c62-9fb3db1e2259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:37:52 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-bc3de191-465f-49ec-ae56-a19ffd03fd82 tempest-DeleteServersTestJSON-357910647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33435080-2627-40bf-9c62-9fb3db1e2259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:37:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2012006390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0edf27e1-db14-41f0-b4d0-0a4c80c67f58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d3953ba395e4d6f84b5f9fb254e4df0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:37:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:37:53Z,use_quota=True,user_id='21696960601549678a076f8286a7793d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:37:52 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-bc3de191-465f-49ec-ae56-a19ffd03fd82 tempest-DeleteServersTestJSON-357910647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3b57509-7176-4a44-aac6-0cee72ca32ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:37:52 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-bc3de191-465f-49ec-ae56-a19ffd03fd82 tempest-DeleteServersTestJSON-357910647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3b57509-7176-4a44-aac6-0cee72ca32ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:37:52 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-bc3de191-465f-49ec-ae56-a19ffd03fd82 tempest-DeleteServersTestJSON-357910647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (388a8c1d-3fb1-4af5-8c5e-c9f71052425d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:37:52 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-bc3de191-465f-49ec-ae56-a19ffd03fd82 tempest-DeleteServersTestJSON-357910647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (388a8c1d-3fb1-4af5-8c5e-c9f71052425d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0edf27e1-db14-41f0-b4d0-0a4c80c67f58', 'volume_name': 'volume-0edf27e1-db14-41f0-b4d0-0a4c80c67f58', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:37:52 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-bc3de191-465f-49ec-ae56-a19ffd03fd82 tempest-DeleteServersTestJSON-357910647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebbb489c-60f9-4405-94a4-c7ece714e0e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:37:52 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-bc3de191-465f-49ec-ae56-a19ffd03fd82 tempest-DeleteServersTestJSON-357910647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebbb489c-60f9-4405-94a4-c7ece714e0e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:37:52 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-bc3de191-465f-49ec-ae56-a19ffd03fd82 tempest-DeleteServersTestJSON-357910647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f62fe4e6-5da7-4483-bcfb-4b502af2afeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:37:52 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-bc3de191-465f-49ec-ae56-a19ffd03fd82 tempest-DeleteServersTestJSON-357910647 None] Volume 0edf27e1-db14-41f0-b4d0-0a4c80c67f58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0edf27e1-db14-41f0-b4d0-0a4c80c67f58', 'volume_size': 1} Jun 17 05:37:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-bc3de191-465f-49ec-ae56-a19ffd03fd82 tempest-DeleteServersTestJSON-357910647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:37:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-bc3de191-465f-49ec-ae56-a19ffd03fd82 tempest-DeleteServersTestJSON-357910647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:37:52 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-bc3de191-465f-49ec-ae56-a19ffd03fd82 tempest-DeleteServersTestJSON-357910647 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:37:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2012006390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0edf27e1-db14-41f0-b4d0-0a4c80c67f58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d3953ba395e4d6f84b5f9fb254e4df0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:37:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:37:53Z,use_quota=True,user_id='21696960601549678a076f8286a7793d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:37:52 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-bc3de191-465f-49ec-ae56-a19ffd03fd82 tempest-DeleteServersTestJSON-357910647 None] Creating volume 0edf27e1-db14-41f0-b4d0-0a4c80c67f58 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:37:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-bc3de191-465f-49ec-ae56-a19ffd03fd82 tempest-DeleteServersTestJSON-357910647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:37:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-bc3de191-465f-49ec-ae56-a19ffd03fd82 tempest-DeleteServersTestJSON-357910647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:37:52 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-bc3de191-465f-49ec-ae56-a19ffd03fd82 tempest-DeleteServersTestJSON-357910647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:37:52 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-bc3de191-465f-49ec-ae56-a19ffd03fd82 tempest-DeleteServersTestJSON-357910647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:37:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-bc3de191-465f-49ec-ae56-a19ffd03fd82 tempest-DeleteServersTestJSON-357910647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:37:52 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-bc3de191-465f-49ec-ae56-a19ffd03fd82 tempest-DeleteServersTestJSON-357910647 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:37:52 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-bc3de191-465f-49ec-ae56-a19ffd03fd82 tempest-DeleteServersTestJSON-357910647 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:37:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-bc3de191-465f-49ec-ae56-a19ffd03fd82 tempest-DeleteServersTestJSON-357910647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0edf27e1-db14-41f0-b4d0-0a4c80c67f58 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:37:52 devstack sudo[92802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0edf27e1-db14-41f0-b4d0-0a4c80c67f58 1073741824 Jun 17 05:37:52 devstack sudo[92802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:37:54 devstack sudo[92802]: pam_unix(sudo:session): session closed for user root Jun 17 05:37:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-bc3de191-465f-49ec-ae56-a19ffd03fd82 tempest-DeleteServersTestJSON-357910647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0edf27e1-db14-41f0-b4d0-0a4c80c67f58 1073741824" returned: 0 in 1.272s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:37:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-bc3de191-465f-49ec-ae56-a19ffd03fd82 tempest-DeleteServersTestJSON-357910647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0edf27e1-db14-41f0-b4d0-0a4c80c67f58 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:37:54 devstack sudo[92838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0edf27e1-db14-41f0-b4d0-0a4c80c67f58 Jun 17 05:37:54 devstack sudo[92838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:37:55 devstack sudo[92838]: pam_unix(sudo:session): session closed for user root Jun 17 05:37:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-bc3de191-465f-49ec-ae56-a19ffd03fd82 tempest-DeleteServersTestJSON-357910647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0edf27e1-db14-41f0-b4d0-0a4c80c67f58" returned: 0 in 0.967s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:37:55 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-bc3de191-465f-49ec-ae56-a19ffd03fd82 tempest-DeleteServersTestJSON-357910647 None] <== create_volume: return (2334ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:37:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-bc3de191-465f-49ec-ae56-a19ffd03fd82 tempest-DeleteServersTestJSON-357910647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.336s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:37:55 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-bc3de191-465f-49ec-ae56-a19ffd03fd82 tempest-DeleteServersTestJSON-357910647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f62fe4e6-5da7-4483-bcfb-4b502af2afeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0edf27e1-db14-41f0-b4d0-0a4c80c67f58', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:37:55 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-bc3de191-465f-49ec-ae56-a19ffd03fd82 tempest-DeleteServersTestJSON-357910647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a6d53b4-1e20-49b4-8902-69a00fc7d015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:37:55 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-bc3de191-465f-49ec-ae56-a19ffd03fd82 tempest-DeleteServersTestJSON-357910647 None] Volume volume-0edf27e1-db14-41f0-b4d0-0a4c80c67f58 (0edf27e1-db14-41f0-b4d0-0a4c80c67f58): created successfully Jun 17 05:37:55 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-bc3de191-465f-49ec-ae56-a19ffd03fd82 tempest-DeleteServersTestJSON-357910647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a6d53b4-1e20-49b4-8902-69a00fc7d015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:37:55 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-bc3de191-465f-49ec-ae56-a19ffd03fd82 tempest-DeleteServersTestJSON-357910647 None] Flow 'volume_create_manager' (e0c076d3-602f-4ffe-95e8-e3f5f8019ab0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:37:55 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-bc3de191-465f-49ec-ae56-a19ffd03fd82 tempest-DeleteServersTestJSON-357910647 None] Created volume successfully. Jun 17 05:38:04 devstack cinder-volume[92083]: WARNING py.warnings [req-3b362b86-59bb-4749-9ab5-a77a08148387 req-d77662d7-9783-424f-8a56-1902166bf5fe tempest-DeleteServersTestJSON-357910647 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2505: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Jun 17 05:38:04 devstack cinder-volume[92083]: .first() Jun 17 05:38:04 devstack cinder-volume[92083]: Jun 17 05:38:04 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-3b362b86-59bb-4749-9ab5-a77a08148387 req-d77662d7-9783-424f-8a56-1902166bf5fe tempest-DeleteServersTestJSON-357910647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:38:04 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-3b362b86-59bb-4749-9ab5-a77a08148387 req-d77662d7-9783-424f-8a56-1902166bf5fe tempest-DeleteServersTestJSON-357910647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:38:04 devstack cinder-volume[92083]: INFO oslo.privsep.daemon [req-3b362b86-59bb-4749-9ab5-a77a08148387 req-d77662d7-9783-424f-8a56-1902166bf5fe tempest-DeleteServersTestJSON-357910647 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp8eyfkctv/privsep.sock'] Jun 17 05:38:04 devstack sudo[92924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp8eyfkctv/privsep.sock Jun 17 05:38:04 devstack sudo[92924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:38:07 devstack sudo[92924]: pam_unix(sudo:session): session closed for user root Jun 17 05:38:07 devstack cinder-volume[92083]: INFO oslo.privsep.daemon [req-3b362b86-59bb-4749-9ab5-a77a08148387 req-d77662d7-9783-424f-8a56-1902166bf5fe tempest-DeleteServersTestJSON-357910647 None] Spawned new privsep daemon via rootwrap Jun 17 05:38:07 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [req-3b362b86-59bb-4749-9ab5-a77a08148387 req-d77662d7-9783-424f-8a56-1902166bf5fe tempest-DeleteServersTestJSON-357910647 None] Accepted privsep connection to /tmp/tmp8eyfkctv/privsep.sock {{(pid=92083) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:418}} Jun 17 05:38:07 devstack cinder-volume[92083]: INFO oslo.privsep.daemon [-] privsep daemon starting Jun 17 05:38:07 devstack cinder-volume[92083]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jun 17 05:38:07 devstack cinder-volume[92083]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jun 17 05:38:07 devstack cinder-volume[92083]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 92963 Jun 17 05:38:07 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a35e4d-65a8-4ee1-ac4c-a5e5515c1ce0]: (2,) {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:38:07 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d074b5d7-5ad4-4eca-8bbc-56606980eeb2]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:38:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-3b362b86-59bb-4749-9ab5-a77a08148387 req-d77662d7-9783-424f-8a56-1902166bf5fe tempest-DeleteServersTestJSON-357910647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0edf27e1-db14-41f0-b4d0-0a4c80c67f58 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:38:07 devstack sudo[92965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0edf27e1-db14-41f0-b4d0-0a4c80c67f58 Jun 17 05:38:07 devstack sudo[92965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:38:08 devstack sudo[92965]: pam_unix(sudo:session): session closed for user root Jun 17 05:38:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-3b362b86-59bb-4749-9ab5-a77a08148387 req-d77662d7-9783-424f-8a56-1902166bf5fe tempest-DeleteServersTestJSON-357910647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0edf27e1-db14-41f0-b4d0-0a4c80c67f58" returned: 0 in 1.476s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:38:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-3b362b86-59bb-4749-9ab5-a77a08148387 req-d77662d7-9783-424f-8a56-1902166bf5fe tempest-DeleteServersTestJSON-357910647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 4.344s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:38:08 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [req-3b362b86-59bb-4749-9ab5-a77a08148387 req-d77662d7-9783-424f-8a56-1902166bf5fe tempest-DeleteServersTestJSON-357910647 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f', 'name': 'volume-0edf27e1-db14-41f0-b4d0-0a4c80c67f58', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a4209196-7002-4522-883a-250dbf9c0a29', 'enforce_multipath': True} {{(pid=92083) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 17 05:38:08 devstack cinder-volume[92083]: INFO cinder.volume.manager [req-3b362b86-59bb-4749-9ab5-a77a08148387 req-d77662d7-9783-424f-8a56-1902166bf5fe tempest-DeleteServersTestJSON-357910647 None] attachment_update completed successfully. Jun 17 05:38:18 devstack cinder-volume[92083]: DEBUG dbcounter [-] [92083] Writing DB stats cinder:SELECT=9,cinder:UPDATE=5,cinder:INSERT=1,cinder:DELETE=1 {{(pid=92083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:38:18 devstack cinder-volume[92083]: DEBUG dbcounter [-] [92083] Writing DB stats cinder:UPDATE=10,cinder:SELECT=10,cinder:INSERT=1,cinder:DELETE=1 {{(pid=92083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:38:22 devstack cinder-volume[92083]: INFO cinder.volume.manager [req-5d9dcb85-f7d8-44ee-9990-96c63b6c7510 req-3e8c973e-b3ed-40ed-97e1-e1b1adbe40bd tempest-DeleteServersTestJSON-357910647 None] Terminate volume connection completed successfully. Jun 17 05:38:22 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [req-5d9dcb85-f7d8-44ee-9990-96c63b6c7510 req-3e8c973e-b3ed-40ed-97e1-e1b1adbe40bd tempest-DeleteServersTestJSON-357910647 None] Deleting attachment a4209196-7002-4522-883a-250dbf9c0a29. {{(pid=92083) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 17 05:38:22 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-db1437dd-e9f5-495c-b59c-67c16bc61dfa tempest-ServerRescueNegativeTestJSON-1634929663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:38:22 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-db1437dd-e9f5-495c-b59c-67c16bc61dfa tempest-ServerRescueNegativeTestJSON-1634929663 None] Flow 'volume_create_manager' (de72a542-a55b-473a-9ab5-112d9bc36f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:38:22 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-db1437dd-e9f5-495c-b59c-67c16bc61dfa tempest-ServerRescueNegativeTestJSON-1634929663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b552aaf9-739b-4bf3-a26f-b7cc7c335c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:38:22 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-db1437dd-e9f5-495c-b59c-67c16bc61dfa tempest-ServerRescueNegativeTestJSON-1634929663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b552aaf9-739b-4bf3-a26f-b7cc7c335c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:38:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-322502112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdd9dbee-dffa-4bda-8e1a-7f305a25e218,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15c0b38a1b014f6787b0b63fedb50453',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:38:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:38:22Z,use_quota=True,user_id='11e821b709834670974f7b936e50ede8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:38:22 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-db1437dd-e9f5-495c-b59c-67c16bc61dfa tempest-ServerRescueNegativeTestJSON-1634929663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a2a1426-d320-4df2-8d97-232c067efc76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:38:22 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-db1437dd-e9f5-495c-b59c-67c16bc61dfa tempest-ServerRescueNegativeTestJSON-1634929663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a2a1426-d320-4df2-8d97-232c067efc76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:38:22 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-db1437dd-e9f5-495c-b59c-67c16bc61dfa tempest-ServerRescueNegativeTestJSON-1634929663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68dfe208-b078-43ca-b162-ccd6ad992582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:38:22 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-db1437dd-e9f5-495c-b59c-67c16bc61dfa tempest-ServerRescueNegativeTestJSON-1634929663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68dfe208-b078-43ca-b162-ccd6ad992582) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdd9dbee-dffa-4bda-8e1a-7f305a25e218', 'volume_name': 'volume-bdd9dbee-dffa-4bda-8e1a-7f305a25e218', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:38:22 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-db1437dd-e9f5-495c-b59c-67c16bc61dfa tempest-ServerRescueNegativeTestJSON-1634929663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9b6e62a-f687-4ea3-af4a-3ae0fc538602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:38:22 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-db1437dd-e9f5-495c-b59c-67c16bc61dfa tempest-ServerRescueNegativeTestJSON-1634929663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9b6e62a-f687-4ea3-af4a-3ae0fc538602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:38:22 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-db1437dd-e9f5-495c-b59c-67c16bc61dfa tempest-ServerRescueNegativeTestJSON-1634929663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (194d55c7-1b3e-48de-8d16-1b47832ea069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:38:22 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-db1437dd-e9f5-495c-b59c-67c16bc61dfa tempest-ServerRescueNegativeTestJSON-1634929663 None] Volume bdd9dbee-dffa-4bda-8e1a-7f305a25e218: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdd9dbee-dffa-4bda-8e1a-7f305a25e218', 'volume_size': 1} Jun 17 05:38:22 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-db1437dd-e9f5-495c-b59c-67c16bc61dfa tempest-ServerRescueNegativeTestJSON-1634929663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:38:22 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-db1437dd-e9f5-495c-b59c-67c16bc61dfa tempest-ServerRescueNegativeTestJSON-1634929663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:38:22 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-db1437dd-e9f5-495c-b59c-67c16bc61dfa tempest-ServerRescueNegativeTestJSON-1634929663 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:38:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-322502112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdd9dbee-dffa-4bda-8e1a-7f305a25e218,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15c0b38a1b014f6787b0b63fedb50453',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:38:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:38:22Z,use_quota=True,user_id='11e821b709834670974f7b936e50ede8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:38:22 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-db1437dd-e9f5-495c-b59c-67c16bc61dfa tempest-ServerRescueNegativeTestJSON-1634929663 None] Creating volume bdd9dbee-dffa-4bda-8e1a-7f305a25e218 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:38:22 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-db1437dd-e9f5-495c-b59c-67c16bc61dfa tempest-ServerRescueNegativeTestJSON-1634929663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:38:22 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-db1437dd-e9f5-495c-b59c-67c16bc61dfa tempest-ServerRescueNegativeTestJSON-1634929663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:38:22 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-db1437dd-e9f5-495c-b59c-67c16bc61dfa tempest-ServerRescueNegativeTestJSON-1634929663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:38:22 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-db1437dd-e9f5-495c-b59c-67c16bc61dfa tempest-ServerRescueNegativeTestJSON-1634929663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:38:22 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-db1437dd-e9f5-495c-b59c-67c16bc61dfa tempest-ServerRescueNegativeTestJSON-1634929663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:38:22 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-db1437dd-e9f5-495c-b59c-67c16bc61dfa tempest-ServerRescueNegativeTestJSON-1634929663 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:38:22 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-db1437dd-e9f5-495c-b59c-67c16bc61dfa tempest-ServerRescueNegativeTestJSON-1634929663 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:38:22 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-db1437dd-e9f5-495c-b59c-67c16bc61dfa tempest-ServerRescueNegativeTestJSON-1634929663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bdd9dbee-dffa-4bda-8e1a-7f305a25e218 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:38:22 devstack sudo[93655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bdd9dbee-dffa-4bda-8e1a-7f305a25e218 1073741824 Jun 17 05:38:22 devstack sudo[93655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:38:24 devstack sudo[93655]: pam_unix(sudo:session): session closed for user root Jun 17 05:38:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-db1437dd-e9f5-495c-b59c-67c16bc61dfa tempest-ServerRescueNegativeTestJSON-1634929663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bdd9dbee-dffa-4bda-8e1a-7f305a25e218 1073741824" returned: 0 in 1.560s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:38:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-db1437dd-e9f5-495c-b59c-67c16bc61dfa tempest-ServerRescueNegativeTestJSON-1634929663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bdd9dbee-dffa-4bda-8e1a-7f305a25e218 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:38:24 devstack sudo[93660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bdd9dbee-dffa-4bda-8e1a-7f305a25e218 Jun 17 05:38:24 devstack sudo[93660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:38:25 devstack sudo[93660]: pam_unix(sudo:session): session closed for user root Jun 17 05:38:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-db1437dd-e9f5-495c-b59c-67c16bc61dfa tempest-ServerRescueNegativeTestJSON-1634929663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bdd9dbee-dffa-4bda-8e1a-7f305a25e218" returned: 0 in 1.193s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:38:25 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-db1437dd-e9f5-495c-b59c-67c16bc61dfa tempest-ServerRescueNegativeTestJSON-1634929663 None] <== create_volume: return (2854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:38:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-db1437dd-e9f5-495c-b59c-67c16bc61dfa tempest-ServerRescueNegativeTestJSON-1634929663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.856s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:38:25 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-db1437dd-e9f5-495c-b59c-67c16bc61dfa tempest-ServerRescueNegativeTestJSON-1634929663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (194d55c7-1b3e-48de-8d16-1b47832ea069) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdd9dbee-dffa-4bda-8e1a-7f305a25e218', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:38:25 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-db1437dd-e9f5-495c-b59c-67c16bc61dfa tempest-ServerRescueNegativeTestJSON-1634929663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb5d386a-47b3-441c-a380-a860f1299247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:38:25 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-db1437dd-e9f5-495c-b59c-67c16bc61dfa tempest-ServerRescueNegativeTestJSON-1634929663 None] Volume volume-bdd9dbee-dffa-4bda-8e1a-7f305a25e218 (bdd9dbee-dffa-4bda-8e1a-7f305a25e218): created successfully Jun 17 05:38:25 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-db1437dd-e9f5-495c-b59c-67c16bc61dfa tempest-ServerRescueNegativeTestJSON-1634929663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb5d386a-47b3-441c-a380-a860f1299247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:38:25 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-db1437dd-e9f5-495c-b59c-67c16bc61dfa tempest-ServerRescueNegativeTestJSON-1634929663 None] Flow 'volume_create_manager' (de72a542-a55b-473a-9ab5-112d9bc36f3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:38:25 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-db1437dd-e9f5-495c-b59c-67c16bc61dfa tempest-ServerRescueNegativeTestJSON-1634929663 None] Created volume successfully. Jun 17 05:38:26 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-cd482725-7e35-49d0-af14-880f820a1ae8 tempest-DeleteServersTestJSON-357910647 None] Acquiring lock "cinder-0edf27e1-db14-41f0-b4d0-0a4c80c67f58-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:38:26 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-cd482725-7e35-49d0-af14-880f820a1ae8 tempest-DeleteServersTestJSON-357910647 None] Lock "cinder-0edf27e1-db14-41f0-b4d0-0a4c80c67f58-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:38:26 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-cd482725-7e35-49d0-af14-880f820a1ae8 tempest-DeleteServersTestJSON-357910647 None] Acquiring lock "cinder-quobyte-0edf27e1-db14-41f0-b4d0-0a4c80c67f58" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:38:26 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-cd482725-7e35-49d0-af14-880f820a1ae8 tempest-DeleteServersTestJSON-357910647 None] Lock "cinder-quobyte-0edf27e1-db14-41f0-b4d0-0a4c80c67f58" acquired by "delete_volume" :: waited 0.033s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:38:26 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e8db2b4-5098-4246-a484-97a5eb53a2ef]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:38:26 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-cd482725-7e35-49d0-af14-880f820a1ae8 tempest-DeleteServersTestJSON-357910647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0edf27e1-db14-41f0-b4d0-0a4c80c67f58 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:38:27 devstack sudo[93665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0edf27e1-db14-41f0-b4d0-0a4c80c67f58 Jun 17 05:38:27 devstack sudo[93665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:38:27 devstack cinder-volume[92083]: DEBUG oslo_service.periodic_task [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92083) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 05:38:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:38:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:38:27 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:38:27 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:38:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:38:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:38:27 devstack sudo[93667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:38:27 devstack sudo[93667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:38:29 devstack sudo[93665]: pam_unix(sudo:session): session closed for user root Jun 17 05:38:29 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-cd482725-7e35-49d0-af14-880f820a1ae8 tempest-DeleteServersTestJSON-357910647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0edf27e1-db14-41f0-b4d0-0a4c80c67f58" returned: 0 in 2.098s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:38:29 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-cd482725-7e35-49d0-af14-880f820a1ae8 tempest-DeleteServersTestJSON-357910647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0edf27e1-db14-41f0-b4d0-0a4c80c67f58 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:38:29 devstack sudo[93674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0edf27e1-db14-41f0-b4d0-0a4c80c67f58 Jun 17 05:38:29 devstack sudo[93674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:38:29 devstack sudo[93667]: pam_unix(sudo:session): session closed for user root Jun 17 05:38:29 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 1.915s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:38:29 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:38:29 devstack cinder-volume[92083]: DEBUG oslo_service.periodic_task [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running periodic task VolumeManager._thread_info {{(pid=92083) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 05:38:29 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] thread count: 8 {{(pid=92083) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 17 05:38:29 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] thread info: [<_MainThread(MainThread, started 133483869905024)>, , , , , , , ] {{(pid=92083) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 17 05:38:30 devstack sudo[93674]: pam_unix(sudo:session): session closed for user root Jun 17 05:38:30 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-cd482725-7e35-49d0-af14-880f820a1ae8 tempest-DeleteServersTestJSON-357910647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0edf27e1-db14-41f0-b4d0-0a4c80c67f58" returned: 0 in 1.252s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:38:30 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-cd482725-7e35-49d0-af14-880f820a1ae8 tempest-DeleteServersTestJSON-357910647 None] Lock "cinder-quobyte-0edf27e1-db14-41f0-b4d0-0a4c80c67f58" released by "delete_volume" :: held 3.435s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:38:30 devstack cinder-volume[92083]: WARNING cinder.quota [None req-cd482725-7e35-49d0-af14-880f820a1ae8 tempest-DeleteServersTestJSON-357910647 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 17 05:38:30 devstack cinder-volume[92083]: WARNING cinder.quota [None req-cd482725-7e35-49d0-af14-880f820a1ae8 tempest-DeleteServersTestJSON-357910647 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 17 05:38:30 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-cd482725-7e35-49d0-af14-880f820a1ae8 tempest-DeleteServersTestJSON-357910647 None] Created reservations ['f5fff241-472c-4242-9514-a9bfb2320759', '8c3de7a0-922c-41dc-9659-a62d8299a980', '12e8506d-ab7d-416f-8ad3-af5ae7a39f28', 'c888a186-7d2f-40ea-9c0d-89d36d7a733b'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:38:30 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-cd482725-7e35-49d0-af14-880f820a1ae8 tempest-DeleteServersTestJSON-357910647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:38:30 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-cd482725-7e35-49d0-af14-880f820a1ae8 tempest-DeleteServersTestJSON-357910647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:38:30 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-cd482725-7e35-49d0-af14-880f820a1ae8 tempest-DeleteServersTestJSON-357910647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:38:30 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-cd482725-7e35-49d0-af14-880f820a1ae8 tempest-DeleteServersTestJSON-357910647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:38:30 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-cd482725-7e35-49d0-af14-880f820a1ae8 tempest-DeleteServersTestJSON-357910647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:38:30 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-cd482725-7e35-49d0-af14-880f820a1ae8 tempest-DeleteServersTestJSON-357910647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:38:30 devstack sudo[93678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:38:30 devstack sudo[93678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:38:32 devstack sudo[93678]: pam_unix(sudo:session): session closed for user root Jun 17 05:38:32 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-cd482725-7e35-49d0-af14-880f820a1ae8 tempest-DeleteServersTestJSON-357910647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 1.360s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:38:32 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-cd482725-7e35-49d0-af14-880f820a1ae8 tempest-DeleteServersTestJSON-357910647 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:38:32 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-cd482725-7e35-49d0-af14-880f820a1ae8 tempest-DeleteServersTestJSON-357910647 None] Deleted volume successfully. Jun 17 05:38:32 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-cd482725-7e35-49d0-af14-880f820a1ae8 tempest-DeleteServersTestJSON-357910647 None] Lock "cinder-0edf27e1-db14-41f0-b4d0-0a4c80c67f58-delete_volume" released by "delete_volume" :: held 5.386s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:38:40 devstack cinder-volume[92083]: DEBUG dbcounter [-] [92083] Writing DB stats cinder:SELECT=8,cinder:UPDATE=11,cinder:INSERT=3 {{(pid=92083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:38:42 devstack cinder-volume[92083]: DEBUG dbcounter [-] [92083] Writing DB stats cinder:SELECT=8,cinder:UPDATE=11,cinder:DELETE=2,cinder:INSERT=2 {{(pid=92083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:38:57 devstack cinder-volume[92083]: DEBUG dbcounter [-] [92083] Writing DB stats cinder:SELECT=1 {{(pid=92083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:38:57 devstack cinder-volume[92083]: DEBUG dbcounter [-] [92083] Writing DB stats cinder:UPDATE=1 {{(pid=92083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:38:58 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-37745887-a38e-4dfe-b991-931b6c28aa95 tempest-ServerRescueNegativeTestJSON-1634929663 None] Acquiring lock "cinder-bdd9dbee-dffa-4bda-8e1a-7f305a25e218-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:38:58 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-37745887-a38e-4dfe-b991-931b6c28aa95 tempest-ServerRescueNegativeTestJSON-1634929663 None] Lock "cinder-bdd9dbee-dffa-4bda-8e1a-7f305a25e218-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:38:58 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-37745887-a38e-4dfe-b991-931b6c28aa95 tempest-ServerRescueNegativeTestJSON-1634929663 None] Acquiring lock "cinder-quobyte-bdd9dbee-dffa-4bda-8e1a-7f305a25e218" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:38:58 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-37745887-a38e-4dfe-b991-931b6c28aa95 tempest-ServerRescueNegativeTestJSON-1634929663 None] Lock "cinder-quobyte-bdd9dbee-dffa-4bda-8e1a-7f305a25e218" acquired by "delete_volume" :: waited 0.035s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:38:58 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[7519fc57-1c17-430d-b1f9-3fb25cccd912]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:38:58 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-37745887-a38e-4dfe-b991-931b6c28aa95 tempest-ServerRescueNegativeTestJSON-1634929663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bdd9dbee-dffa-4bda-8e1a-7f305a25e218 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:38:58 devstack sudo[93932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bdd9dbee-dffa-4bda-8e1a-7f305a25e218 Jun 17 05:38:58 devstack sudo[93932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:39:00 devstack sudo[93932]: pam_unix(sudo:session): session closed for user root Jun 17 05:39:00 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-37745887-a38e-4dfe-b991-931b6c28aa95 tempest-ServerRescueNegativeTestJSON-1634929663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bdd9dbee-dffa-4bda-8e1a-7f305a25e218" returned: 0 in 1.383s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:39:00 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-37745887-a38e-4dfe-b991-931b6c28aa95 tempest-ServerRescueNegativeTestJSON-1634929663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bdd9dbee-dffa-4bda-8e1a-7f305a25e218 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:39:00 devstack sudo[93937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bdd9dbee-dffa-4bda-8e1a-7f305a25e218 Jun 17 05:39:00 devstack sudo[93937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:39:01 devstack sudo[93937]: pam_unix(sudo:session): session closed for user root Jun 17 05:39:01 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-37745887-a38e-4dfe-b991-931b6c28aa95 tempest-ServerRescueNegativeTestJSON-1634929663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bdd9dbee-dffa-4bda-8e1a-7f305a25e218" returned: 0 in 1.228s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:39:01 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-37745887-a38e-4dfe-b991-931b6c28aa95 tempest-ServerRescueNegativeTestJSON-1634929663 None] Lock "cinder-quobyte-bdd9dbee-dffa-4bda-8e1a-7f305a25e218" released by "delete_volume" :: held 2.681s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:39:01 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-37745887-a38e-4dfe-b991-931b6c28aa95 tempest-ServerRescueNegativeTestJSON-1634929663 None] Created reservations ['2ae43bd6-7db3-4d1d-ab18-43f2639dc458', '44dbee7a-d5df-4587-a5b3-88bdeced323c', '49f523d4-5f99-4fbf-9a1d-e55daf504dcf', 'dd87f7b7-fa2b-4bb6-a669-9e6ffb9a67e2'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:39:01 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-37745887-a38e-4dfe-b991-931b6c28aa95 tempest-ServerRescueNegativeTestJSON-1634929663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:39:01 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-37745887-a38e-4dfe-b991-931b6c28aa95 tempest-ServerRescueNegativeTestJSON-1634929663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:39:01 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-37745887-a38e-4dfe-b991-931b6c28aa95 tempest-ServerRescueNegativeTestJSON-1634929663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:39:01 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-37745887-a38e-4dfe-b991-931b6c28aa95 tempest-ServerRescueNegativeTestJSON-1634929663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:39:01 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-37745887-a38e-4dfe-b991-931b6c28aa95 tempest-ServerRescueNegativeTestJSON-1634929663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:39:01 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-37745887-a38e-4dfe-b991-931b6c28aa95 tempest-ServerRescueNegativeTestJSON-1634929663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:39:01 devstack sudo[93940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:39:01 devstack sudo[93940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:39:02 devstack sudo[93940]: pam_unix(sudo:session): session closed for user root Jun 17 05:39:02 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-37745887-a38e-4dfe-b991-931b6c28aa95 tempest-ServerRescueNegativeTestJSON-1634929663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.898s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:39:02 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-37745887-a38e-4dfe-b991-931b6c28aa95 tempest-ServerRescueNegativeTestJSON-1634929663 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:39:02 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-37745887-a38e-4dfe-b991-931b6c28aa95 tempest-ServerRescueNegativeTestJSON-1634929663 None] Deleted volume successfully. Jun 17 05:39:02 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-37745887-a38e-4dfe-b991-931b6c28aa95 tempest-ServerRescueNegativeTestJSON-1634929663 None] Lock "cinder-bdd9dbee-dffa-4bda-8e1a-7f305a25e218-delete_volume" released by "delete_volume" :: held 3.920s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:39:11 devstack cinder-volume[92083]: DEBUG dbcounter [-] [92083] Writing DB stats cinder:SELECT=3,cinder:INSERT=3,cinder:UPDATE=9 {{(pid=92083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:39:12 devstack cinder-volume[92083]: DEBUG dbcounter [-] [92083] Writing DB stats cinder:UPDATE=7,cinder:SELECT=7,cinder:INSERT=1,cinder:DELETE=1 {{(pid=92083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:39:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-a26e83c0-d202-48bb-a850-4885e1475a2b req-fae2b6ed-3384-4712-93ac-79f9645ef9cf tempest-TaggedAttachmentsTest-1347861742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:39:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-a26e83c0-d202-48bb-a850-4885e1475a2b req-fae2b6ed-3384-4712-93ac-79f9645ef9cf tempest-TaggedAttachmentsTest-1347861742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:39:14 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[352a5b56-718b-4722-a720-03a7ed880c12]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:39:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-a26e83c0-d202-48bb-a850-4885e1475a2b req-fae2b6ed-3384-4712-93ac-79f9645ef9cf tempest-TaggedAttachmentsTest-1347861742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-3e1b9db3-e9d0-4900-b87f-95245c4066e9 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:39:14 devstack sudo[94121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-3e1b9db3-e9d0-4900-b87f-95245c4066e9 Jun 17 05:39:14 devstack sudo[94121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:39:15 devstack sudo[94121]: pam_unix(sudo:session): session closed for user root Jun 17 05:39:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-a26e83c0-d202-48bb-a850-4885e1475a2b req-fae2b6ed-3384-4712-93ac-79f9645ef9cf tempest-TaggedAttachmentsTest-1347861742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-3e1b9db3-e9d0-4900-b87f-95245c4066e9" returned: 0 in 0.847s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:39:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-a26e83c0-d202-48bb-a850-4885e1475a2b req-fae2b6ed-3384-4712-93ac-79f9645ef9cf tempest-TaggedAttachmentsTest-1347861742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.872s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:39:15 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [req-a26e83c0-d202-48bb-a850-4885e1475a2b req-fae2b6ed-3384-4712-93ac-79f9645ef9cf tempest-TaggedAttachmentsTest-1347861742 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f', 'name': 'volume-3e1b9db3-e9d0-4900-b87f-95245c4066e9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5ba23961-ade5-48fc-a46e-0e88789542b6', 'enforce_multipath': True} {{(pid=92083) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 17 05:39:15 devstack cinder-volume[92083]: INFO cinder.volume.manager [req-a26e83c0-d202-48bb-a850-4885e1475a2b req-fae2b6ed-3384-4712-93ac-79f9645ef9cf tempest-TaggedAttachmentsTest-1347861742 None] attachment_update completed successfully. Jun 17 05:39:23 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-1af2f288-288f-4248-b4de-8a729d44981b tempest-VolumesAdminNegativeTest-883206038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:39:23 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1af2f288-288f-4248-b4de-8a729d44981b tempest-VolumesAdminNegativeTest-883206038 None] Flow 'volume_create_manager' (77950c37-711b-44a4-9723-d5445fa4482c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:39:23 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1af2f288-288f-4248-b4de-8a729d44981b tempest-VolumesAdminNegativeTest-883206038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bec175d8-0d8b-425e-b8c1-940a66008633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:39:23 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1af2f288-288f-4248-b4de-8a729d44981b tempest-VolumesAdminNegativeTest-883206038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bec175d8-0d8b-425e-b8c1-940a66008633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:39:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1974169848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9906bc5a-6a3b-444c-8b1f-692c57493fdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a5dd5ffabf34d3f88b45b8766081dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:39:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:39:24Z,use_quota=True,user_id='5e2d19c5b2484ebf9128747b68ed5590',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:39:23 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1af2f288-288f-4248-b4de-8a729d44981b tempest-VolumesAdminNegativeTest-883206038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f84baaf0-36a5-4abc-9874-65e2558f6711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:39:23 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1af2f288-288f-4248-b4de-8a729d44981b tempest-VolumesAdminNegativeTest-883206038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f84baaf0-36a5-4abc-9874-65e2558f6711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:39:23 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1af2f288-288f-4248-b4de-8a729d44981b tempest-VolumesAdminNegativeTest-883206038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bbd86fa-a605-443e-9e19-be07c3e358e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:39:23 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1af2f288-288f-4248-b4de-8a729d44981b tempest-VolumesAdminNegativeTest-883206038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bbd86fa-a605-443e-9e19-be07c3e358e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9906bc5a-6a3b-444c-8b1f-692c57493fdf', 'volume_name': 'volume-9906bc5a-6a3b-444c-8b1f-692c57493fdf', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:39:23 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1af2f288-288f-4248-b4de-8a729d44981b tempest-VolumesAdminNegativeTest-883206038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f6149eb-af10-436a-9115-a1cdd088e002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:39:23 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1af2f288-288f-4248-b4de-8a729d44981b tempest-VolumesAdminNegativeTest-883206038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f6149eb-af10-436a-9115-a1cdd088e002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:39:23 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1af2f288-288f-4248-b4de-8a729d44981b tempest-VolumesAdminNegativeTest-883206038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51c7d272-2554-4862-925e-6862c55d04f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:39:23 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-1af2f288-288f-4248-b4de-8a729d44981b tempest-VolumesAdminNegativeTest-883206038 None] Volume 9906bc5a-6a3b-444c-8b1f-692c57493fdf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9906bc5a-6a3b-444c-8b1f-692c57493fdf', 'volume_size': 1} Jun 17 05:39:23 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-1af2f288-288f-4248-b4de-8a729d44981b tempest-VolumesAdminNegativeTest-883206038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:39:23 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-1af2f288-288f-4248-b4de-8a729d44981b tempest-VolumesAdminNegativeTest-883206038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:39:23 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-1af2f288-288f-4248-b4de-8a729d44981b tempest-VolumesAdminNegativeTest-883206038 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:39:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1974169848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9906bc5a-6a3b-444c-8b1f-692c57493fdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a5dd5ffabf34d3f88b45b8766081dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:39:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:39:24Z,use_quota=True,user_id='5e2d19c5b2484ebf9128747b68ed5590',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:39:23 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-1af2f288-288f-4248-b4de-8a729d44981b tempest-VolumesAdminNegativeTest-883206038 None] Creating volume 9906bc5a-6a3b-444c-8b1f-692c57493fdf {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:39:23 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-1af2f288-288f-4248-b4de-8a729d44981b tempest-VolumesAdminNegativeTest-883206038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:39:23 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-1af2f288-288f-4248-b4de-8a729d44981b tempest-VolumesAdminNegativeTest-883206038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:39:23 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-1af2f288-288f-4248-b4de-8a729d44981b tempest-VolumesAdminNegativeTest-883206038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:39:23 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-1af2f288-288f-4248-b4de-8a729d44981b tempest-VolumesAdminNegativeTest-883206038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:39:23 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-1af2f288-288f-4248-b4de-8a729d44981b tempest-VolumesAdminNegativeTest-883206038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:39:23 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-1af2f288-288f-4248-b4de-8a729d44981b tempest-VolumesAdminNegativeTest-883206038 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:39:23 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-1af2f288-288f-4248-b4de-8a729d44981b tempest-VolumesAdminNegativeTest-883206038 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:39:23 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1af2f288-288f-4248-b4de-8a729d44981b tempest-VolumesAdminNegativeTest-883206038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9906bc5a-6a3b-444c-8b1f-692c57493fdf 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:39:23 devstack sudo[94697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9906bc5a-6a3b-444c-8b1f-692c57493fdf 1073741824 Jun 17 05:39:23 devstack sudo[94697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:39:24 devstack cinder-volume[92083]: INFO cinder.volume.manager [req-2bce1256-b1bb-4f48-ad52-78b76c27de64 req-233208d5-8181-488b-bb04-55f5927e2369 tempest-TaggedAttachmentsTest-1347861742 None] Terminate volume connection completed successfully. Jun 17 05:39:24 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [req-2bce1256-b1bb-4f48-ad52-78b76c27de64 req-233208d5-8181-488b-bb04-55f5927e2369 tempest-TaggedAttachmentsTest-1347861742 None] Deleting attachment 5ba23961-ade5-48fc-a46e-0e88789542b6. {{(pid=92083) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 17 05:39:25 devstack sudo[94697]: pam_unix(sudo:session): session closed for user root Jun 17 05:39:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1af2f288-288f-4248-b4de-8a729d44981b tempest-VolumesAdminNegativeTest-883206038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9906bc5a-6a3b-444c-8b1f-692c57493fdf 1073741824" returned: 0 in 1.704s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:39:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1af2f288-288f-4248-b4de-8a729d44981b tempest-VolumesAdminNegativeTest-883206038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9906bc5a-6a3b-444c-8b1f-692c57493fdf {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:39:25 devstack sudo[94730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9906bc5a-6a3b-444c-8b1f-692c57493fdf Jun 17 05:39:25 devstack sudo[94730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:39:26 devstack sudo[94730]: pam_unix(sudo:session): session closed for user root Jun 17 05:39:26 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1af2f288-288f-4248-b4de-8a729d44981b tempest-VolumesAdminNegativeTest-883206038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9906bc5a-6a3b-444c-8b1f-692c57493fdf" returned: 0 in 1.320s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:39:26 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-1af2f288-288f-4248-b4de-8a729d44981b tempest-VolumesAdminNegativeTest-883206038 None] <== create_volume: return (3131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:39:26 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-1af2f288-288f-4248-b4de-8a729d44981b tempest-VolumesAdminNegativeTest-883206038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.133s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:39:26 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1af2f288-288f-4248-b4de-8a729d44981b tempest-VolumesAdminNegativeTest-883206038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51c7d272-2554-4862-925e-6862c55d04f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9906bc5a-6a3b-444c-8b1f-692c57493fdf', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:39:26 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1af2f288-288f-4248-b4de-8a729d44981b tempest-VolumesAdminNegativeTest-883206038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f31e45e-fb77-4588-a8e4-5cfa8318fe6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:39:26 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-1af2f288-288f-4248-b4de-8a729d44981b tempest-VolumesAdminNegativeTest-883206038 None] Volume volume-9906bc5a-6a3b-444c-8b1f-692c57493fdf (9906bc5a-6a3b-444c-8b1f-692c57493fdf): created successfully Jun 17 05:39:26 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1af2f288-288f-4248-b4de-8a729d44981b tempest-VolumesAdminNegativeTest-883206038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f31e45e-fb77-4588-a8e4-5cfa8318fe6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:39:26 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1af2f288-288f-4248-b4de-8a729d44981b tempest-VolumesAdminNegativeTest-883206038 None] Flow 'volume_create_manager' (77950c37-711b-44a4-9723-d5445fa4482c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:39:27 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-1af2f288-288f-4248-b4de-8a729d44981b tempest-VolumesAdminNegativeTest-883206038 None] Created volume successfully. Jun 17 05:39:27 devstack cinder-volume[92083]: DEBUG oslo_service.periodic_task [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92083) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 05:39:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:39:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:39:27 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:39:27 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:39:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:39:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:39:27 devstack sudo[94733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:39:27 devstack sudo[94733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:39:29 devstack sudo[94733]: pam_unix(sudo:session): session closed for user root Jun 17 05:39:29 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 1.799s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:39:29 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:39:29 devstack cinder-volume[92083]: DEBUG oslo_service.periodic_task [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running periodic task VolumeManager._thread_info {{(pid=92083) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 05:39:29 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] thread count: 8 {{(pid=92083) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 17 05:39:29 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] thread info: [<_MainThread(MainThread, started 133483869905024)>, , , , , , , ] {{(pid=92083) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 17 05:39:29 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-21575147-f690-4dca-8682-f650b0636bf3 tempest-VolumesAdminNegativeTest-883206038 None] Acquiring lock "cinder-9906bc5a-6a3b-444c-8b1f-692c57493fdf-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:39:29 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-21575147-f690-4dca-8682-f650b0636bf3 tempest-VolumesAdminNegativeTest-883206038 None] Lock "cinder-9906bc5a-6a3b-444c-8b1f-692c57493fdf-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:39:29 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-21575147-f690-4dca-8682-f650b0636bf3 tempest-VolumesAdminNegativeTest-883206038 None] Acquiring lock "cinder-quobyte-9906bc5a-6a3b-444c-8b1f-692c57493fdf" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:39:29 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-21575147-f690-4dca-8682-f650b0636bf3 tempest-VolumesAdminNegativeTest-883206038 None] Lock "cinder-quobyte-9906bc5a-6a3b-444c-8b1f-692c57493fdf" acquired by "delete_volume" :: waited 0.065s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:39:29 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c80918f-9699-4faf-a859-0ed490382b91]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:39:29 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-21575147-f690-4dca-8682-f650b0636bf3 tempest-VolumesAdminNegativeTest-883206038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9906bc5a-6a3b-444c-8b1f-692c57493fdf {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:39:30 devstack sudo[94757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9906bc5a-6a3b-444c-8b1f-692c57493fdf Jun 17 05:39:30 devstack sudo[94757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:39:31 devstack sudo[94757]: pam_unix(sudo:session): session closed for user root Jun 17 05:39:31 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-21575147-f690-4dca-8682-f650b0636bf3 tempest-VolumesAdminNegativeTest-883206038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9906bc5a-6a3b-444c-8b1f-692c57493fdf" returned: 0 in 1.431s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:39:31 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-21575147-f690-4dca-8682-f650b0636bf3 tempest-VolumesAdminNegativeTest-883206038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9906bc5a-6a3b-444c-8b1f-692c57493fdf {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:39:31 devstack sudo[94768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9906bc5a-6a3b-444c-8b1f-692c57493fdf Jun 17 05:39:31 devstack sudo[94768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:39:32 devstack sudo[94768]: pam_unix(sudo:session): session closed for user root Jun 17 05:39:32 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-21575147-f690-4dca-8682-f650b0636bf3 tempest-VolumesAdminNegativeTest-883206038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9906bc5a-6a3b-444c-8b1f-692c57493fdf" returned: 0 in 0.950s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:39:32 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-21575147-f690-4dca-8682-f650b0636bf3 tempest-VolumesAdminNegativeTest-883206038 None] Lock "cinder-quobyte-9906bc5a-6a3b-444c-8b1f-692c57493fdf" released by "delete_volume" :: held 2.566s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:39:32 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-21575147-f690-4dca-8682-f650b0636bf3 tempest-VolumesAdminNegativeTest-883206038 None] Created reservations ['b54fca93-b75a-4864-91a8-8b2ec9aa5a3a', '34eea5ce-20d8-4c43-b596-905d8270ceaf', '3ad60565-3aed-491c-b391-82c59004d9dd', '5cd846bf-353c-4b60-a81c-a67dc31db108'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:39:32 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-21575147-f690-4dca-8682-f650b0636bf3 tempest-VolumesAdminNegativeTest-883206038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:39:32 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-21575147-f690-4dca-8682-f650b0636bf3 tempest-VolumesAdminNegativeTest-883206038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:39:32 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-21575147-f690-4dca-8682-f650b0636bf3 tempest-VolumesAdminNegativeTest-883206038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:39:32 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-21575147-f690-4dca-8682-f650b0636bf3 tempest-VolumesAdminNegativeTest-883206038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:39:32 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-21575147-f690-4dca-8682-f650b0636bf3 tempest-VolumesAdminNegativeTest-883206038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:39:32 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-21575147-f690-4dca-8682-f650b0636bf3 tempest-VolumesAdminNegativeTest-883206038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:39:32 devstack sudo[94772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:39:32 devstack sudo[94772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:39:34 devstack sudo[94772]: pam_unix(sudo:session): session closed for user root Jun 17 05:39:34 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-21575147-f690-4dca-8682-f650b0636bf3 tempest-VolumesAdminNegativeTest-883206038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 1.382s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:39:34 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-21575147-f690-4dca-8682-f650b0636bf3 tempest-VolumesAdminNegativeTest-883206038 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:39:34 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-21575147-f690-4dca-8682-f650b0636bf3 tempest-VolumesAdminNegativeTest-883206038 None] Deleted volume successfully. Jun 17 05:39:34 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-21575147-f690-4dca-8682-f650b0636bf3 tempest-VolumesAdminNegativeTest-883206038 None] Lock "cinder-9906bc5a-6a3b-444c-8b1f-692c57493fdf-delete_volume" released by "delete_volume" :: held 4.398s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:39:42 devstack cinder-volume[92083]: DEBUG dbcounter [-] [92083] Writing DB stats cinder:SELECT=11,cinder:UPDATE=15,cinder:INSERT=1 {{(pid=92083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:39:44 devstack cinder-volume[92083]: DEBUG dbcounter [-] [92083] Writing DB stats cinder:SELECT=16,cinder:UPDATE=10,cinder:INSERT=4,cinder:DELETE=2 {{(pid=92083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:39:49 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-9fb79d68-f719-415c-9b54-b48d6a63c624 tempest-TaggedAttachmentsTest-1347861742 None] Acquiring lock "cinder-3e1b9db3-e9d0-4900-b87f-95245c4066e9-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:39:49 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-9fb79d68-f719-415c-9b54-b48d6a63c624 tempest-TaggedAttachmentsTest-1347861742 None] Lock "cinder-3e1b9db3-e9d0-4900-b87f-95245c4066e9-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:39:49 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-9fb79d68-f719-415c-9b54-b48d6a63c624 tempest-TaggedAttachmentsTest-1347861742 None] Acquiring lock "cinder-quobyte-3e1b9db3-e9d0-4900-b87f-95245c4066e9" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:39:49 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-9fb79d68-f719-415c-9b54-b48d6a63c624 tempest-TaggedAttachmentsTest-1347861742 None] Lock "cinder-quobyte-3e1b9db3-e9d0-4900-b87f-95245c4066e9" acquired by "delete_volume" :: waited 0.014s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:39:49 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb4940d8-7b20-4ede-a991-6746d86e374d]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:39:49 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-9fb79d68-f719-415c-9b54-b48d6a63c624 tempest-TaggedAttachmentsTest-1347861742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-3e1b9db3-e9d0-4900-b87f-95245c4066e9 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:39:49 devstack sudo[94919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-3e1b9db3-e9d0-4900-b87f-95245c4066e9 Jun 17 05:39:49 devstack sudo[94919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:39:50 devstack sudo[94919]: pam_unix(sudo:session): session closed for user root Jun 17 05:39:50 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-9fb79d68-f719-415c-9b54-b48d6a63c624 tempest-TaggedAttachmentsTest-1347861742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-3e1b9db3-e9d0-4900-b87f-95245c4066e9" returned: 0 in 0.718s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:39:50 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-9fb79d68-f719-415c-9b54-b48d6a63c624 tempest-TaggedAttachmentsTest-1347861742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-3e1b9db3-e9d0-4900-b87f-95245c4066e9 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:39:50 devstack sudo[94924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-3e1b9db3-e9d0-4900-b87f-95245c4066e9 Jun 17 05:39:50 devstack sudo[94924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:39:51 devstack sudo[94924]: pam_unix(sudo:session): session closed for user root Jun 17 05:39:51 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-9fb79d68-f719-415c-9b54-b48d6a63c624 tempest-TaggedAttachmentsTest-1347861742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-3e1b9db3-e9d0-4900-b87f-95245c4066e9" returned: 0 in 0.756s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:39:51 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-9fb79d68-f719-415c-9b54-b48d6a63c624 tempest-TaggedAttachmentsTest-1347861742 None] Lock "cinder-quobyte-3e1b9db3-e9d0-4900-b87f-95245c4066e9" released by "delete_volume" :: held 1.535s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:39:51 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-9fb79d68-f719-415c-9b54-b48d6a63c624 tempest-TaggedAttachmentsTest-1347861742 None] Created reservations ['d8d306bb-0d28-4ab7-bed0-e3fe9b51aa10', 'a56f24cd-61a2-4a36-979c-7fd1b527fdfd', '42bfbb41-94e7-4288-903b-6d031f19dba0', '7c6db834-d600-4b92-99c6-e6c48f12529c'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:39:51 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-9fb79d68-f719-415c-9b54-b48d6a63c624 tempest-TaggedAttachmentsTest-1347861742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:39:51 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-9fb79d68-f719-415c-9b54-b48d6a63c624 tempest-TaggedAttachmentsTest-1347861742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:39:51 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-9fb79d68-f719-415c-9b54-b48d6a63c624 tempest-TaggedAttachmentsTest-1347861742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:39:51 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-9fb79d68-f719-415c-9b54-b48d6a63c624 tempest-TaggedAttachmentsTest-1347861742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:39:51 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-9fb79d68-f719-415c-9b54-b48d6a63c624 tempest-TaggedAttachmentsTest-1347861742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:39:51 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-9fb79d68-f719-415c-9b54-b48d6a63c624 tempest-TaggedAttachmentsTest-1347861742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:39:51 devstack sudo[94930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:39:51 devstack sudo[94930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:39:51 devstack sudo[94930]: pam_unix(sudo:session): session closed for user root Jun 17 05:39:51 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-9fb79d68-f719-415c-9b54-b48d6a63c624 tempest-TaggedAttachmentsTest-1347861742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.705s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:39:51 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-9fb79d68-f719-415c-9b54-b48d6a63c624 tempest-TaggedAttachmentsTest-1347861742 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:39:52 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-9fb79d68-f719-415c-9b54-b48d6a63c624 tempest-TaggedAttachmentsTest-1347861742 None] Deleted volume successfully. Jun 17 05:39:52 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-9fb79d68-f719-415c-9b54-b48d6a63c624 tempest-TaggedAttachmentsTest-1347861742 None] Lock "cinder-3e1b9db3-e9d0-4900-b87f-95245c4066e9-delete_volume" released by "delete_volume" :: held 2.504s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:39:53 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ad6e0d1-547d-4a62-8459-04ac595a7149 tempest-ServerActionsTestOtherA-2081174214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:39:53 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6ad6e0d1-547d-4a62-8459-04ac595a7149 tempest-ServerActionsTestOtherA-2081174214 None] Flow 'volume_create_manager' (24029b79-22a7-4c39-af3b-8ac95067380b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:39:53 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6ad6e0d1-547d-4a62-8459-04ac595a7149 tempest-ServerActionsTestOtherA-2081174214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c2e90a8-d687-4e89-8d37-8ab54867d24e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:39:53 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6ad6e0d1-547d-4a62-8459-04ac595a7149 tempest-ServerActionsTestOtherA-2081174214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c2e90a8-d687-4e89-8d37-8ab54867d24e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:39:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1054950892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=117e939d-3af9-4f51-b678-c1e8b1727c2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f26fda9aa9f481c9fc9054ad65ca491',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:39:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:39:53Z,use_quota=True,user_id='0524889cda2844f59b90a4873ae6afca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:39:53 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6ad6e0d1-547d-4a62-8459-04ac595a7149 tempest-ServerActionsTestOtherA-2081174214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cd16d83-1ed8-4e38-a51e-137229fa49fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:39:53 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6ad6e0d1-547d-4a62-8459-04ac595a7149 tempest-ServerActionsTestOtherA-2081174214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cd16d83-1ed8-4e38-a51e-137229fa49fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:39:53 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6ad6e0d1-547d-4a62-8459-04ac595a7149 tempest-ServerActionsTestOtherA-2081174214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef4fa0e2-d207-4f56-8092-f344bd214748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:39:53 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6ad6e0d1-547d-4a62-8459-04ac595a7149 tempest-ServerActionsTestOtherA-2081174214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef4fa0e2-d207-4f56-8092-f344bd214748) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '117e939d-3af9-4f51-b678-c1e8b1727c2e', 'volume_name': 'volume-117e939d-3af9-4f51-b678-c1e8b1727c2e', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:39:53 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6ad6e0d1-547d-4a62-8459-04ac595a7149 tempest-ServerActionsTestOtherA-2081174214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18c765bd-1212-4cf3-a19a-bfc87adfa48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:39:53 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6ad6e0d1-547d-4a62-8459-04ac595a7149 tempest-ServerActionsTestOtherA-2081174214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18c765bd-1212-4cf3-a19a-bfc87adfa48b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:39:53 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6ad6e0d1-547d-4a62-8459-04ac595a7149 tempest-ServerActionsTestOtherA-2081174214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8100230d-53a6-45ba-9e3e-5f5e7b418984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:39:53 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-6ad6e0d1-547d-4a62-8459-04ac595a7149 tempest-ServerActionsTestOtherA-2081174214 None] Volume 117e939d-3af9-4f51-b678-c1e8b1727c2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-117e939d-3af9-4f51-b678-c1e8b1727c2e', 'volume_size': 1} Jun 17 05:39:53 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-6ad6e0d1-547d-4a62-8459-04ac595a7149 tempest-ServerActionsTestOtherA-2081174214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:39:53 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-6ad6e0d1-547d-4a62-8459-04ac595a7149 tempest-ServerActionsTestOtherA-2081174214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:39:53 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-6ad6e0d1-547d-4a62-8459-04ac595a7149 tempest-ServerActionsTestOtherA-2081174214 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:39:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1054950892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=117e939d-3af9-4f51-b678-c1e8b1727c2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f26fda9aa9f481c9fc9054ad65ca491',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:39:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:39:53Z,use_quota=True,user_id='0524889cda2844f59b90a4873ae6afca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:39:53 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-6ad6e0d1-547d-4a62-8459-04ac595a7149 tempest-ServerActionsTestOtherA-2081174214 None] Creating volume 117e939d-3af9-4f51-b678-c1e8b1727c2e {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:39:53 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-6ad6e0d1-547d-4a62-8459-04ac595a7149 tempest-ServerActionsTestOtherA-2081174214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:39:53 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-6ad6e0d1-547d-4a62-8459-04ac595a7149 tempest-ServerActionsTestOtherA-2081174214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:39:53 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-6ad6e0d1-547d-4a62-8459-04ac595a7149 tempest-ServerActionsTestOtherA-2081174214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:39:53 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-6ad6e0d1-547d-4a62-8459-04ac595a7149 tempest-ServerActionsTestOtherA-2081174214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:39:53 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-6ad6e0d1-547d-4a62-8459-04ac595a7149 tempest-ServerActionsTestOtherA-2081174214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:39:53 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-6ad6e0d1-547d-4a62-8459-04ac595a7149 tempest-ServerActionsTestOtherA-2081174214 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:39:53 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-6ad6e0d1-547d-4a62-8459-04ac595a7149 tempest-ServerActionsTestOtherA-2081174214 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:39:53 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6ad6e0d1-547d-4a62-8459-04ac595a7149 tempest-ServerActionsTestOtherA-2081174214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-117e939d-3af9-4f51-b678-c1e8b1727c2e 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:39:53 devstack sudo[94950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-117e939d-3af9-4f51-b678-c1e8b1727c2e 1073741824 Jun 17 05:39:53 devstack sudo[94950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:39:54 devstack sudo[94950]: pam_unix(sudo:session): session closed for user root Jun 17 05:39:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6ad6e0d1-547d-4a62-8459-04ac595a7149 tempest-ServerActionsTestOtherA-2081174214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-117e939d-3af9-4f51-b678-c1e8b1727c2e 1073741824" returned: 0 in 1.051s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:39:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6ad6e0d1-547d-4a62-8459-04ac595a7149 tempest-ServerActionsTestOtherA-2081174214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-117e939d-3af9-4f51-b678-c1e8b1727c2e {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:39:54 devstack sudo[94959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-117e939d-3af9-4f51-b678-c1e8b1727c2e Jun 17 05:39:54 devstack sudo[94959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:39:55 devstack sudo[94959]: pam_unix(sudo:session): session closed for user root Jun 17 05:39:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6ad6e0d1-547d-4a62-8459-04ac595a7149 tempest-ServerActionsTestOtherA-2081174214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-117e939d-3af9-4f51-b678-c1e8b1727c2e" returned: 0 in 0.818s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:39:55 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-6ad6e0d1-547d-4a62-8459-04ac595a7149 tempest-ServerActionsTestOtherA-2081174214 None] <== create_volume: return (1921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:39:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-6ad6e0d1-547d-4a62-8459-04ac595a7149 tempest-ServerActionsTestOtherA-2081174214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.925s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:39:55 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6ad6e0d1-547d-4a62-8459-04ac595a7149 tempest-ServerActionsTestOtherA-2081174214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8100230d-53a6-45ba-9e3e-5f5e7b418984) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-117e939d-3af9-4f51-b678-c1e8b1727c2e', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:39:55 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6ad6e0d1-547d-4a62-8459-04ac595a7149 tempest-ServerActionsTestOtherA-2081174214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0fde5ad-bd27-4737-ade9-8344faf3c0bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:39:55 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-6ad6e0d1-547d-4a62-8459-04ac595a7149 tempest-ServerActionsTestOtherA-2081174214 None] Volume volume-117e939d-3af9-4f51-b678-c1e8b1727c2e (117e939d-3af9-4f51-b678-c1e8b1727c2e): created successfully Jun 17 05:39:55 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6ad6e0d1-547d-4a62-8459-04ac595a7149 tempest-ServerActionsTestOtherA-2081174214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0fde5ad-bd27-4737-ade9-8344faf3c0bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:39:55 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6ad6e0d1-547d-4a62-8459-04ac595a7149 tempest-ServerActionsTestOtherA-2081174214 None] Flow 'volume_create_manager' (24029b79-22a7-4c39-af3b-8ac95067380b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:39:55 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-6ad6e0d1-547d-4a62-8459-04ac595a7149 tempest-ServerActionsTestOtherA-2081174214 None] Created volume successfully. Jun 17 05:40:01 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b9b92da-6f97-4adc-8283-9c68cd2db99f tempest-VolumesTestJSON-133050396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:40:01 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-3b9b92da-6f97-4adc-8283-9c68cd2db99f tempest-VolumesTestJSON-133050396 None] Flow 'volume_create_manager' (00158b92-5959-4b66-886f-d4372e4e82be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:40:01 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-3b9b92da-6f97-4adc-8283-9c68cd2db99f tempest-VolumesTestJSON-133050396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c51d1fa-7e9e-4328-bd62-38e2655d7e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:40:01 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-3b9b92da-6f97-4adc-8283-9c68cd2db99f tempest-VolumesTestJSON-133050396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c51d1fa-7e9e-4328-bd62-38e2655d7e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:40:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-807493297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74d79f04-e607-44c4-9256-fedb5d7b2dcb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b6a954b976864ae49abab1cb2d0fc856',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:40:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:40:02Z,use_quota=True,user_id='9a5f0433b3034977b2004a4674ced884',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:40:01 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-3b9b92da-6f97-4adc-8283-9c68cd2db99f tempest-VolumesTestJSON-133050396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91806d6a-2e19-473c-99f0-43411729302c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:40:01 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-3b9b92da-6f97-4adc-8283-9c68cd2db99f tempest-VolumesTestJSON-133050396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91806d6a-2e19-473c-99f0-43411729302c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:40:01 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-3b9b92da-6f97-4adc-8283-9c68cd2db99f tempest-VolumesTestJSON-133050396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c07fe3c1-955b-445d-87b6-70de458dec8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:40:01 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-3b9b92da-6f97-4adc-8283-9c68cd2db99f tempest-VolumesTestJSON-133050396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c07fe3c1-955b-445d-87b6-70de458dec8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74d79f04-e607-44c4-9256-fedb5d7b2dcb', 'volume_name': 'volume-74d79f04-e607-44c4-9256-fedb5d7b2dcb', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:40:01 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-3b9b92da-6f97-4adc-8283-9c68cd2db99f tempest-VolumesTestJSON-133050396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d8e01c0-f325-4b5e-b6a0-df2b10107189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:40:01 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-3b9b92da-6f97-4adc-8283-9c68cd2db99f tempest-VolumesTestJSON-133050396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d8e01c0-f325-4b5e-b6a0-df2b10107189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:40:01 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-3b9b92da-6f97-4adc-8283-9c68cd2db99f tempest-VolumesTestJSON-133050396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25a49bd8-7e9c-483b-bc2b-98f483a11a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:40:01 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-3b9b92da-6f97-4adc-8283-9c68cd2db99f tempest-VolumesTestJSON-133050396 None] Volume 74d79f04-e607-44c4-9256-fedb5d7b2dcb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74d79f04-e607-44c4-9256-fedb5d7b2dcb', 'volume_size': 1} Jun 17 05:40:01 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-3b9b92da-6f97-4adc-8283-9c68cd2db99f tempest-VolumesTestJSON-133050396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:40:01 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-3b9b92da-6f97-4adc-8283-9c68cd2db99f tempest-VolumesTestJSON-133050396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:40:01 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-3b9b92da-6f97-4adc-8283-9c68cd2db99f tempest-VolumesTestJSON-133050396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:40:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-807493297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74d79f04-e607-44c4-9256-fedb5d7b2dcb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b6a954b976864ae49abab1cb2d0fc856',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:40:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:40:02Z,use_quota=True,user_id='9a5f0433b3034977b2004a4674ced884',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:40:01 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-3b9b92da-6f97-4adc-8283-9c68cd2db99f tempest-VolumesTestJSON-133050396 None] Creating volume 74d79f04-e607-44c4-9256-fedb5d7b2dcb {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:40:01 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-3b9b92da-6f97-4adc-8283-9c68cd2db99f tempest-VolumesTestJSON-133050396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:40:01 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-3b9b92da-6f97-4adc-8283-9c68cd2db99f tempest-VolumesTestJSON-133050396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:40:01 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-3b9b92da-6f97-4adc-8283-9c68cd2db99f tempest-VolumesTestJSON-133050396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:40:01 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-3b9b92da-6f97-4adc-8283-9c68cd2db99f tempest-VolumesTestJSON-133050396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:40:01 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-3b9b92da-6f97-4adc-8283-9c68cd2db99f tempest-VolumesTestJSON-133050396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:40:01 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-3b9b92da-6f97-4adc-8283-9c68cd2db99f tempest-VolumesTestJSON-133050396 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:40:01 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-3b9b92da-6f97-4adc-8283-9c68cd2db99f tempest-VolumesTestJSON-133050396 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:40:01 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-3b9b92da-6f97-4adc-8283-9c68cd2db99f tempest-VolumesTestJSON-133050396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-74d79f04-e607-44c4-9256-fedb5d7b2dcb 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:40:01 devstack sudo[95046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-74d79f04-e607-44c4-9256-fedb5d7b2dcb 1073741824 Jun 17 05:40:01 devstack sudo[95046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:40:02 devstack sudo[95046]: pam_unix(sudo:session): session closed for user root Jun 17 05:40:02 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-3b9b92da-6f97-4adc-8283-9c68cd2db99f tempest-VolumesTestJSON-133050396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-74d79f04-e607-44c4-9256-fedb5d7b2dcb 1073741824" returned: 0 in 1.137s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:40:02 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-3b9b92da-6f97-4adc-8283-9c68cd2db99f tempest-VolumesTestJSON-133050396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-74d79f04-e607-44c4-9256-fedb5d7b2dcb {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:40:02 devstack sudo[95054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-74d79f04-e607-44c4-9256-fedb5d7b2dcb Jun 17 05:40:02 devstack sudo[95054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:40:04 devstack sudo[95054]: pam_unix(sudo:session): session closed for user root Jun 17 05:40:04 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-3b9b92da-6f97-4adc-8283-9c68cd2db99f tempest-VolumesTestJSON-133050396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-74d79f04-e607-44c4-9256-fedb5d7b2dcb" returned: 0 in 1.154s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:40:04 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-3b9b92da-6f97-4adc-8283-9c68cd2db99f tempest-VolumesTestJSON-133050396 None] <== create_volume: return (2379ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:40:04 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-3b9b92da-6f97-4adc-8283-9c68cd2db99f tempest-VolumesTestJSON-133050396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.382s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:40:04 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-3b9b92da-6f97-4adc-8283-9c68cd2db99f tempest-VolumesTestJSON-133050396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25a49bd8-7e9c-483b-bc2b-98f483a11a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74d79f04-e607-44c4-9256-fedb5d7b2dcb', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:40:04 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-3b9b92da-6f97-4adc-8283-9c68cd2db99f tempest-VolumesTestJSON-133050396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b02dd6f-0ed2-4cf3-b5f4-10b9fbb9b051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:40:04 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-3b9b92da-6f97-4adc-8283-9c68cd2db99f tempest-VolumesTestJSON-133050396 None] Volume volume-74d79f04-e607-44c4-9256-fedb5d7b2dcb (74d79f04-e607-44c4-9256-fedb5d7b2dcb): created successfully Jun 17 05:40:04 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-3b9b92da-6f97-4adc-8283-9c68cd2db99f tempest-VolumesTestJSON-133050396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b02dd6f-0ed2-4cf3-b5f4-10b9fbb9b051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:40:04 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-3b9b92da-6f97-4adc-8283-9c68cd2db99f tempest-VolumesTestJSON-133050396 None] Flow 'volume_create_manager' (00158b92-5959-4b66-886f-d4372e4e82be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:40:04 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-3b9b92da-6f97-4adc-8283-9c68cd2db99f tempest-VolumesTestJSON-133050396 None] Created volume successfully. Jun 17 05:40:05 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-35739bef-81a4-403e-8dce-0635af63f541 tempest-VolumesTestJSON-133050396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:40:05 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-35739bef-81a4-403e-8dce-0635af63f541 tempest-VolumesTestJSON-133050396 None] Flow 'volume_create_manager' (ce8b99c0-f0c4-4dc8-9764-00cdcf4f9f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:40:05 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-35739bef-81a4-403e-8dce-0635af63f541 tempest-VolumesTestJSON-133050396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9355e1e0-708a-4568-9144-236d1a084999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:40:05 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-35739bef-81a4-403e-8dce-0635af63f541 tempest-VolumesTestJSON-133050396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9355e1e0-708a-4568-9144-236d1a084999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:40:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-69395613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0f9343b-eb9e-482b-9ca5-24c6413defc2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b6a954b976864ae49abab1cb2d0fc856',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:40:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:40:06Z,use_quota=True,user_id='9a5f0433b3034977b2004a4674ced884',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:40:05 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-35739bef-81a4-403e-8dce-0635af63f541 tempest-VolumesTestJSON-133050396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1ad9feb-2065-456d-a8cd-045b5135843e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:40:05 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-35739bef-81a4-403e-8dce-0635af63f541 tempest-VolumesTestJSON-133050396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1ad9feb-2065-456d-a8cd-045b5135843e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:40:05 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-35739bef-81a4-403e-8dce-0635af63f541 tempest-VolumesTestJSON-133050396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09d10987-9f45-41d7-810e-b3ace2308d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:40:05 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-35739bef-81a4-403e-8dce-0635af63f541 tempest-VolumesTestJSON-133050396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09d10987-9f45-41d7-810e-b3ace2308d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0f9343b-eb9e-482b-9ca5-24c6413defc2', 'volume_name': 'volume-b0f9343b-eb9e-482b-9ca5-24c6413defc2', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:40:05 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-35739bef-81a4-403e-8dce-0635af63f541 tempest-VolumesTestJSON-133050396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2dff2b5-776f-4212-8d1c-dcadb8b528ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:40:05 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-35739bef-81a4-403e-8dce-0635af63f541 tempest-VolumesTestJSON-133050396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2dff2b5-776f-4212-8d1c-dcadb8b528ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:40:05 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-35739bef-81a4-403e-8dce-0635af63f541 tempest-VolumesTestJSON-133050396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eea6d6b-4ef9-4f3d-a195-37ec542b8c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:40:05 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-35739bef-81a4-403e-8dce-0635af63f541 tempest-VolumesTestJSON-133050396 None] Volume b0f9343b-eb9e-482b-9ca5-24c6413defc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0f9343b-eb9e-482b-9ca5-24c6413defc2', 'volume_size': 1} Jun 17 05:40:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-35739bef-81a4-403e-8dce-0635af63f541 tempest-VolumesTestJSON-133050396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:40:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-35739bef-81a4-403e-8dce-0635af63f541 tempest-VolumesTestJSON-133050396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:40:05 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-35739bef-81a4-403e-8dce-0635af63f541 tempest-VolumesTestJSON-133050396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:40:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-69395613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0f9343b-eb9e-482b-9ca5-24c6413defc2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b6a954b976864ae49abab1cb2d0fc856',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:40:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:40:06Z,use_quota=True,user_id='9a5f0433b3034977b2004a4674ced884',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:40:05 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-35739bef-81a4-403e-8dce-0635af63f541 tempest-VolumesTestJSON-133050396 None] Creating volume b0f9343b-eb9e-482b-9ca5-24c6413defc2 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:40:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-35739bef-81a4-403e-8dce-0635af63f541 tempest-VolumesTestJSON-133050396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:40:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-35739bef-81a4-403e-8dce-0635af63f541 tempest-VolumesTestJSON-133050396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:40:05 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-35739bef-81a4-403e-8dce-0635af63f541 tempest-VolumesTestJSON-133050396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:40:05 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-35739bef-81a4-403e-8dce-0635af63f541 tempest-VolumesTestJSON-133050396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:40:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-35739bef-81a4-403e-8dce-0635af63f541 tempest-VolumesTestJSON-133050396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:40:05 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-35739bef-81a4-403e-8dce-0635af63f541 tempest-VolumesTestJSON-133050396 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:40:05 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-35739bef-81a4-403e-8dce-0635af63f541 tempest-VolumesTestJSON-133050396 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:40:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-35739bef-81a4-403e-8dce-0635af63f541 tempest-VolumesTestJSON-133050396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b0f9343b-eb9e-482b-9ca5-24c6413defc2 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:40:05 devstack sudo[95074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b0f9343b-eb9e-482b-9ca5-24c6413defc2 1073741824 Jun 17 05:40:05 devstack sudo[95074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:40:07 devstack sudo[95074]: pam_unix(sudo:session): session closed for user root Jun 17 05:40:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-35739bef-81a4-403e-8dce-0635af63f541 tempest-VolumesTestJSON-133050396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b0f9343b-eb9e-482b-9ca5-24c6413defc2 1073741824" returned: 0 in 1.443s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:40:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-35739bef-81a4-403e-8dce-0635af63f541 tempest-VolumesTestJSON-133050396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b0f9343b-eb9e-482b-9ca5-24c6413defc2 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:40:07 devstack sudo[95080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b0f9343b-eb9e-482b-9ca5-24c6413defc2 Jun 17 05:40:07 devstack sudo[95080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:40:08 devstack sudo[95080]: pam_unix(sudo:session): session closed for user root Jun 17 05:40:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-35739bef-81a4-403e-8dce-0635af63f541 tempest-VolumesTestJSON-133050396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b0f9343b-eb9e-482b-9ca5-24c6413defc2" returned: 0 in 0.888s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:40:08 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-35739bef-81a4-403e-8dce-0635af63f541 tempest-VolumesTestJSON-133050396 None] <== create_volume: return (2416ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:40:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-35739bef-81a4-403e-8dce-0635af63f541 tempest-VolumesTestJSON-133050396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.424s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:40:08 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-35739bef-81a4-403e-8dce-0635af63f541 tempest-VolumesTestJSON-133050396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eea6d6b-4ef9-4f3d-a195-37ec542b8c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0f9343b-eb9e-482b-9ca5-24c6413defc2', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:40:08 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-35739bef-81a4-403e-8dce-0635af63f541 tempest-VolumesTestJSON-133050396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31aedccc-6f16-4ae8-b8cd-2d07280d01fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:40:08 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-35739bef-81a4-403e-8dce-0635af63f541 tempest-VolumesTestJSON-133050396 None] Volume volume-b0f9343b-eb9e-482b-9ca5-24c6413defc2 (b0f9343b-eb9e-482b-9ca5-24c6413defc2): created successfully Jun 17 05:40:08 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-35739bef-81a4-403e-8dce-0635af63f541 tempest-VolumesTestJSON-133050396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31aedccc-6f16-4ae8-b8cd-2d07280d01fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:40:08 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-35739bef-81a4-403e-8dce-0635af63f541 tempest-VolumesTestJSON-133050396 None] Flow 'volume_create_manager' (ce8b99c0-f0c4-4dc8-9764-00cdcf4f9f70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:40:08 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-35739bef-81a4-403e-8dce-0635af63f541 tempest-VolumesTestJSON-133050396 None] Created volume successfully. Jun 17 05:40:09 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-8670c697-9fcd-4682-b988-d29be5d117d1 tempest-VolumesTestJSON-133050396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:40:09 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8670c697-9fcd-4682-b988-d29be5d117d1 tempest-VolumesTestJSON-133050396 None] Flow 'volume_create_manager' (27686f95-af20-4d89-b700-a1aa9bdf6b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:40:09 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8670c697-9fcd-4682-b988-d29be5d117d1 tempest-VolumesTestJSON-133050396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f56abc6a-ef60-435c-a82d-33c2676bec5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:40:09 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8670c697-9fcd-4682-b988-d29be5d117d1 tempest-VolumesTestJSON-133050396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f56abc6a-ef60-435c-a82d-33c2676bec5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:40:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-699195467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d652c1a0-dd29-4658-b002-5bc2924992eb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b6a954b976864ae49abab1cb2d0fc856',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:40:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:40:10Z,use_quota=True,user_id='9a5f0433b3034977b2004a4674ced884',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:40:09 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8670c697-9fcd-4682-b988-d29be5d117d1 tempest-VolumesTestJSON-133050396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4299b99e-b9dd-40a2-9969-a6fa64bdbdc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:40:09 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8670c697-9fcd-4682-b988-d29be5d117d1 tempest-VolumesTestJSON-133050396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4299b99e-b9dd-40a2-9969-a6fa64bdbdc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:40:09 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8670c697-9fcd-4682-b988-d29be5d117d1 tempest-VolumesTestJSON-133050396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (048424ef-9b85-4574-8a70-910185bef4ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:40:09 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8670c697-9fcd-4682-b988-d29be5d117d1 tempest-VolumesTestJSON-133050396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (048424ef-9b85-4574-8a70-910185bef4ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd652c1a0-dd29-4658-b002-5bc2924992eb', 'volume_name': 'volume-d652c1a0-dd29-4658-b002-5bc2924992eb', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:40:09 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8670c697-9fcd-4682-b988-d29be5d117d1 tempest-VolumesTestJSON-133050396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68f623fa-2d7d-4653-a9c2-ffdfddd3b08e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:40:09 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8670c697-9fcd-4682-b988-d29be5d117d1 tempest-VolumesTestJSON-133050396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68f623fa-2d7d-4653-a9c2-ffdfddd3b08e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:40:09 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8670c697-9fcd-4682-b988-d29be5d117d1 tempest-VolumesTestJSON-133050396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ac1c9ce-2d55-4553-ad41-70da39504ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:40:09 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-8670c697-9fcd-4682-b988-d29be5d117d1 tempest-VolumesTestJSON-133050396 None] Volume d652c1a0-dd29-4658-b002-5bc2924992eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d652c1a0-dd29-4658-b002-5bc2924992eb', 'volume_size': 1} Jun 17 05:40:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-8670c697-9fcd-4682-b988-d29be5d117d1 tempest-VolumesTestJSON-133050396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:40:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-8670c697-9fcd-4682-b988-d29be5d117d1 tempest-VolumesTestJSON-133050396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:40:09 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-8670c697-9fcd-4682-b988-d29be5d117d1 tempest-VolumesTestJSON-133050396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:40:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-699195467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d652c1a0-dd29-4658-b002-5bc2924992eb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b6a954b976864ae49abab1cb2d0fc856',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:40:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:40:10Z,use_quota=True,user_id='9a5f0433b3034977b2004a4674ced884',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:40:09 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-8670c697-9fcd-4682-b988-d29be5d117d1 tempest-VolumesTestJSON-133050396 None] Creating volume d652c1a0-dd29-4658-b002-5bc2924992eb {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:40:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-8670c697-9fcd-4682-b988-d29be5d117d1 tempest-VolumesTestJSON-133050396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:40:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-8670c697-9fcd-4682-b988-d29be5d117d1 tempest-VolumesTestJSON-133050396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:40:09 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-8670c697-9fcd-4682-b988-d29be5d117d1 tempest-VolumesTestJSON-133050396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:40:09 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-8670c697-9fcd-4682-b988-d29be5d117d1 tempest-VolumesTestJSON-133050396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:40:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-8670c697-9fcd-4682-b988-d29be5d117d1 tempest-VolumesTestJSON-133050396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:40:09 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-8670c697-9fcd-4682-b988-d29be5d117d1 tempest-VolumesTestJSON-133050396 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:40:09 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-8670c697-9fcd-4682-b988-d29be5d117d1 tempest-VolumesTestJSON-133050396 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:40:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8670c697-9fcd-4682-b988-d29be5d117d1 tempest-VolumesTestJSON-133050396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d652c1a0-dd29-4658-b002-5bc2924992eb 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:40:09 devstack sudo[95085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d652c1a0-dd29-4658-b002-5bc2924992eb 1073741824 Jun 17 05:40:09 devstack sudo[95085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:40:10 devstack sudo[95085]: pam_unix(sudo:session): session closed for user root Jun 17 05:40:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8670c697-9fcd-4682-b988-d29be5d117d1 tempest-VolumesTestJSON-133050396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d652c1a0-dd29-4658-b002-5bc2924992eb 1073741824" returned: 0 in 0.848s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:40:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8670c697-9fcd-4682-b988-d29be5d117d1 tempest-VolumesTestJSON-133050396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d652c1a0-dd29-4658-b002-5bc2924992eb {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:40:10 devstack sudo[95091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d652c1a0-dd29-4658-b002-5bc2924992eb Jun 17 05:40:10 devstack sudo[95091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:40:11 devstack sudo[95091]: pam_unix(sudo:session): session closed for user root Jun 17 05:40:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8670c697-9fcd-4682-b988-d29be5d117d1 tempest-VolumesTestJSON-133050396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d652c1a0-dd29-4658-b002-5bc2924992eb" returned: 0 in 0.793s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:40:11 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-8670c697-9fcd-4682-b988-d29be5d117d1 tempest-VolumesTestJSON-133050396 None] <== create_volume: return (1714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:40:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-8670c697-9fcd-4682-b988-d29be5d117d1 tempest-VolumesTestJSON-133050396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.716s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:40:11 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8670c697-9fcd-4682-b988-d29be5d117d1 tempest-VolumesTestJSON-133050396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ac1c9ce-2d55-4553-ad41-70da39504ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d652c1a0-dd29-4658-b002-5bc2924992eb', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:40:11 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8670c697-9fcd-4682-b988-d29be5d117d1 tempest-VolumesTestJSON-133050396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b97b2be-a237-47e6-95ca-613ff9129f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:40:11 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-8670c697-9fcd-4682-b988-d29be5d117d1 tempest-VolumesTestJSON-133050396 None] Volume volume-d652c1a0-dd29-4658-b002-5bc2924992eb (d652c1a0-dd29-4658-b002-5bc2924992eb): created successfully Jun 17 05:40:11 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8670c697-9fcd-4682-b988-d29be5d117d1 tempest-VolumesTestJSON-133050396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b97b2be-a237-47e6-95ca-613ff9129f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:40:11 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8670c697-9fcd-4682-b988-d29be5d117d1 tempest-VolumesTestJSON-133050396 None] Flow 'volume_create_manager' (27686f95-af20-4d89-b700-a1aa9bdf6b4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:40:11 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-8670c697-9fcd-4682-b988-d29be5d117d1 tempest-VolumesTestJSON-133050396 None] Created volume successfully. Jun 17 05:40:13 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-3082e2f0-29f8-44c0-b230-763dde934d6a tempest-VolumesTestJSON-133050396 None] Acquiring lock "cinder-d652c1a0-dd29-4658-b002-5bc2924992eb-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:40:13 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-3082e2f0-29f8-44c0-b230-763dde934d6a tempest-VolumesTestJSON-133050396 None] Lock "cinder-d652c1a0-dd29-4658-b002-5bc2924992eb-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:40:13 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-3082e2f0-29f8-44c0-b230-763dde934d6a tempest-VolumesTestJSON-133050396 None] Acquiring lock "cinder-quobyte-d652c1a0-dd29-4658-b002-5bc2924992eb" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:40:13 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-3082e2f0-29f8-44c0-b230-763dde934d6a tempest-VolumesTestJSON-133050396 None] Lock "cinder-quobyte-d652c1a0-dd29-4658-b002-5bc2924992eb" acquired by "delete_volume" :: waited 0.051s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:40:13 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e3dec6-a936-402c-bb20-828386abe390]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:40:13 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-3082e2f0-29f8-44c0-b230-763dde934d6a tempest-VolumesTestJSON-133050396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d652c1a0-dd29-4658-b002-5bc2924992eb {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:40:14 devstack sudo[95155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d652c1a0-dd29-4658-b002-5bc2924992eb Jun 17 05:40:14 devstack sudo[95155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:40:15 devstack sudo[95155]: pam_unix(sudo:session): session closed for user root Jun 17 05:40:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-3082e2f0-29f8-44c0-b230-763dde934d6a tempest-VolumesTestJSON-133050396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d652c1a0-dd29-4658-b002-5bc2924992eb" returned: 0 in 1.259s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:40:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-3082e2f0-29f8-44c0-b230-763dde934d6a tempest-VolumesTestJSON-133050396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d652c1a0-dd29-4658-b002-5bc2924992eb {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:40:15 devstack sudo[95164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d652c1a0-dd29-4658-b002-5bc2924992eb Jun 17 05:40:15 devstack sudo[95164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:40:16 devstack sudo[95164]: pam_unix(sudo:session): session closed for user root Jun 17 05:40:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-3082e2f0-29f8-44c0-b230-763dde934d6a tempest-VolumesTestJSON-133050396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d652c1a0-dd29-4658-b002-5bc2924992eb" returned: 0 in 0.799s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:40:16 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-3082e2f0-29f8-44c0-b230-763dde934d6a tempest-VolumesTestJSON-133050396 None] Lock "cinder-quobyte-d652c1a0-dd29-4658-b002-5bc2924992eb" released by "delete_volume" :: held 2.159s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:40:16 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-3082e2f0-29f8-44c0-b230-763dde934d6a tempest-VolumesTestJSON-133050396 None] Created reservations ['1933f809-ccdb-4d27-ac3a-fc256794dfbc', 'f0dc0b53-2cab-4a4e-9d79-5405d4c2a73c', '7fde3588-85f2-4f57-8fba-ffd8b59e303c', '6176078c-413f-4637-8d8c-337b857e6f2e'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:40:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-3082e2f0-29f8-44c0-b230-763dde934d6a tempest-VolumesTestJSON-133050396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:40:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-3082e2f0-29f8-44c0-b230-763dde934d6a tempest-VolumesTestJSON-133050396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:40:16 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-3082e2f0-29f8-44c0-b230-763dde934d6a tempest-VolumesTestJSON-133050396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:40:16 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-3082e2f0-29f8-44c0-b230-763dde934d6a tempest-VolumesTestJSON-133050396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:40:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-3082e2f0-29f8-44c0-b230-763dde934d6a tempest-VolumesTestJSON-133050396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:40:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-3082e2f0-29f8-44c0-b230-763dde934d6a tempest-VolumesTestJSON-133050396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:40:16 devstack sudo[95167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:40:16 devstack sudo[95167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:40:17 devstack sudo[95167]: pam_unix(sudo:session): session closed for user root Jun 17 05:40:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-3082e2f0-29f8-44c0-b230-763dde934d6a tempest-VolumesTestJSON-133050396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.797s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:40:17 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-3082e2f0-29f8-44c0-b230-763dde934d6a tempest-VolumesTestJSON-133050396 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:40:17 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-3082e2f0-29f8-44c0-b230-763dde934d6a tempest-VolumesTestJSON-133050396 None] Deleted volume successfully. Jun 17 05:40:17 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-3082e2f0-29f8-44c0-b230-763dde934d6a tempest-VolumesTestJSON-133050396 None] Lock "cinder-d652c1a0-dd29-4658-b002-5bc2924992eb-delete_volume" released by "delete_volume" :: held 3.300s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:40:17 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-6b7a24be-d1b6-4839-bbc8-9d8f62ebbd9a tempest-VolumesTestJSON-133050396 None] Acquiring lock "cinder-b0f9343b-eb9e-482b-9ca5-24c6413defc2-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:40:17 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-6b7a24be-d1b6-4839-bbc8-9d8f62ebbd9a tempest-VolumesTestJSON-133050396 None] Lock "cinder-b0f9343b-eb9e-482b-9ca5-24c6413defc2-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:40:17 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-6b7a24be-d1b6-4839-bbc8-9d8f62ebbd9a tempest-VolumesTestJSON-133050396 None] Acquiring lock "cinder-quobyte-b0f9343b-eb9e-482b-9ca5-24c6413defc2" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:40:17 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-6b7a24be-d1b6-4839-bbc8-9d8f62ebbd9a tempest-VolumesTestJSON-133050396 None] Lock "cinder-quobyte-b0f9343b-eb9e-482b-9ca5-24c6413defc2" acquired by "delete_volume" :: waited 0.037s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:40:17 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fdeb421-357e-418e-b9dc-be5c5863de73]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:40:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6b7a24be-d1b6-4839-bbc8-9d8f62ebbd9a tempest-VolumesTestJSON-133050396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b0f9343b-eb9e-482b-9ca5-24c6413defc2 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:40:17 devstack sudo[95170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b0f9343b-eb9e-482b-9ca5-24c6413defc2 Jun 17 05:40:17 devstack sudo[95170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:40:18 devstack sudo[95170]: pam_unix(sudo:session): session closed for user root Jun 17 05:40:18 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6b7a24be-d1b6-4839-bbc8-9d8f62ebbd9a tempest-VolumesTestJSON-133050396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b0f9343b-eb9e-482b-9ca5-24c6413defc2" returned: 0 in 0.975s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:40:18 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6b7a24be-d1b6-4839-bbc8-9d8f62ebbd9a tempest-VolumesTestJSON-133050396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b0f9343b-eb9e-482b-9ca5-24c6413defc2 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:40:18 devstack sudo[95177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b0f9343b-eb9e-482b-9ca5-24c6413defc2 Jun 17 05:40:18 devstack sudo[95177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:40:19 devstack sudo[95177]: pam_unix(sudo:session): session closed for user root Jun 17 05:40:19 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6b7a24be-d1b6-4839-bbc8-9d8f62ebbd9a tempest-VolumesTestJSON-133050396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b0f9343b-eb9e-482b-9ca5-24c6413defc2" returned: 0 in 0.754s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:40:19 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-6b7a24be-d1b6-4839-bbc8-9d8f62ebbd9a tempest-VolumesTestJSON-133050396 None] Lock "cinder-quobyte-b0f9343b-eb9e-482b-9ca5-24c6413defc2" released by "delete_volume" :: held 1.783s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:40:19 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-6b7a24be-d1b6-4839-bbc8-9d8f62ebbd9a tempest-VolumesTestJSON-133050396 None] Created reservations ['656a5f53-6eed-465d-a24a-08f348b7e7c8', 'fe48c5c7-ca47-4220-b367-792a476d13d4', '4aee84d2-c744-452d-8791-27c063034def', 'f342ab20-6bf1-4058-a360-9c0d4ef76efa'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:40:19 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-6b7a24be-d1b6-4839-bbc8-9d8f62ebbd9a tempest-VolumesTestJSON-133050396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:40:19 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-6b7a24be-d1b6-4839-bbc8-9d8f62ebbd9a tempest-VolumesTestJSON-133050396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:40:19 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-6b7a24be-d1b6-4839-bbc8-9d8f62ebbd9a tempest-VolumesTestJSON-133050396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:40:19 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-6b7a24be-d1b6-4839-bbc8-9d8f62ebbd9a tempest-VolumesTestJSON-133050396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:40:19 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-6b7a24be-d1b6-4839-bbc8-9d8f62ebbd9a tempest-VolumesTestJSON-133050396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:40:19 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6b7a24be-d1b6-4839-bbc8-9d8f62ebbd9a tempest-VolumesTestJSON-133050396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:40:19 devstack sudo[95181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:40:19 devstack sudo[95181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:40:19 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-00e437d7-e2ab-46c3-b3cd-66acb10a1ee5 tempest-VolumesTestJSON-133050396 None] Acquiring lock "cinder-74d79f04-e607-44c4-9256-fedb5d7b2dcb-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:40:19 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-00e437d7-e2ab-46c3-b3cd-66acb10a1ee5 tempest-VolumesTestJSON-133050396 None] Lock "cinder-74d79f04-e607-44c4-9256-fedb5d7b2dcb-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:40:19 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-00e437d7-e2ab-46c3-b3cd-66acb10a1ee5 tempest-VolumesTestJSON-133050396 None] Acquiring lock "cinder-quobyte-74d79f04-e607-44c4-9256-fedb5d7b2dcb" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:40:19 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-00e437d7-e2ab-46c3-b3cd-66acb10a1ee5 tempest-VolumesTestJSON-133050396 None] Lock "cinder-quobyte-74d79f04-e607-44c4-9256-fedb5d7b2dcb" acquired by "delete_volume" :: waited 0.038s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:40:19 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df990b4-d920-4343-a43b-1bf43dd87ec7]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:40:19 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-00e437d7-e2ab-46c3-b3cd-66acb10a1ee5 tempest-VolumesTestJSON-133050396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-74d79f04-e607-44c4-9256-fedb5d7b2dcb {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:40:20 devstack sudo[95183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-74d79f04-e607-44c4-9256-fedb5d7b2dcb Jun 17 05:40:20 devstack sudo[95183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:40:20 devstack sudo[95181]: pam_unix(sudo:session): session closed for user root Jun 17 05:40:20 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6b7a24be-d1b6-4839-bbc8-9d8f62ebbd9a tempest-VolumesTestJSON-133050396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.845s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:40:20 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-6b7a24be-d1b6-4839-bbc8-9d8f62ebbd9a tempest-VolumesTestJSON-133050396 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:40:20 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-6b7a24be-d1b6-4839-bbc8-9d8f62ebbd9a tempest-VolumesTestJSON-133050396 None] Deleted volume successfully. Jun 17 05:40:20 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-6b7a24be-d1b6-4839-bbc8-9d8f62ebbd9a tempest-VolumesTestJSON-133050396 None] Lock "cinder-b0f9343b-eb9e-482b-9ca5-24c6413defc2-delete_volume" released by "delete_volume" :: held 2.935s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:40:20 devstack sudo[95183]: pam_unix(sudo:session): session closed for user root Jun 17 05:40:20 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-00e437d7-e2ab-46c3-b3cd-66acb10a1ee5 tempest-VolumesTestJSON-133050396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-74d79f04-e607-44c4-9256-fedb5d7b2dcb" returned: 0 in 0.984s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:40:20 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-00e437d7-e2ab-46c3-b3cd-66acb10a1ee5 tempest-VolumesTestJSON-133050396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-74d79f04-e607-44c4-9256-fedb5d7b2dcb {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:40:20 devstack sudo[95190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-74d79f04-e607-44c4-9256-fedb5d7b2dcb Jun 17 05:40:20 devstack sudo[95190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:40:21 devstack sudo[95190]: pam_unix(sudo:session): session closed for user root Jun 17 05:40:21 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-00e437d7-e2ab-46c3-b3cd-66acb10a1ee5 tempest-VolumesTestJSON-133050396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-74d79f04-e607-44c4-9256-fedb5d7b2dcb" returned: 0 in 0.995s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:40:21 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-00e437d7-e2ab-46c3-b3cd-66acb10a1ee5 tempest-VolumesTestJSON-133050396 None] Lock "cinder-quobyte-74d79f04-e607-44c4-9256-fedb5d7b2dcb" released by "delete_volume" :: held 2.052s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:40:22 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-00e437d7-e2ab-46c3-b3cd-66acb10a1ee5 tempest-VolumesTestJSON-133050396 None] Created reservations ['35176a20-1958-4663-bbdd-3c4b5234d4f3', 'ae47f972-b1cc-413c-b70a-469e3f3ba243', '745d1f27-951f-45ca-97af-08d6f1682e7a', '55ece80e-66b5-4503-8b46-c6fdf267b148'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:40:22 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-00e437d7-e2ab-46c3-b3cd-66acb10a1ee5 tempest-VolumesTestJSON-133050396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:40:22 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-00e437d7-e2ab-46c3-b3cd-66acb10a1ee5 tempest-VolumesTestJSON-133050396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:40:22 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-00e437d7-e2ab-46c3-b3cd-66acb10a1ee5 tempest-VolumesTestJSON-133050396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:40:22 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-00e437d7-e2ab-46c3-b3cd-66acb10a1ee5 tempest-VolumesTestJSON-133050396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:40:22 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-00e437d7-e2ab-46c3-b3cd-66acb10a1ee5 tempest-VolumesTestJSON-133050396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:40:22 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-00e437d7-e2ab-46c3-b3cd-66acb10a1ee5 tempest-VolumesTestJSON-133050396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:40:22 devstack sudo[95229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:40:22 devstack sudo[95229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:40:22 devstack sudo[95229]: pam_unix(sudo:session): session closed for user root Jun 17 05:40:22 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-00e437d7-e2ab-46c3-b3cd-66acb10a1ee5 tempest-VolumesTestJSON-133050396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.748s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:40:22 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-00e437d7-e2ab-46c3-b3cd-66acb10a1ee5 tempest-VolumesTestJSON-133050396 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:40:22 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-00e437d7-e2ab-46c3-b3cd-66acb10a1ee5 tempest-VolumesTestJSON-133050396 None] Deleted volume successfully. Jun 17 05:40:22 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-00e437d7-e2ab-46c3-b3cd-66acb10a1ee5 tempest-VolumesTestJSON-133050396 None] Lock "cinder-74d79f04-e607-44c4-9256-fedb5d7b2dcb-delete_volume" released by "delete_volume" :: held 3.236s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:40:25 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-c19760db-c2f5-4484-9dd8-24f8b95b506f tempest-AttachVolumeTestJSON-1295992640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:40:25 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c19760db-c2f5-4484-9dd8-24f8b95b506f tempest-AttachVolumeTestJSON-1295992640 None] Flow 'volume_create_manager' (c4f5f452-ce04-43c6-b3b5-33108d280155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:40:25 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c19760db-c2f5-4484-9dd8-24f8b95b506f tempest-AttachVolumeTestJSON-1295992640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b40a1a8-2530-43e7-8de7-4e1c6783adaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:40:25 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c19760db-c2f5-4484-9dd8-24f8b95b506f tempest-AttachVolumeTestJSON-1295992640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b40a1a8-2530-43e7-8de7-4e1c6783adaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:40:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2101425434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bf65822-1990-495b-ba97-a96db3520eb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f53e2b9be8464f7b8fb5ddd8da730e6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:40:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:40:26Z,use_quota=True,user_id='f4a2faa939b24437a5879ff1646f687e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:40:25 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c19760db-c2f5-4484-9dd8-24f8b95b506f tempest-AttachVolumeTestJSON-1295992640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dfff4f6-15c6-4b26-8af4-25e9531341e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:40:25 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c19760db-c2f5-4484-9dd8-24f8b95b506f tempest-AttachVolumeTestJSON-1295992640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dfff4f6-15c6-4b26-8af4-25e9531341e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:40:25 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c19760db-c2f5-4484-9dd8-24f8b95b506f tempest-AttachVolumeTestJSON-1295992640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4af27e67-eb73-479c-9193-57eb62d26259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:40:25 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c19760db-c2f5-4484-9dd8-24f8b95b506f tempest-AttachVolumeTestJSON-1295992640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4af27e67-eb73-479c-9193-57eb62d26259) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bf65822-1990-495b-ba97-a96db3520eb0', 'volume_name': 'volume-4bf65822-1990-495b-ba97-a96db3520eb0', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:40:26 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c19760db-c2f5-4484-9dd8-24f8b95b506f tempest-AttachVolumeTestJSON-1295992640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19d6520f-c68d-49eb-89d2-c38690850d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:40:26 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c19760db-c2f5-4484-9dd8-24f8b95b506f tempest-AttachVolumeTestJSON-1295992640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19d6520f-c68d-49eb-89d2-c38690850d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:40:26 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c19760db-c2f5-4484-9dd8-24f8b95b506f tempest-AttachVolumeTestJSON-1295992640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae3cdaa0-b0eb-420c-a733-1d4c126e60b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:40:26 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-c19760db-c2f5-4484-9dd8-24f8b95b506f tempest-AttachVolumeTestJSON-1295992640 None] Volume 4bf65822-1990-495b-ba97-a96db3520eb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bf65822-1990-495b-ba97-a96db3520eb0', 'volume_size': 1} Jun 17 05:40:26 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-c19760db-c2f5-4484-9dd8-24f8b95b506f tempest-AttachVolumeTestJSON-1295992640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:40:26 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-c19760db-c2f5-4484-9dd8-24f8b95b506f tempest-AttachVolumeTestJSON-1295992640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:40:26 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-c19760db-c2f5-4484-9dd8-24f8b95b506f tempest-AttachVolumeTestJSON-1295992640 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:40:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2101425434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bf65822-1990-495b-ba97-a96db3520eb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f53e2b9be8464f7b8fb5ddd8da730e6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:40:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:40:26Z,use_quota=True,user_id='f4a2faa939b24437a5879ff1646f687e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:40:26 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-c19760db-c2f5-4484-9dd8-24f8b95b506f tempest-AttachVolumeTestJSON-1295992640 None] Creating volume 4bf65822-1990-495b-ba97-a96db3520eb0 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:40:26 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-c19760db-c2f5-4484-9dd8-24f8b95b506f tempest-AttachVolumeTestJSON-1295992640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:40:26 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-c19760db-c2f5-4484-9dd8-24f8b95b506f tempest-AttachVolumeTestJSON-1295992640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:40:26 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-c19760db-c2f5-4484-9dd8-24f8b95b506f tempest-AttachVolumeTestJSON-1295992640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:40:26 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-c19760db-c2f5-4484-9dd8-24f8b95b506f tempest-AttachVolumeTestJSON-1295992640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:40:26 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-c19760db-c2f5-4484-9dd8-24f8b95b506f tempest-AttachVolumeTestJSON-1295992640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:40:26 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-c19760db-c2f5-4484-9dd8-24f8b95b506f tempest-AttachVolumeTestJSON-1295992640 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:40:26 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-c19760db-c2f5-4484-9dd8-24f8b95b506f tempest-AttachVolumeTestJSON-1295992640 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:40:26 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c19760db-c2f5-4484-9dd8-24f8b95b506f tempest-AttachVolumeTestJSON-1295992640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4bf65822-1990-495b-ba97-a96db3520eb0 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:40:26 devstack sudo[95241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4bf65822-1990-495b-ba97-a96db3520eb0 1073741824 Jun 17 05:40:26 devstack sudo[95241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:40:27 devstack sudo[95241]: pam_unix(sudo:session): session closed for user root Jun 17 05:40:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c19760db-c2f5-4484-9dd8-24f8b95b506f tempest-AttachVolumeTestJSON-1295992640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4bf65822-1990-495b-ba97-a96db3520eb0 1073741824" returned: 0 in 0.987s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:40:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c19760db-c2f5-4484-9dd8-24f8b95b506f tempest-AttachVolumeTestJSON-1295992640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4bf65822-1990-495b-ba97-a96db3520eb0 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:40:27 devstack sudo[95267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4bf65822-1990-495b-ba97-a96db3520eb0 Jun 17 05:40:27 devstack sudo[95267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:40:27 devstack cinder-volume[92083]: DEBUG oslo_service.periodic_task [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92083) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 05:40:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:40:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:40:27 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:40:27 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:40:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:40:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:40:27 devstack sudo[95269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:40:27 devstack sudo[95269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:40:27 devstack sudo[95267]: pam_unix(sudo:session): session closed for user root Jun 17 05:40:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c19760db-c2f5-4484-9dd8-24f8b95b506f tempest-AttachVolumeTestJSON-1295992640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4bf65822-1990-495b-ba97-a96db3520eb0" returned: 0 in 0.713s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:40:27 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-c19760db-c2f5-4484-9dd8-24f8b95b506f tempest-AttachVolumeTestJSON-1295992640 None] <== create_volume: return (1766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:40:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-c19760db-c2f5-4484-9dd8-24f8b95b506f tempest-AttachVolumeTestJSON-1295992640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.771s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:40:27 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c19760db-c2f5-4484-9dd8-24f8b95b506f tempest-AttachVolumeTestJSON-1295992640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae3cdaa0-b0eb-420c-a733-1d4c126e60b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bf65822-1990-495b-ba97-a96db3520eb0', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:40:27 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c19760db-c2f5-4484-9dd8-24f8b95b506f tempest-AttachVolumeTestJSON-1295992640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d58fcc7-2614-48f1-afe7-edea324de18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:40:27 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-c19760db-c2f5-4484-9dd8-24f8b95b506f tempest-AttachVolumeTestJSON-1295992640 None] Volume volume-4bf65822-1990-495b-ba97-a96db3520eb0 (4bf65822-1990-495b-ba97-a96db3520eb0): created successfully Jun 17 05:40:27 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c19760db-c2f5-4484-9dd8-24f8b95b506f tempest-AttachVolumeTestJSON-1295992640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d58fcc7-2614-48f1-afe7-edea324de18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:40:27 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c19760db-c2f5-4484-9dd8-24f8b95b506f tempest-AttachVolumeTestJSON-1295992640 None] Flow 'volume_create_manager' (c4f5f452-ce04-43c6-b3b5-33108d280155) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:40:27 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-c19760db-c2f5-4484-9dd8-24f8b95b506f tempest-AttachVolumeTestJSON-1295992640 None] Created volume successfully. Jun 17 05:40:28 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-e750cba6-281d-4f7f-b57f-2122b8b711e6 tempest-GroupsTest-390947614 None] Group tempest-Group1-81859002: creating Jun 17 05:40:28 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-e750cba6-281d-4f7f-b57f-2122b8b711e6 tempest-GroupsTest-390947614 None] Group tempest-Group1-81859002: created successfully Jun 17 05:40:28 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-e750cba6-281d-4f7f-b57f-2122b8b711e6 tempest-GroupsTest-390947614 None] Create group completed successfully. Jun 17 05:40:28 devstack sudo[95269]: pam_unix(sudo:session): session closed for user root Jun 17 05:40:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.681s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:40:28 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:40:29 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-f333d555-4f65-430a-8604-4e5e1fbb12ce tempest-GroupsTest-390947614 None] Group tempest-Group2-4002977: creating Jun 17 05:40:29 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-f333d555-4f65-430a-8604-4e5e1fbb12ce tempest-GroupsTest-390947614 None] Group tempest-Group2-4002977: created successfully Jun 17 05:40:29 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-f333d555-4f65-430a-8604-4e5e1fbb12ce tempest-GroupsTest-390947614 None] Create group completed successfully. Jun 17 05:40:30 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-f73e10f7-89d5-44e2-a972-14fe12793d8c tempest-GroupsTest-390947614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:40:30 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-f73e10f7-89d5-44e2-a972-14fe12793d8c tempest-GroupsTest-390947614 None] Flow 'volume_create_manager' (85863771-7847-4520-964b-b329bfb86515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:40:30 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-f73e10f7-89d5-44e2-a972-14fe12793d8c tempest-GroupsTest-390947614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0ba318a-9cb9-4dd1-a347-8754d8eabca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:40:30 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-f73e10f7-89d5-44e2-a972-14fe12793d8c tempest-GroupsTest-390947614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0ba318a-9cb9-4dd1-a347-8754d8eabca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:40:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-371584701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6e9989ef-7f2e-4db8-ae87-1edd2ebe6837,host='devstack@QuobyteHD#QuobyteHD',id=716b0087-d9fc-4221-a512-fc1db591ebbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c32af6e6e04940d7829eecc966cba4e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:40:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:40:31Z,use_quota=True,user_id='f65be56990ac433d8435110bc689a206',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(430c05c3-02b2-4183-acd1-11e53fcd750c),volume_type_id=430c05c3-02b2-4183-acd1-11e53fcd750c)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:40:30 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-f73e10f7-89d5-44e2-a972-14fe12793d8c tempest-GroupsTest-390947614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae89b870-11d8-4fe4-947b-41c2e71c1a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:40:30 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-f73e10f7-89d5-44e2-a972-14fe12793d8c tempest-GroupsTest-390947614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae89b870-11d8-4fe4-947b-41c2e71c1a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:40:30 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-f73e10f7-89d5-44e2-a972-14fe12793d8c tempest-GroupsTest-390947614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f15166bb-2c14-455d-9151-5f0026e1582d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:40:30 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-f73e10f7-89d5-44e2-a972-14fe12793d8c tempest-GroupsTest-390947614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f15166bb-2c14-455d-9151-5f0026e1582d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '716b0087-d9fc-4221-a512-fc1db591ebbd', 'volume_name': 'volume-716b0087-d9fc-4221-a512-fc1db591ebbd', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:40:30 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-f73e10f7-89d5-44e2-a972-14fe12793d8c tempest-GroupsTest-390947614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52e224ba-e652-4d9f-b091-fa7cc0eac5bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:40:30 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-f73e10f7-89d5-44e2-a972-14fe12793d8c tempest-GroupsTest-390947614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52e224ba-e652-4d9f-b091-fa7cc0eac5bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:40:30 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-f73e10f7-89d5-44e2-a972-14fe12793d8c tempest-GroupsTest-390947614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a49f0ffe-b47e-41f5-974a-265373169dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:40:30 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-f73e10f7-89d5-44e2-a972-14fe12793d8c tempest-GroupsTest-390947614 None] Volume 716b0087-d9fc-4221-a512-fc1db591ebbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-716b0087-d9fc-4221-a512-fc1db591ebbd', 'volume_size': 1} Jun 17 05:40:30 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-f73e10f7-89d5-44e2-a972-14fe12793d8c tempest-GroupsTest-390947614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:40:30 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-f73e10f7-89d5-44e2-a972-14fe12793d8c tempest-GroupsTest-390947614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:40:30 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-f73e10f7-89d5-44e2-a972-14fe12793d8c tempest-GroupsTest-390947614 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6e9989ef-7f2e-4db8-ae87-1edd2ebe6837,created_at=2026-06-17T03:40:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-371584701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6e9989ef-7f2e-4db8-ae87-1edd2ebe6837,host='devstack@QuobyteHD#QuobyteHD',id=716b0087-d9fc-4221-a512-fc1db591ebbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c32af6e6e04940d7829eecc966cba4e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:40:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:40:31Z,use_quota=True,user_id='f65be56990ac433d8435110bc689a206',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(430c05c3-02b2-4183-acd1-11e53fcd750c),volume_type_id=430c05c3-02b2-4183-acd1-11e53fcd750c)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:40:30 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-f73e10f7-89d5-44e2-a972-14fe12793d8c tempest-GroupsTest-390947614 None] Creating volume 716b0087-d9fc-4221-a512-fc1db591ebbd {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:40:30 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-f73e10f7-89d5-44e2-a972-14fe12793d8c tempest-GroupsTest-390947614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:40:30 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-f73e10f7-89d5-44e2-a972-14fe12793d8c tempest-GroupsTest-390947614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:40:30 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-f73e10f7-89d5-44e2-a972-14fe12793d8c tempest-GroupsTest-390947614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:40:30 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-f73e10f7-89d5-44e2-a972-14fe12793d8c tempest-GroupsTest-390947614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:40:30 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-f73e10f7-89d5-44e2-a972-14fe12793d8c tempest-GroupsTest-390947614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:40:30 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-f73e10f7-89d5-44e2-a972-14fe12793d8c tempest-GroupsTest-390947614 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:40:30 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-f73e10f7-89d5-44e2-a972-14fe12793d8c tempest-GroupsTest-390947614 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:40:31 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f73e10f7-89d5-44e2-a972-14fe12793d8c tempest-GroupsTest-390947614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-716b0087-d9fc-4221-a512-fc1db591ebbd 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:40:31 devstack sudo[95277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-716b0087-d9fc-4221-a512-fc1db591ebbd 1073741824 Jun 17 05:40:31 devstack sudo[95277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:40:31 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-b646fc08-1dff-4442-8575-b9a69b75da57 req-358d3c0e-e2c0-4dd2-ba93-8137f8e95da6 tempest-AttachVolumeTestJSON-1295992640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:40:31 devstack sudo[95277]: pam_unix(sudo:session): session closed for user root Jun 17 05:40:31 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f73e10f7-89d5-44e2-a972-14fe12793d8c tempest-GroupsTest-390947614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-716b0087-d9fc-4221-a512-fc1db591ebbd 1073741824" returned: 0 in 0.867s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:40:31 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f73e10f7-89d5-44e2-a972-14fe12793d8c tempest-GroupsTest-390947614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-716b0087-d9fc-4221-a512-fc1db591ebbd {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:40:31 devstack sudo[95302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-716b0087-d9fc-4221-a512-fc1db591ebbd Jun 17 05:40:31 devstack sudo[95302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:40:32 devstack sudo[95302]: pam_unix(sudo:session): session closed for user root Jun 17 05:40:32 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f73e10f7-89d5-44e2-a972-14fe12793d8c tempest-GroupsTest-390947614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-716b0087-d9fc-4221-a512-fc1db591ebbd" returned: 0 in 0.608s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:40:32 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-f73e10f7-89d5-44e2-a972-14fe12793d8c tempest-GroupsTest-390947614 None] <== create_volume: return (1518ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:40:32 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-f73e10f7-89d5-44e2-a972-14fe12793d8c tempest-GroupsTest-390947614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.521s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:40:32 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-b646fc08-1dff-4442-8575-b9a69b75da57 req-358d3c0e-e2c0-4dd2-ba93-8137f8e95da6 tempest-AttachVolumeTestJSON-1295992640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.249s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:40:32 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-f73e10f7-89d5-44e2-a972-14fe12793d8c tempest-GroupsTest-390947614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a49f0ffe-b47e-41f5-974a-265373169dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-716b0087-d9fc-4221-a512-fc1db591ebbd', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:40:32 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-f73e10f7-89d5-44e2-a972-14fe12793d8c tempest-GroupsTest-390947614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (180cb773-f4c8-47b2-92da-921ab0215627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:40:32 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[5231839c-25c5-4c9a-84d3-7f9bb11b6833]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:40:32 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-b646fc08-1dff-4442-8575-b9a69b75da57 req-358d3c0e-e2c0-4dd2-ba93-8137f8e95da6 tempest-AttachVolumeTestJSON-1295992640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4bf65822-1990-495b-ba97-a96db3520eb0 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:40:32 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-f73e10f7-89d5-44e2-a972-14fe12793d8c tempest-GroupsTest-390947614 None] Volume volume-716b0087-d9fc-4221-a512-fc1db591ebbd (716b0087-d9fc-4221-a512-fc1db591ebbd): created successfully Jun 17 05:40:32 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-f73e10f7-89d5-44e2-a972-14fe12793d8c tempest-GroupsTest-390947614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (180cb773-f4c8-47b2-92da-921ab0215627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:40:32 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-f73e10f7-89d5-44e2-a972-14fe12793d8c tempest-GroupsTest-390947614 None] Flow 'volume_create_manager' (85863771-7847-4520-964b-b329bfb86515) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:40:32 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-f73e10f7-89d5-44e2-a972-14fe12793d8c tempest-GroupsTest-390947614 None] Created volume successfully. Jun 17 05:40:32 devstack sudo[95313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4bf65822-1990-495b-ba97-a96db3520eb0 Jun 17 05:40:32 devstack sudo[95313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:40:33 devstack sudo[95313]: pam_unix(sudo:session): session closed for user root Jun 17 05:40:33 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-b646fc08-1dff-4442-8575-b9a69b75da57 req-358d3c0e-e2c0-4dd2-ba93-8137f8e95da6 tempest-AttachVolumeTestJSON-1295992640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4bf65822-1990-495b-ba97-a96db3520eb0" returned: 0 in 0.709s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:40:33 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-b646fc08-1dff-4442-8575-b9a69b75da57 req-358d3c0e-e2c0-4dd2-ba93-8137f8e95da6 tempest-AttachVolumeTestJSON-1295992640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.742s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:40:33 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [req-b646fc08-1dff-4442-8575-b9a69b75da57 req-358d3c0e-e2c0-4dd2-ba93-8137f8e95da6 tempest-AttachVolumeTestJSON-1295992640 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f', 'name': 'volume-4bf65822-1990-495b-ba97-a96db3520eb0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'aa98709a-cf97-4e24-8735-856b63b31af0', 'enforce_multipath': True} {{(pid=92083) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 17 05:40:33 devstack cinder-volume[92083]: INFO cinder.volume.manager [req-b646fc08-1dff-4442-8575-b9a69b75da57 req-358d3c0e-e2c0-4dd2-ba93-8137f8e95da6 tempest-AttachVolumeTestJSON-1295992640 None] attachment_update completed successfully. Jun 17 05:40:33 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-1941d334-14dc-46ef-8a56-ff28e7206abd tempest-GroupsTest-390947614 None] Acquiring lock "cinder-quobyte-716b0087-d9fc-4221-a512-fc1db591ebbd" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:40:33 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-1941d334-14dc-46ef-8a56-ff28e7206abd tempest-GroupsTest-390947614 None] Lock "cinder-quobyte-716b0087-d9fc-4221-a512-fc1db591ebbd" acquired by "delete_volume" :: waited 0.016s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:40:33 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54e48bf-e589-466c-aaa2-268126a1c368]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:40:33 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1941d334-14dc-46ef-8a56-ff28e7206abd tempest-GroupsTest-390947614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-716b0087-d9fc-4221-a512-fc1db591ebbd {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:40:33 devstack sudo[95318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-716b0087-d9fc-4221-a512-fc1db591ebbd Jun 17 05:40:33 devstack sudo[95318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:40:34 devstack sudo[95318]: pam_unix(sudo:session): session closed for user root Jun 17 05:40:34 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1941d334-14dc-46ef-8a56-ff28e7206abd tempest-GroupsTest-390947614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-716b0087-d9fc-4221-a512-fc1db591ebbd" returned: 0 in 0.827s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:40:34 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1941d334-14dc-46ef-8a56-ff28e7206abd tempest-GroupsTest-390947614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-716b0087-d9fc-4221-a512-fc1db591ebbd {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:40:34 devstack sudo[95392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-716b0087-d9fc-4221-a512-fc1db591ebbd Jun 17 05:40:34 devstack sudo[95392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:40:35 devstack sudo[95392]: pam_unix(sudo:session): session closed for user root Jun 17 05:40:35 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1941d334-14dc-46ef-8a56-ff28e7206abd tempest-GroupsTest-390947614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-716b0087-d9fc-4221-a512-fc1db591ebbd" returned: 0 in 0.641s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:40:35 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-1941d334-14dc-46ef-8a56-ff28e7206abd tempest-GroupsTest-390947614 None] Lock "cinder-quobyte-716b0087-d9fc-4221-a512-fc1db591ebbd" released by "delete_volume" :: held 1.533s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:40:35 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-1941d334-14dc-46ef-8a56-ff28e7206abd tempest-GroupsTest-390947614 None] Created reservations ['4b9def5a-5e71-481e-b2d5-0c5cdcd5ec77'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:40:35 devstack cinder-volume[92083]: WARNING cinder.quota [None req-1941d334-14dc-46ef-8a56-ff28e7206abd tempest-GroupsTest-390947614 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1405333664 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1405333664, it is now deprecated. Please use the default quota class for default quota. Jun 17 05:40:35 devstack cinder-volume[92083]: WARNING cinder.quota [None req-1941d334-14dc-46ef-8a56-ff28e7206abd tempest-GroupsTest-390947614 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1405333664 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1405333664, it is now deprecated. Please use the default quota class for default quota. Jun 17 05:40:35 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-1941d334-14dc-46ef-8a56-ff28e7206abd tempest-GroupsTest-390947614 None] Created reservations ['79bfd1f2-0fe2-4893-a7bc-c422d539fbb5', '37a6c112-0951-4227-b9e1-4febb5d7ecb0', 'e2c7d0bb-af1f-4be6-8d35-0b5fac02aa14', '69dd88e8-0fc7-4c92-816c-225836b6dcdf'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:40:35 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-1941d334-14dc-46ef-8a56-ff28e7206abd tempest-GroupsTest-390947614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:40:35 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-1941d334-14dc-46ef-8a56-ff28e7206abd tempest-GroupsTest-390947614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:40:35 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-1941d334-14dc-46ef-8a56-ff28e7206abd tempest-GroupsTest-390947614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:40:35 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-1941d334-14dc-46ef-8a56-ff28e7206abd tempest-GroupsTest-390947614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:40:35 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-1941d334-14dc-46ef-8a56-ff28e7206abd tempest-GroupsTest-390947614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:40:35 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1941d334-14dc-46ef-8a56-ff28e7206abd tempest-GroupsTest-390947614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:40:35 devstack sudo[95714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:40:35 devstack sudo[95714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:40:36 devstack sudo[95714]: pam_unix(sudo:session): session closed for user root Jun 17 05:40:36 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1941d334-14dc-46ef-8a56-ff28e7206abd tempest-GroupsTest-390947614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.658s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:40:36 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-1941d334-14dc-46ef-8a56-ff28e7206abd tempest-GroupsTest-390947614 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:40:36 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-1941d334-14dc-46ef-8a56-ff28e7206abd tempest-GroupsTest-390947614 None] Delete group completed successfully. Jun 17 05:40:36 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-7cb36139-c671-480b-8280-fe05b9c573c0 tempest-GroupsTest-390947614 None] Created reservations ['9b19381f-7817-4cd3-b88d-0b91df63f43d'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:40:36 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-7cb36139-c671-480b-8280-fe05b9c573c0 tempest-GroupsTest-390947614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:40:36 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-7cb36139-c671-480b-8280-fe05b9c573c0 tempest-GroupsTest-390947614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:40:36 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-7cb36139-c671-480b-8280-fe05b9c573c0 tempest-GroupsTest-390947614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:40:36 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-7cb36139-c671-480b-8280-fe05b9c573c0 tempest-GroupsTest-390947614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:40:36 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-7cb36139-c671-480b-8280-fe05b9c573c0 tempest-GroupsTest-390947614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:40:36 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-7cb36139-c671-480b-8280-fe05b9c573c0 tempest-GroupsTest-390947614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:40:36 devstack sudo[95718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:40:36 devstack sudo[95718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:40:37 devstack sudo[95718]: pam_unix(sudo:session): session closed for user root Jun 17 05:40:37 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-7cb36139-c671-480b-8280-fe05b9c573c0 tempest-GroupsTest-390947614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.893s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:40:37 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-7cb36139-c671-480b-8280-fe05b9c573c0 tempest-GroupsTest-390947614 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:40:37 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-7cb36139-c671-480b-8280-fe05b9c573c0 tempest-GroupsTest-390947614 None] Delete group completed successfully. Jun 17 05:40:38 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-6dd1775a-6cd8-42e3-be5a-0d8e6a518b45 tempest-GroupsTest-390947614 None] Group tempest-GroupsTest-Group-445426915: creating Jun 17 05:40:38 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-6dd1775a-6cd8-42e3-be5a-0d8e6a518b45 tempest-GroupsTest-390947614 None] Group tempest-GroupsTest-Group-445426915: created successfully Jun 17 05:40:38 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-6dd1775a-6cd8-42e3-be5a-0d8e6a518b45 tempest-GroupsTest-390947614 None] Create group completed successfully. Jun 17 05:40:39 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-16364016-2fc3-4f46-bcf6-b0c8f1bd45fa tempest-GroupsTest-390947614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:40:39 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-16364016-2fc3-4f46-bcf6-b0c8f1bd45fa tempest-GroupsTest-390947614 None] Flow 'volume_create_manager' (357e00d7-02be-4289-bf73-a86d8944616f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:40:39 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-16364016-2fc3-4f46-bcf6-b0c8f1bd45fa tempest-GroupsTest-390947614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31aa202c-edd9-42d1-b7e1-13b392f7f203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:40:39 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-16364016-2fc3-4f46-bcf6-b0c8f1bd45fa tempest-GroupsTest-390947614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31aa202c-edd9-42d1-b7e1-13b392f7f203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:40:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1972189353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ac296d1d-a760-4bd4-9674-416c7a72069c,host='devstack@QuobyteHD#QuobyteHD',id=7663181f-2ccc-436f-a5a3-387120045843,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c32af6e6e04940d7829eecc966cba4e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:40:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:40:40Z,use_quota=True,user_id='f65be56990ac433d8435110bc689a206',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eb094801-f100-42d7-b38c-ff5a49adcbf6),volume_type_id=eb094801-f100-42d7-b38c-ff5a49adcbf6)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:40:39 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-16364016-2fc3-4f46-bcf6-b0c8f1bd45fa tempest-GroupsTest-390947614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e624acb-3b13-4251-a928-1ed65087f519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:40:39 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-16364016-2fc3-4f46-bcf6-b0c8f1bd45fa tempest-GroupsTest-390947614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e624acb-3b13-4251-a928-1ed65087f519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:40:39 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-16364016-2fc3-4f46-bcf6-b0c8f1bd45fa tempest-GroupsTest-390947614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2038702-a107-413a-8082-087068e693b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:40:39 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-16364016-2fc3-4f46-bcf6-b0c8f1bd45fa tempest-GroupsTest-390947614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2038702-a107-413a-8082-087068e693b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7663181f-2ccc-436f-a5a3-387120045843', 'volume_name': 'volume-7663181f-2ccc-436f-a5a3-387120045843', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:40:39 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-16364016-2fc3-4f46-bcf6-b0c8f1bd45fa tempest-GroupsTest-390947614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6de9e045-d246-4007-b01a-cf9c2e89b8c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:40:39 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-16364016-2fc3-4f46-bcf6-b0c8f1bd45fa tempest-GroupsTest-390947614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6de9e045-d246-4007-b01a-cf9c2e89b8c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:40:39 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-16364016-2fc3-4f46-bcf6-b0c8f1bd45fa tempest-GroupsTest-390947614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ae5a323-fad1-464f-add1-6f14afbb14e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:40:39 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-16364016-2fc3-4f46-bcf6-b0c8f1bd45fa tempest-GroupsTest-390947614 None] Volume 7663181f-2ccc-436f-a5a3-387120045843: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7663181f-2ccc-436f-a5a3-387120045843', 'volume_size': 1} Jun 17 05:40:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-16364016-2fc3-4f46-bcf6-b0c8f1bd45fa tempest-GroupsTest-390947614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:40:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-16364016-2fc3-4f46-bcf6-b0c8f1bd45fa tempest-GroupsTest-390947614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:40:39 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-16364016-2fc3-4f46-bcf6-b0c8f1bd45fa tempest-GroupsTest-390947614 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ac296d1d-a760-4bd4-9674-416c7a72069c,created_at=2026-06-17T03:40:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1972189353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ac296d1d-a760-4bd4-9674-416c7a72069c,host='devstack@QuobyteHD#QuobyteHD',id=7663181f-2ccc-436f-a5a3-387120045843,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c32af6e6e04940d7829eecc966cba4e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:40:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:40:40Z,use_quota=True,user_id='f65be56990ac433d8435110bc689a206',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eb094801-f100-42d7-b38c-ff5a49adcbf6),volume_type_id=eb094801-f100-42d7-b38c-ff5a49adcbf6)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:40:39 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-16364016-2fc3-4f46-bcf6-b0c8f1bd45fa tempest-GroupsTest-390947614 None] Creating volume 7663181f-2ccc-436f-a5a3-387120045843 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:40:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-16364016-2fc3-4f46-bcf6-b0c8f1bd45fa tempest-GroupsTest-390947614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:40:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-16364016-2fc3-4f46-bcf6-b0c8f1bd45fa tempest-GroupsTest-390947614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:40:39 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-16364016-2fc3-4f46-bcf6-b0c8f1bd45fa tempest-GroupsTest-390947614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:40:39 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-16364016-2fc3-4f46-bcf6-b0c8f1bd45fa tempest-GroupsTest-390947614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:40:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-16364016-2fc3-4f46-bcf6-b0c8f1bd45fa tempest-GroupsTest-390947614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:40:39 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-16364016-2fc3-4f46-bcf6-b0c8f1bd45fa tempest-GroupsTest-390947614 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:40:39 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-16364016-2fc3-4f46-bcf6-b0c8f1bd45fa tempest-GroupsTest-390947614 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:40:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-16364016-2fc3-4f46-bcf6-b0c8f1bd45fa tempest-GroupsTest-390947614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7663181f-2ccc-436f-a5a3-387120045843 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:40:39 devstack sudo[95786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7663181f-2ccc-436f-a5a3-387120045843 1073741824 Jun 17 05:40:39 devstack sudo[95786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:40:41 devstack sudo[95786]: pam_unix(sudo:session): session closed for user root Jun 17 05:40:41 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-16364016-2fc3-4f46-bcf6-b0c8f1bd45fa tempest-GroupsTest-390947614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7663181f-2ccc-436f-a5a3-387120045843 1073741824" returned: 0 in 1.288s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:40:41 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-16364016-2fc3-4f46-bcf6-b0c8f1bd45fa tempest-GroupsTest-390947614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7663181f-2ccc-436f-a5a3-387120045843 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:40:41 devstack sudo[95833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7663181f-2ccc-436f-a5a3-387120045843 Jun 17 05:40:41 devstack sudo[95833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:40:42 devstack sudo[95833]: pam_unix(sudo:session): session closed for user root Jun 17 05:40:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-16364016-2fc3-4f46-bcf6-b0c8f1bd45fa tempest-GroupsTest-390947614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7663181f-2ccc-436f-a5a3-387120045843" returned: 0 in 0.976s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:40:42 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-16364016-2fc3-4f46-bcf6-b0c8f1bd45fa tempest-GroupsTest-390947614 None] <== create_volume: return (2337ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:40:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-16364016-2fc3-4f46-bcf6-b0c8f1bd45fa tempest-GroupsTest-390947614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.341s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:40:42 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-16364016-2fc3-4f46-bcf6-b0c8f1bd45fa tempest-GroupsTest-390947614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ae5a323-fad1-464f-add1-6f14afbb14e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7663181f-2ccc-436f-a5a3-387120045843', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:40:42 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-16364016-2fc3-4f46-bcf6-b0c8f1bd45fa tempest-GroupsTest-390947614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68bd5c9b-7aed-4ca6-aa31-36ddf566e021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:40:42 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-16364016-2fc3-4f46-bcf6-b0c8f1bd45fa tempest-GroupsTest-390947614 None] Volume volume-7663181f-2ccc-436f-a5a3-387120045843 (7663181f-2ccc-436f-a5a3-387120045843): created successfully Jun 17 05:40:42 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-16364016-2fc3-4f46-bcf6-b0c8f1bd45fa tempest-GroupsTest-390947614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68bd5c9b-7aed-4ca6-aa31-36ddf566e021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:40:42 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-16364016-2fc3-4f46-bcf6-b0c8f1bd45fa tempest-GroupsTest-390947614 None] Flow 'volume_create_manager' (357e00d7-02be-4289-bf73-a86d8944616f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:40:42 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-16364016-2fc3-4f46-bcf6-b0c8f1bd45fa tempest-GroupsTest-390947614 None] Created volume successfully. Jun 17 05:40:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-14a6e85b-efa0-4843-b430-031fe5d84114 req-2453ce88-98fc-48f6-9a57-7a362c7bdf5e tempest-ServerActionsTestOtherA-2081174214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:40:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-14a6e85b-efa0-4843-b430-031fe5d84114 req-2453ce88-98fc-48f6-9a57-7a362c7bdf5e tempest-ServerActionsTestOtherA-2081174214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:40:42 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a37392-f669-47ca-afec-9fa27c8e03f8]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:40:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-14a6e85b-efa0-4843-b430-031fe5d84114 req-2453ce88-98fc-48f6-9a57-7a362c7bdf5e tempest-ServerActionsTestOtherA-2081174214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-117e939d-3af9-4f51-b678-c1e8b1727c2e {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:40:42 devstack sudo[95845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-117e939d-3af9-4f51-b678-c1e8b1727c2e Jun 17 05:40:42 devstack sudo[95845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:40:43 devstack sudo[95845]: pam_unix(sudo:session): session closed for user root Jun 17 05:40:43 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-14a6e85b-efa0-4843-b430-031fe5d84114 req-2453ce88-98fc-48f6-9a57-7a362c7bdf5e tempest-ServerActionsTestOtherA-2081174214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-117e939d-3af9-4f51-b678-c1e8b1727c2e" returned: 0 in 0.839s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:40:43 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-14a6e85b-efa0-4843-b430-031fe5d84114 req-2453ce88-98fc-48f6-9a57-7a362c7bdf5e tempest-ServerActionsTestOtherA-2081174214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.859s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:40:43 devstack cinder-volume[92083]: DEBUG dbcounter [-] [92083] Writing DB stats cinder:SELECT=66,cinder:INSERT=17,cinder:UPDATE=69,cinder:DELETE=7 {{(pid=92083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:40:43 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [req-14a6e85b-efa0-4843-b430-031fe5d84114 req-2453ce88-98fc-48f6-9a57-7a362c7bdf5e tempest-ServerActionsTestOtherA-2081174214 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f', 'name': 'volume-117e939d-3af9-4f51-b678-c1e8b1727c2e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '30095d23-60a5-42de-94b5-3ee24233d148', 'enforce_multipath': True} {{(pid=92083) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 17 05:40:43 devstack cinder-volume[92083]: INFO cinder.volume.manager [req-14a6e85b-efa0-4843-b430-031fe5d84114 req-2453ce88-98fc-48f6-9a57-7a362c7bdf5e tempest-ServerActionsTestOtherA-2081174214 None] attachment_update completed successfully. Jun 17 05:40:43 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b75a722-ec2b-43b5-9249-f75742ed097f tempest-GroupsTest-390947614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:40:43 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0b75a722-ec2b-43b5-9249-f75742ed097f tempest-GroupsTest-390947614 None] Flow 'volume_create_manager' (78ebdde6-a5ed-47db-8536-42d5f1ac25dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:40:43 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0b75a722-ec2b-43b5-9249-f75742ed097f tempest-GroupsTest-390947614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d26714c-8cc4-422b-ad1d-b228b63fb9da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:40:43 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0b75a722-ec2b-43b5-9249-f75742ed097f tempest-GroupsTest-390947614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d26714c-8cc4-422b-ad1d-b228b63fb9da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:40:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-768387167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ac296d1d-a760-4bd4-9674-416c7a72069c,host='devstack@QuobyteHD#QuobyteHD',id=3a9c1225-8a0d-487a-be1e-3a2896dd889f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c32af6e6e04940d7829eecc966cba4e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:40:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:40:44Z,use_quota=True,user_id='f65be56990ac433d8435110bc689a206',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eb094801-f100-42d7-b38c-ff5a49adcbf6),volume_type_id=eb094801-f100-42d7-b38c-ff5a49adcbf6)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:40:43 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0b75a722-ec2b-43b5-9249-f75742ed097f tempest-GroupsTest-390947614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8af36f46-6bc7-4bcb-91a8-7bacf26918ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:40:43 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0b75a722-ec2b-43b5-9249-f75742ed097f tempest-GroupsTest-390947614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8af36f46-6bc7-4bcb-91a8-7bacf26918ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:40:43 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0b75a722-ec2b-43b5-9249-f75742ed097f tempest-GroupsTest-390947614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c037f76-3fe1-4aa1-ad42-26e948ef684b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:40:43 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0b75a722-ec2b-43b5-9249-f75742ed097f tempest-GroupsTest-390947614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c037f76-3fe1-4aa1-ad42-26e948ef684b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a9c1225-8a0d-487a-be1e-3a2896dd889f', 'volume_name': 'volume-3a9c1225-8a0d-487a-be1e-3a2896dd889f', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:40:43 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0b75a722-ec2b-43b5-9249-f75742ed097f tempest-GroupsTest-390947614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (721d7485-f761-49b3-b99c-d12f07be2a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:40:43 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0b75a722-ec2b-43b5-9249-f75742ed097f tempest-GroupsTest-390947614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (721d7485-f761-49b3-b99c-d12f07be2a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:40:43 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0b75a722-ec2b-43b5-9249-f75742ed097f tempest-GroupsTest-390947614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (840aae5c-27cd-4ed2-8b0b-538bb1be6ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:40:43 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-0b75a722-ec2b-43b5-9249-f75742ed097f tempest-GroupsTest-390947614 None] Volume 3a9c1225-8a0d-487a-be1e-3a2896dd889f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a9c1225-8a0d-487a-be1e-3a2896dd889f', 'volume_size': 1} Jun 17 05:40:43 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-0b75a722-ec2b-43b5-9249-f75742ed097f tempest-GroupsTest-390947614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:40:43 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-0b75a722-ec2b-43b5-9249-f75742ed097f tempest-GroupsTest-390947614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:40:43 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-0b75a722-ec2b-43b5-9249-f75742ed097f tempest-GroupsTest-390947614 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ac296d1d-a760-4bd4-9674-416c7a72069c,created_at=2026-06-17T03:40:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-768387167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ac296d1d-a760-4bd4-9674-416c7a72069c,host='devstack@QuobyteHD#QuobyteHD',id=3a9c1225-8a0d-487a-be1e-3a2896dd889f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c32af6e6e04940d7829eecc966cba4e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:40:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:40:44Z,use_quota=True,user_id='f65be56990ac433d8435110bc689a206',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eb094801-f100-42d7-b38c-ff5a49adcbf6),volume_type_id=eb094801-f100-42d7-b38c-ff5a49adcbf6)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:40:43 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-0b75a722-ec2b-43b5-9249-f75742ed097f tempest-GroupsTest-390947614 None] Creating volume 3a9c1225-8a0d-487a-be1e-3a2896dd889f {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:40:43 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-0b75a722-ec2b-43b5-9249-f75742ed097f tempest-GroupsTest-390947614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:40:43 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-0b75a722-ec2b-43b5-9249-f75742ed097f tempest-GroupsTest-390947614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:40:43 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-0b75a722-ec2b-43b5-9249-f75742ed097f tempest-GroupsTest-390947614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:40:43 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-0b75a722-ec2b-43b5-9249-f75742ed097f tempest-GroupsTest-390947614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:40:43 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-0b75a722-ec2b-43b5-9249-f75742ed097f tempest-GroupsTest-390947614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:40:43 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-0b75a722-ec2b-43b5-9249-f75742ed097f tempest-GroupsTest-390947614 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:40:43 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-0b75a722-ec2b-43b5-9249-f75742ed097f tempest-GroupsTest-390947614 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:40:43 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0b75a722-ec2b-43b5-9249-f75742ed097f tempest-GroupsTest-390947614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-3a9c1225-8a0d-487a-be1e-3a2896dd889f 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:40:43 devstack sudo[95850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-3a9c1225-8a0d-487a-be1e-3a2896dd889f 1073741824 Jun 17 05:40:43 devstack sudo[95850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:40:44 devstack sudo[95850]: pam_unix(sudo:session): session closed for user root Jun 17 05:40:44 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0b75a722-ec2b-43b5-9249-f75742ed097f tempest-GroupsTest-390947614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-3a9c1225-8a0d-487a-be1e-3a2896dd889f 1073741824" returned: 0 in 0.888s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:40:44 devstack cinder-volume[92083]: DEBUG dbcounter [-] [92083] Writing DB stats cinder:UPDATE=76,cinder:SELECT=57,cinder:INSERT=12,cinder:DELETE=4 {{(pid=92083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:40:44 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0b75a722-ec2b-43b5-9249-f75742ed097f tempest-GroupsTest-390947614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-3a9c1225-8a0d-487a-be1e-3a2896dd889f {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:40:44 devstack sudo[95858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-3a9c1225-8a0d-487a-be1e-3a2896dd889f Jun 17 05:40:44 devstack sudo[95858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:40:45 devstack sudo[95858]: pam_unix(sudo:session): session closed for user root Jun 17 05:40:45 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0b75a722-ec2b-43b5-9249-f75742ed097f tempest-GroupsTest-390947614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-3a9c1225-8a0d-487a-be1e-3a2896dd889f" returned: 0 in 0.636s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:40:45 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-0b75a722-ec2b-43b5-9249-f75742ed097f tempest-GroupsTest-390947614 None] <== create_volume: return (1589ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:40:45 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-0b75a722-ec2b-43b5-9249-f75742ed097f tempest-GroupsTest-390947614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.591s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:40:45 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0b75a722-ec2b-43b5-9249-f75742ed097f tempest-GroupsTest-390947614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (840aae5c-27cd-4ed2-8b0b-538bb1be6ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a9c1225-8a0d-487a-be1e-3a2896dd889f', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:40:45 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0b75a722-ec2b-43b5-9249-f75742ed097f tempest-GroupsTest-390947614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb7cb488-8721-45b6-8c85-f9c7032b14ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:40:45 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-0b75a722-ec2b-43b5-9249-f75742ed097f tempest-GroupsTest-390947614 None] Volume volume-3a9c1225-8a0d-487a-be1e-3a2896dd889f (3a9c1225-8a0d-487a-be1e-3a2896dd889f): created successfully Jun 17 05:40:45 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0b75a722-ec2b-43b5-9249-f75742ed097f tempest-GroupsTest-390947614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb7cb488-8721-45b6-8c85-f9c7032b14ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:40:45 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0b75a722-ec2b-43b5-9249-f75742ed097f tempest-GroupsTest-390947614 None] Flow 'volume_create_manager' (78ebdde6-a5ed-47db-8536-42d5f1ac25dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:40:45 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-0b75a722-ec2b-43b5-9249-f75742ed097f tempest-GroupsTest-390947614 None] Created volume successfully. Jun 17 05:40:46 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-2ed0e6a4-4f6e-4d06-8d6f-b5b196e67dec tempest-GroupsTest-390947614 None] Update group completed successfully. Jun 17 05:40:47 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-83eb01b3-4d4f-474b-9191-866b72c58bc5 tempest-GroupsTest-390947614 None] Update group completed successfully. Jun 17 05:40:49 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-fbef21b7-60d9-4aa8-a197-ed064f36e361 tempest-GroupsTest-390947614 None] Acquiring lock "cinder-quobyte-3a9c1225-8a0d-487a-be1e-3a2896dd889f" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:40:49 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-fbef21b7-60d9-4aa8-a197-ed064f36e361 tempest-GroupsTest-390947614 None] Lock "cinder-quobyte-3a9c1225-8a0d-487a-be1e-3a2896dd889f" acquired by "delete_volume" :: waited 0.034s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:40:49 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b3e667-2b00-4f4c-9f76-542a30ca3046]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:40:49 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-fbef21b7-60d9-4aa8-a197-ed064f36e361 tempest-GroupsTest-390947614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-3a9c1225-8a0d-487a-be1e-3a2896dd889f {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:40:49 devstack sudo[95882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-3a9c1225-8a0d-487a-be1e-3a2896dd889f Jun 17 05:40:49 devstack sudo[95882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:40:50 devstack sudo[95882]: pam_unix(sudo:session): session closed for user root Jun 17 05:40:50 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-fbef21b7-60d9-4aa8-a197-ed064f36e361 tempest-GroupsTest-390947614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-3a9c1225-8a0d-487a-be1e-3a2896dd889f" returned: 0 in 1.038s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:40:50 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-fbef21b7-60d9-4aa8-a197-ed064f36e361 tempest-GroupsTest-390947614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-3a9c1225-8a0d-487a-be1e-3a2896dd889f {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:40:50 devstack sudo[95914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-3a9c1225-8a0d-487a-be1e-3a2896dd889f Jun 17 05:40:50 devstack sudo[95914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:40:51 devstack sudo[95914]: pam_unix(sudo:session): session closed for user root Jun 17 05:40:51 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-fbef21b7-60d9-4aa8-a197-ed064f36e361 tempest-GroupsTest-390947614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-3a9c1225-8a0d-487a-be1e-3a2896dd889f" returned: 0 in 0.646s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:40:51 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-fbef21b7-60d9-4aa8-a197-ed064f36e361 tempest-GroupsTest-390947614 None] Lock "cinder-quobyte-3a9c1225-8a0d-487a-be1e-3a2896dd889f" released by "delete_volume" :: held 1.774s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:40:51 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-fbef21b7-60d9-4aa8-a197-ed064f36e361 tempest-GroupsTest-390947614 None] Acquiring lock "cinder-quobyte-7663181f-2ccc-436f-a5a3-387120045843" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:40:51 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-fbef21b7-60d9-4aa8-a197-ed064f36e361 tempest-GroupsTest-390947614 None] Lock "cinder-quobyte-7663181f-2ccc-436f-a5a3-387120045843" acquired by "delete_volume" :: waited 0.032s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:40:51 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0256e96-9eea-457b-bfb0-36d4a5994ada]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:40:51 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-fbef21b7-60d9-4aa8-a197-ed064f36e361 tempest-GroupsTest-390947614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7663181f-2ccc-436f-a5a3-387120045843 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:40:51 devstack sudo[95933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7663181f-2ccc-436f-a5a3-387120045843 Jun 17 05:40:51 devstack sudo[95933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:40:52 devstack sudo[95933]: pam_unix(sudo:session): session closed for user root Jun 17 05:40:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-fbef21b7-60d9-4aa8-a197-ed064f36e361 tempest-GroupsTest-390947614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7663181f-2ccc-436f-a5a3-387120045843" returned: 0 in 1.380s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:40:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-fbef21b7-60d9-4aa8-a197-ed064f36e361 tempest-GroupsTest-390947614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7663181f-2ccc-436f-a5a3-387120045843 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:40:52 devstack sudo[96060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7663181f-2ccc-436f-a5a3-387120045843 Jun 17 05:40:52 devstack sudo[96060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:40:53 devstack cinder-volume[92083]: INFO cinder.volume.manager [req-e32afc34-781f-43a4-934a-1cd5339e5e3c req-453475a3-0cd4-4f16-8a45-461026e44d06 tempest-ServerActionsTestOtherA-2081174214 None] Terminate volume connection completed successfully. Jun 17 05:40:53 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [req-e32afc34-781f-43a4-934a-1cd5339e5e3c req-453475a3-0cd4-4f16-8a45-461026e44d06 tempest-ServerActionsTestOtherA-2081174214 None] Deleting attachment 30095d23-60a5-42de-94b5-3ee24233d148. {{(pid=92083) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 17 05:40:53 devstack sudo[96060]: pam_unix(sudo:session): session closed for user root Jun 17 05:40:53 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-fbef21b7-60d9-4aa8-a197-ed064f36e361 tempest-GroupsTest-390947614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7663181f-2ccc-436f-a5a3-387120045843" returned: 0 in 1.071s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:40:53 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-fbef21b7-60d9-4aa8-a197-ed064f36e361 tempest-GroupsTest-390947614 None] Lock "cinder-quobyte-7663181f-2ccc-436f-a5a3-387120045843" released by "delete_volume" :: held 2.522s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:40:53 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-fbef21b7-60d9-4aa8-a197-ed064f36e361 tempest-GroupsTest-390947614 None] Created reservations ['9947d951-99f2-4679-957c-5a776a60fd47'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:40:54 devstack cinder-volume[92083]: WARNING cinder.quota [None req-fbef21b7-60d9-4aa8-a197-ed064f36e361 tempest-GroupsTest-390947614 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-584147353 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-584147353, it is now deprecated. Please use the default quota class for default quota. Jun 17 05:40:54 devstack cinder-volume[92083]: WARNING cinder.quota [None req-fbef21b7-60d9-4aa8-a197-ed064f36e361 tempest-GroupsTest-390947614 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-584147353 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-584147353, it is now deprecated. Please use the default quota class for default quota. Jun 17 05:40:54 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-fbef21b7-60d9-4aa8-a197-ed064f36e361 tempest-GroupsTest-390947614 None] Created reservations ['fef65933-fd53-4f42-b7de-3b2c15b86e9c', '369a8447-e516-454f-be36-93eb8d839589', '4ad05977-824c-4bc0-9e0b-5bafa12bc563', '53397647-0abe-4ab5-8cef-5a8570e7aff3'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:40:54 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-fbef21b7-60d9-4aa8-a197-ed064f36e361 tempest-GroupsTest-390947614 None] Created reservations ['dd87119f-a473-4b1e-aac6-1f39a5ce2889', 'af3e3604-88f1-4d00-981c-518eb1e1d65d', '18c67cbf-c7cb-4cfa-90c7-dcca9829f28a', '78b18465-7c0d-4987-8b11-0994d0ac04ff'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:40:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-fbef21b7-60d9-4aa8-a197-ed064f36e361 tempest-GroupsTest-390947614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:40:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-fbef21b7-60d9-4aa8-a197-ed064f36e361 tempest-GroupsTest-390947614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:40:54 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-fbef21b7-60d9-4aa8-a197-ed064f36e361 tempest-GroupsTest-390947614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:40:54 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-fbef21b7-60d9-4aa8-a197-ed064f36e361 tempest-GroupsTest-390947614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:40:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-fbef21b7-60d9-4aa8-a197-ed064f36e361 tempest-GroupsTest-390947614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:40:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-fbef21b7-60d9-4aa8-a197-ed064f36e361 tempest-GroupsTest-390947614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:40:54 devstack sudo[96176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:40:54 devstack sudo[96176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:40:56 devstack sudo[96176]: pam_unix(sudo:session): session closed for user root Jun 17 05:40:56 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-fbef21b7-60d9-4aa8-a197-ed064f36e361 tempest-GroupsTest-390947614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 1.466s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:40:56 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-fbef21b7-60d9-4aa8-a197-ed064f36e361 tempest-GroupsTest-390947614 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:40:56 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-fbef21b7-60d9-4aa8-a197-ed064f36e361 tempest-GroupsTest-390947614 None] Delete group completed successfully. Jun 17 05:40:56 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-e32afc34-781f-43a4-934a-1cd5339e5e3c req-1f4d0ad2-459e-4879-9f1d-27f56e85dc71 tempest-ServerActionsTestOtherA-2081174214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:40:56 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-e32afc34-781f-43a4-934a-1cd5339e5e3c req-1f4d0ad2-459e-4879-9f1d-27f56e85dc71 tempest-ServerActionsTestOtherA-2081174214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:40:56 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2361a2-a47c-4008-841b-804016c43f0b]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:40:56 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-e32afc34-781f-43a4-934a-1cd5339e5e3c req-1f4d0ad2-459e-4879-9f1d-27f56e85dc71 tempest-ServerActionsTestOtherA-2081174214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-117e939d-3af9-4f51-b678-c1e8b1727c2e {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:40:57 devstack sudo[96193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-117e939d-3af9-4f51-b678-c1e8b1727c2e Jun 17 05:40:57 devstack sudo[96193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:40:58 devstack sudo[96193]: pam_unix(sudo:session): session closed for user root Jun 17 05:40:58 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-e32afc34-781f-43a4-934a-1cd5339e5e3c req-1f4d0ad2-459e-4879-9f1d-27f56e85dc71 tempest-ServerActionsTestOtherA-2081174214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-117e939d-3af9-4f51-b678-c1e8b1727c2e" returned: 0 in 1.959s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:40:58 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-e32afc34-781f-43a4-934a-1cd5339e5e3c req-1f4d0ad2-459e-4879-9f1d-27f56e85dc71 tempest-ServerActionsTestOtherA-2081174214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.018s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:40:58 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [req-e32afc34-781f-43a4-934a-1cd5339e5e3c req-1f4d0ad2-459e-4879-9f1d-27f56e85dc71 tempest-ServerActionsTestOtherA-2081174214 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f', 'name': 'volume-117e939d-3af9-4f51-b678-c1e8b1727c2e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b2adbe8b-1a1e-43ee-804e-5330ae0387e5', 'enforce_multipath': True} {{(pid=92083) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 17 05:40:59 devstack cinder-volume[92083]: INFO cinder.volume.manager [req-e32afc34-781f-43a4-934a-1cd5339e5e3c req-1f4d0ad2-459e-4879-9f1d-27f56e85dc71 tempest-ServerActionsTestOtherA-2081174214 None] attachment_update completed successfully. Jun 17 05:41:06 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcfa93d9-ad59-4b57-b395-998bdc8fea10 tempest-ServersNegativeTestJSON-825167853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:41:06 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-fcfa93d9-ad59-4b57-b395-998bdc8fea10 tempest-ServersNegativeTestJSON-825167853 None] Flow 'volume_create_manager' (77c566fb-5786-479c-82a5-4fe1338cde30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:41:06 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-fcfa93d9-ad59-4b57-b395-998bdc8fea10 tempest-ServersNegativeTestJSON-825167853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e76363a2-739d-4124-9b3e-b04b03df987a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:41:06 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-fcfa93d9-ad59-4b57-b395-998bdc8fea10 tempest-ServersNegativeTestJSON-825167853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e76363a2-739d-4124-9b3e-b04b03df987a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:41:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1528271662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0020ce9a-ef76-4ee9-8c25-51b509fb4f84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1af54c7ae0844e478c575c7f60ef9d29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:41:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:41:07Z,use_quota=True,user_id='05addb15d52f4a51b5186c7130e40a0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:41:06 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-fcfa93d9-ad59-4b57-b395-998bdc8fea10 tempest-ServersNegativeTestJSON-825167853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3832d6ba-c95e-4c53-83f7-a5e4dcf2fe7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:41:06 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-fcfa93d9-ad59-4b57-b395-998bdc8fea10 tempest-ServersNegativeTestJSON-825167853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3832d6ba-c95e-4c53-83f7-a5e4dcf2fe7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:41:06 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-fcfa93d9-ad59-4b57-b395-998bdc8fea10 tempest-ServersNegativeTestJSON-825167853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d3e12f5-3f91-4e50-82b6-604c2e9b1fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:41:06 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-fcfa93d9-ad59-4b57-b395-998bdc8fea10 tempest-ServersNegativeTestJSON-825167853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d3e12f5-3f91-4e50-82b6-604c2e9b1fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0020ce9a-ef76-4ee9-8c25-51b509fb4f84', 'volume_name': 'volume-0020ce9a-ef76-4ee9-8c25-51b509fb4f84', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:41:06 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-fcfa93d9-ad59-4b57-b395-998bdc8fea10 tempest-ServersNegativeTestJSON-825167853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (567e6bc7-90c3-4d55-9db5-657f4edc33da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:41:06 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-fcfa93d9-ad59-4b57-b395-998bdc8fea10 tempest-ServersNegativeTestJSON-825167853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (567e6bc7-90c3-4d55-9db5-657f4edc33da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:41:06 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-fcfa93d9-ad59-4b57-b395-998bdc8fea10 tempest-ServersNegativeTestJSON-825167853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31540368-bf99-4582-9d26-6b093e806ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:41:06 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-fcfa93d9-ad59-4b57-b395-998bdc8fea10 tempest-ServersNegativeTestJSON-825167853 None] Volume 0020ce9a-ef76-4ee9-8c25-51b509fb4f84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0020ce9a-ef76-4ee9-8c25-51b509fb4f84', 'volume_size': 1} Jun 17 05:41:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-fcfa93d9-ad59-4b57-b395-998bdc8fea10 tempest-ServersNegativeTestJSON-825167853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:41:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-fcfa93d9-ad59-4b57-b395-998bdc8fea10 tempest-ServersNegativeTestJSON-825167853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:41:06 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-fcfa93d9-ad59-4b57-b395-998bdc8fea10 tempest-ServersNegativeTestJSON-825167853 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:41:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1528271662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0020ce9a-ef76-4ee9-8c25-51b509fb4f84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1af54c7ae0844e478c575c7f60ef9d29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:41:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:41:07Z,use_quota=True,user_id='05addb15d52f4a51b5186c7130e40a0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:41:06 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-fcfa93d9-ad59-4b57-b395-998bdc8fea10 tempest-ServersNegativeTestJSON-825167853 None] Creating volume 0020ce9a-ef76-4ee9-8c25-51b509fb4f84 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:41:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-fcfa93d9-ad59-4b57-b395-998bdc8fea10 tempest-ServersNegativeTestJSON-825167853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:41:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-fcfa93d9-ad59-4b57-b395-998bdc8fea10 tempest-ServersNegativeTestJSON-825167853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:41:06 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-fcfa93d9-ad59-4b57-b395-998bdc8fea10 tempest-ServersNegativeTestJSON-825167853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:41:06 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-fcfa93d9-ad59-4b57-b395-998bdc8fea10 tempest-ServersNegativeTestJSON-825167853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:41:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-fcfa93d9-ad59-4b57-b395-998bdc8fea10 tempest-ServersNegativeTestJSON-825167853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:41:06 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-fcfa93d9-ad59-4b57-b395-998bdc8fea10 tempest-ServersNegativeTestJSON-825167853 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:41:06 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-fcfa93d9-ad59-4b57-b395-998bdc8fea10 tempest-ServersNegativeTestJSON-825167853 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:41:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-fcfa93d9-ad59-4b57-b395-998bdc8fea10 tempest-ServersNegativeTestJSON-825167853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0020ce9a-ef76-4ee9-8c25-51b509fb4f84 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:41:07 devstack sudo[96296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0020ce9a-ef76-4ee9-8c25-51b509fb4f84 1073741824 Jun 17 05:41:07 devstack sudo[96296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:41:08 devstack sudo[96296]: pam_unix(sudo:session): session closed for user root Jun 17 05:41:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-fcfa93d9-ad59-4b57-b395-998bdc8fea10 tempest-ServersNegativeTestJSON-825167853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0020ce9a-ef76-4ee9-8c25-51b509fb4f84 1073741824" returned: 0 in 1.090s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:41:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-fcfa93d9-ad59-4b57-b395-998bdc8fea10 tempest-ServersNegativeTestJSON-825167853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0020ce9a-ef76-4ee9-8c25-51b509fb4f84 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:41:08 devstack sudo[96301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0020ce9a-ef76-4ee9-8c25-51b509fb4f84 Jun 17 05:41:08 devstack sudo[96301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:41:09 devstack sudo[96301]: pam_unix(sudo:session): session closed for user root Jun 17 05:41:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-fcfa93d9-ad59-4b57-b395-998bdc8fea10 tempest-ServersNegativeTestJSON-825167853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0020ce9a-ef76-4ee9-8c25-51b509fb4f84" returned: 0 in 0.998s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:41:09 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-fcfa93d9-ad59-4b57-b395-998bdc8fea10 tempest-ServersNegativeTestJSON-825167853 None] <== create_volume: return (2165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:41:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-fcfa93d9-ad59-4b57-b395-998bdc8fea10 tempest-ServersNegativeTestJSON-825167853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.175s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:41:09 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-fcfa93d9-ad59-4b57-b395-998bdc8fea10 tempest-ServersNegativeTestJSON-825167853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31540368-bf99-4582-9d26-6b093e806ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0020ce9a-ef76-4ee9-8c25-51b509fb4f84', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:41:09 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-fcfa93d9-ad59-4b57-b395-998bdc8fea10 tempest-ServersNegativeTestJSON-825167853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b34e9c6e-f9f3-4405-9f46-55f7f73452d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:41:09 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-fcfa93d9-ad59-4b57-b395-998bdc8fea10 tempest-ServersNegativeTestJSON-825167853 None] Volume volume-0020ce9a-ef76-4ee9-8c25-51b509fb4f84 (0020ce9a-ef76-4ee9-8c25-51b509fb4f84): created successfully Jun 17 05:41:09 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-fcfa93d9-ad59-4b57-b395-998bdc8fea10 tempest-ServersNegativeTestJSON-825167853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b34e9c6e-f9f3-4405-9f46-55f7f73452d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:41:09 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-fcfa93d9-ad59-4b57-b395-998bdc8fea10 tempest-ServersNegativeTestJSON-825167853 None] Flow 'volume_create_manager' (77c566fb-5786-479c-82a5-4fe1338cde30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:41:09 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-fcfa93d9-ad59-4b57-b395-998bdc8fea10 tempest-ServersNegativeTestJSON-825167853 None] Created volume successfully. Jun 17 05:41:11 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-331714c7-8dc5-446d-842e-29ce6e672251 tempest-ServersNegativeTestJSON-825167853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:41:11 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-331714c7-8dc5-446d-842e-29ce6e672251 tempest-ServersNegativeTestJSON-825167853 None] Flow 'volume_create_manager' (d100431d-9e08-4da7-808c-26f8e8e39c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:41:11 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-331714c7-8dc5-446d-842e-29ce6e672251 tempest-ServersNegativeTestJSON-825167853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba540811-a6f5-49fc-8580-b43fff357eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:41:11 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-331714c7-8dc5-446d-842e-29ce6e672251 tempest-ServersNegativeTestJSON-825167853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba540811-a6f5-49fc-8580-b43fff357eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:41:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1243927603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=993a130d-8c99-43d8-8b8b-848b14cde437,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1af54c7ae0844e478c575c7f60ef9d29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:41:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:41:11Z,use_quota=True,user_id='05addb15d52f4a51b5186c7130e40a0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:41:11 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-331714c7-8dc5-446d-842e-29ce6e672251 tempest-ServersNegativeTestJSON-825167853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8aa6c3b2-f750-456d-9508-0bb70f0e2ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:41:11 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-331714c7-8dc5-446d-842e-29ce6e672251 tempest-ServersNegativeTestJSON-825167853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8aa6c3b2-f750-456d-9508-0bb70f0e2ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:41:11 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-331714c7-8dc5-446d-842e-29ce6e672251 tempest-ServersNegativeTestJSON-825167853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0afa410-6b34-4987-b39e-041e61d904b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:41:11 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-331714c7-8dc5-446d-842e-29ce6e672251 tempest-ServersNegativeTestJSON-825167853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0afa410-6b34-4987-b39e-041e61d904b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '993a130d-8c99-43d8-8b8b-848b14cde437', 'volume_name': 'volume-993a130d-8c99-43d8-8b8b-848b14cde437', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:41:11 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-331714c7-8dc5-446d-842e-29ce6e672251 tempest-ServersNegativeTestJSON-825167853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1734b0e6-3576-4b2b-bba5-ebf7812dbd53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:41:11 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-331714c7-8dc5-446d-842e-29ce6e672251 tempest-ServersNegativeTestJSON-825167853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1734b0e6-3576-4b2b-bba5-ebf7812dbd53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:41:11 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-331714c7-8dc5-446d-842e-29ce6e672251 tempest-ServersNegativeTestJSON-825167853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccf4443c-e808-4a6a-8149-614b8e01a919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:41:11 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-331714c7-8dc5-446d-842e-29ce6e672251 tempest-ServersNegativeTestJSON-825167853 None] Volume 993a130d-8c99-43d8-8b8b-848b14cde437: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-993a130d-8c99-43d8-8b8b-848b14cde437', 'volume_size': 1} Jun 17 05:41:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-331714c7-8dc5-446d-842e-29ce6e672251 tempest-ServersNegativeTestJSON-825167853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:41:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-331714c7-8dc5-446d-842e-29ce6e672251 tempest-ServersNegativeTestJSON-825167853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:41:11 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-331714c7-8dc5-446d-842e-29ce6e672251 tempest-ServersNegativeTestJSON-825167853 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:41:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1243927603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=993a130d-8c99-43d8-8b8b-848b14cde437,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1af54c7ae0844e478c575c7f60ef9d29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:41:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:41:11Z,use_quota=True,user_id='05addb15d52f4a51b5186c7130e40a0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:41:11 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-331714c7-8dc5-446d-842e-29ce6e672251 tempest-ServersNegativeTestJSON-825167853 None] Creating volume 993a130d-8c99-43d8-8b8b-848b14cde437 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:41:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-331714c7-8dc5-446d-842e-29ce6e672251 tempest-ServersNegativeTestJSON-825167853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:41:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-331714c7-8dc5-446d-842e-29ce6e672251 tempest-ServersNegativeTestJSON-825167853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:41:11 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-331714c7-8dc5-446d-842e-29ce6e672251 tempest-ServersNegativeTestJSON-825167853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:41:11 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-331714c7-8dc5-446d-842e-29ce6e672251 tempest-ServersNegativeTestJSON-825167853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:41:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-331714c7-8dc5-446d-842e-29ce6e672251 tempest-ServersNegativeTestJSON-825167853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:41:11 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-331714c7-8dc5-446d-842e-29ce6e672251 tempest-ServersNegativeTestJSON-825167853 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:41:11 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-331714c7-8dc5-446d-842e-29ce6e672251 tempest-ServersNegativeTestJSON-825167853 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:41:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-331714c7-8dc5-446d-842e-29ce6e672251 tempest-ServersNegativeTestJSON-825167853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-993a130d-8c99-43d8-8b8b-848b14cde437 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:41:11 devstack sudo[96316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-993a130d-8c99-43d8-8b8b-848b14cde437 1073741824 Jun 17 05:41:11 devstack sudo[96316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:41:11 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-f749ad21-4f7b-435f-98e9-96500cae43b5 tempest-VolumeRetypeWithoutMigrationTest-462135676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:41:11 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-f749ad21-4f7b-435f-98e9-96500cae43b5 tempest-VolumeRetypeWithoutMigrationTest-462135676 None] Flow 'volume_create_manager' (fbfd2ffd-3937-4b2d-bcb5-aafecabf721a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:41:11 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-f749ad21-4f7b-435f-98e9-96500cae43b5 tempest-VolumeRetypeWithoutMigrationTest-462135676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f6fcc26-4326-4b13-a10f-2812e6c4f312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:41:11 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-f749ad21-4f7b-435f-98e9-96500cae43b5 tempest-VolumeRetypeWithoutMigrationTest-462135676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f6fcc26-4326-4b13-a10f-2812e6c4f312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:41:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-791735245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a60c2b6-bc11-4039-8df3-60deced80187,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c8aebaf347948329bd3ffbf2d4bd1cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:41:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:41:11Z,use_quota=True,user_id='60ecc28d7723425f8c04aac00de1bf35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(513c792c-0fa6-4ecc-b0de-d0d41779232a),volume_type_id=513c792c-0fa6-4ecc-b0de-d0d41779232a)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:41:11 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-f749ad21-4f7b-435f-98e9-96500cae43b5 tempest-VolumeRetypeWithoutMigrationTest-462135676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ff79187-558c-4ef6-b769-cdee53cd11f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:41:11 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-f749ad21-4f7b-435f-98e9-96500cae43b5 tempest-VolumeRetypeWithoutMigrationTest-462135676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ff79187-558c-4ef6-b769-cdee53cd11f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:41:11 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-f749ad21-4f7b-435f-98e9-96500cae43b5 tempest-VolumeRetypeWithoutMigrationTest-462135676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5ea10d4-5f76-4fa7-9b63-f331f0f0c5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:41:11 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-f749ad21-4f7b-435f-98e9-96500cae43b5 tempest-VolumeRetypeWithoutMigrationTest-462135676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5ea10d4-5f76-4fa7-9b63-f331f0f0c5a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a60c2b6-bc11-4039-8df3-60deced80187', 'volume_name': 'volume-4a60c2b6-bc11-4039-8df3-60deced80187', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:41:11 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-f749ad21-4f7b-435f-98e9-96500cae43b5 tempest-VolumeRetypeWithoutMigrationTest-462135676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c9339d0-1209-4956-9f5a-270ac3f2224e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:41:11 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-f749ad21-4f7b-435f-98e9-96500cae43b5 tempest-VolumeRetypeWithoutMigrationTest-462135676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c9339d0-1209-4956-9f5a-270ac3f2224e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:41:11 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-f749ad21-4f7b-435f-98e9-96500cae43b5 tempest-VolumeRetypeWithoutMigrationTest-462135676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3276867f-aa01-4e48-96b3-7c8a9702f7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:41:11 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-f749ad21-4f7b-435f-98e9-96500cae43b5 tempest-VolumeRetypeWithoutMigrationTest-462135676 None] Volume 4a60c2b6-bc11-4039-8df3-60deced80187: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a60c2b6-bc11-4039-8df3-60deced80187', 'volume_size': 1} Jun 17 05:41:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-f749ad21-4f7b-435f-98e9-96500cae43b5 tempest-VolumeRetypeWithoutMigrationTest-462135676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:41:12 devstack sudo[96316]: pam_unix(sudo:session): session closed for user root Jun 17 05:41:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-331714c7-8dc5-446d-842e-29ce6e672251 tempest-ServersNegativeTestJSON-825167853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-993a130d-8c99-43d8-8b8b-848b14cde437 1073741824" returned: 0 in 0.777s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:41:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-331714c7-8dc5-446d-842e-29ce6e672251 tempest-ServersNegativeTestJSON-825167853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-993a130d-8c99-43d8-8b8b-848b14cde437 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:41:12 devstack sudo[96321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-993a130d-8c99-43d8-8b8b-848b14cde437 Jun 17 05:41:12 devstack sudo[96321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:41:12 devstack sudo[96321]: pam_unix(sudo:session): session closed for user root Jun 17 05:41:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-331714c7-8dc5-446d-842e-29ce6e672251 tempest-ServersNegativeTestJSON-825167853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-993a130d-8c99-43d8-8b8b-848b14cde437" returned: 0 in 0.592s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:41:12 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-331714c7-8dc5-446d-842e-29ce6e672251 tempest-ServersNegativeTestJSON-825167853 None] <== create_volume: return (1427ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:41:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-331714c7-8dc5-446d-842e-29ce6e672251 tempest-ServersNegativeTestJSON-825167853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.430s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:41:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-f749ad21-4f7b-435f-98e9-96500cae43b5 tempest-VolumeRetypeWithoutMigrationTest-462135676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.311s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:41:12 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-f749ad21-4f7b-435f-98e9-96500cae43b5 tempest-VolumeRetypeWithoutMigrationTest-462135676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:41:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-791735245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a60c2b6-bc11-4039-8df3-60deced80187,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c8aebaf347948329bd3ffbf2d4bd1cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:41:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:41:11Z,use_quota=True,user_id='60ecc28d7723425f8c04aac00de1bf35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(513c792c-0fa6-4ecc-b0de-d0d41779232a),volume_type_id=513c792c-0fa6-4ecc-b0de-d0d41779232a)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:41:12 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-f749ad21-4f7b-435f-98e9-96500cae43b5 tempest-VolumeRetypeWithoutMigrationTest-462135676 None] Creating volume 4a60c2b6-bc11-4039-8df3-60deced80187 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:41:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-f749ad21-4f7b-435f-98e9-96500cae43b5 tempest-VolumeRetypeWithoutMigrationTest-462135676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:41:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-f749ad21-4f7b-435f-98e9-96500cae43b5 tempest-VolumeRetypeWithoutMigrationTest-462135676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:41:12 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-f749ad21-4f7b-435f-98e9-96500cae43b5 tempest-VolumeRetypeWithoutMigrationTest-462135676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:41:12 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-f749ad21-4f7b-435f-98e9-96500cae43b5 tempest-VolumeRetypeWithoutMigrationTest-462135676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:41:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-f749ad21-4f7b-435f-98e9-96500cae43b5 tempest-VolumeRetypeWithoutMigrationTest-462135676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:41:12 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-f749ad21-4f7b-435f-98e9-96500cae43b5 tempest-VolumeRetypeWithoutMigrationTest-462135676 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:41:12 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-f749ad21-4f7b-435f-98e9-96500cae43b5 tempest-VolumeRetypeWithoutMigrationTest-462135676 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:41:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f749ad21-4f7b-435f-98e9-96500cae43b5 tempest-VolumeRetypeWithoutMigrationTest-462135676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4a60c2b6-bc11-4039-8df3-60deced80187 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:41:12 devstack sudo[96324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4a60c2b6-bc11-4039-8df3-60deced80187 1073741824 Jun 17 05:41:12 devstack sudo[96324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:41:12 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-331714c7-8dc5-446d-842e-29ce6e672251 tempest-ServersNegativeTestJSON-825167853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccf4443c-e808-4a6a-8149-614b8e01a919) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-993a130d-8c99-43d8-8b8b-848b14cde437', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:41:12 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-331714c7-8dc5-446d-842e-29ce6e672251 tempest-ServersNegativeTestJSON-825167853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6168da79-4ab9-499b-a932-4099894582e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:41:13 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-331714c7-8dc5-446d-842e-29ce6e672251 tempest-ServersNegativeTestJSON-825167853 None] Volume volume-993a130d-8c99-43d8-8b8b-848b14cde437 (993a130d-8c99-43d8-8b8b-848b14cde437): created successfully Jun 17 05:41:13 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-331714c7-8dc5-446d-842e-29ce6e672251 tempest-ServersNegativeTestJSON-825167853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6168da79-4ab9-499b-a932-4099894582e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:41:13 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-331714c7-8dc5-446d-842e-29ce6e672251 tempest-ServersNegativeTestJSON-825167853 None] Flow 'volume_create_manager' (d100431d-9e08-4da7-808c-26f8e8e39c9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:41:13 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-331714c7-8dc5-446d-842e-29ce6e672251 tempest-ServersNegativeTestJSON-825167853 None] Created volume successfully. Jun 17 05:41:13 devstack sudo[96324]: pam_unix(sudo:session): session closed for user root Jun 17 05:41:13 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f749ad21-4f7b-435f-98e9-96500cae43b5 tempest-VolumeRetypeWithoutMigrationTest-462135676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4a60c2b6-bc11-4039-8df3-60deced80187 1073741824" returned: 0 in 0.890s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:41:13 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f749ad21-4f7b-435f-98e9-96500cae43b5 tempest-VolumeRetypeWithoutMigrationTest-462135676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4a60c2b6-bc11-4039-8df3-60deced80187 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:41:13 devstack sudo[96330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4a60c2b6-bc11-4039-8df3-60deced80187 Jun 17 05:41:13 devstack sudo[96330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:41:14 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-01075f49-3306-4de0-8224-6487995d4feb tempest-ServersNegativeTestJSON-825167853 None] Acquiring lock "cinder-993a130d-8c99-43d8-8b8b-848b14cde437-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:41:14 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-01075f49-3306-4de0-8224-6487995d4feb tempest-ServersNegativeTestJSON-825167853 None] Lock "cinder-993a130d-8c99-43d8-8b8b-848b14cde437-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:41:14 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-01075f49-3306-4de0-8224-6487995d4feb tempest-ServersNegativeTestJSON-825167853 None] Acquiring lock "cinder-quobyte-993a130d-8c99-43d8-8b8b-848b14cde437" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:41:14 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-01075f49-3306-4de0-8224-6487995d4feb tempest-ServersNegativeTestJSON-825167853 None] Lock "cinder-quobyte-993a130d-8c99-43d8-8b8b-848b14cde437" acquired by "delete_volume" :: waited 0.027s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:41:14 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc49f3ce-1b9b-46d0-8e41-a401714e3c76]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:41:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-01075f49-3306-4de0-8224-6487995d4feb tempest-ServersNegativeTestJSON-825167853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-993a130d-8c99-43d8-8b8b-848b14cde437 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:41:14 devstack sudo[96337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-993a130d-8c99-43d8-8b8b-848b14cde437 Jun 17 05:41:14 devstack sudo[96337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:41:14 devstack sudo[96330]: pam_unix(sudo:session): session closed for user root Jun 17 05:41:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f749ad21-4f7b-435f-98e9-96500cae43b5 tempest-VolumeRetypeWithoutMigrationTest-462135676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4a60c2b6-bc11-4039-8df3-60deced80187" returned: 0 in 0.695s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:41:14 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-f749ad21-4f7b-435f-98e9-96500cae43b5 tempest-VolumeRetypeWithoutMigrationTest-462135676 None] <== create_volume: return (1638ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:41:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-f749ad21-4f7b-435f-98e9-96500cae43b5 tempest-VolumeRetypeWithoutMigrationTest-462135676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.643s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:41:14 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-f749ad21-4f7b-435f-98e9-96500cae43b5 tempest-VolumeRetypeWithoutMigrationTest-462135676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3276867f-aa01-4e48-96b3-7c8a9702f7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a60c2b6-bc11-4039-8df3-60deced80187', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:41:14 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-f749ad21-4f7b-435f-98e9-96500cae43b5 tempest-VolumeRetypeWithoutMigrationTest-462135676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d883bb79-e664-43f5-bd97-efd27962b602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:41:14 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-f749ad21-4f7b-435f-98e9-96500cae43b5 tempest-VolumeRetypeWithoutMigrationTest-462135676 None] Volume volume-4a60c2b6-bc11-4039-8df3-60deced80187 (4a60c2b6-bc11-4039-8df3-60deced80187): created successfully Jun 17 05:41:14 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-f749ad21-4f7b-435f-98e9-96500cae43b5 tempest-VolumeRetypeWithoutMigrationTest-462135676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d883bb79-e664-43f5-bd97-efd27962b602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:41:14 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-f749ad21-4f7b-435f-98e9-96500cae43b5 tempest-VolumeRetypeWithoutMigrationTest-462135676 None] Flow 'volume_create_manager' (fbfd2ffd-3937-4b2d-bcb5-aafecabf721a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:41:14 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-f749ad21-4f7b-435f-98e9-96500cae43b5 tempest-VolumeRetypeWithoutMigrationTest-462135676 None] Created volume successfully. Jun 17 05:41:14 devstack sudo[96337]: pam_unix(sudo:session): session closed for user root Jun 17 05:41:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-01075f49-3306-4de0-8224-6487995d4feb tempest-ServersNegativeTestJSON-825167853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-993a130d-8c99-43d8-8b8b-848b14cde437" returned: 0 in 0.752s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:41:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-01075f49-3306-4de0-8224-6487995d4feb tempest-ServersNegativeTestJSON-825167853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-993a130d-8c99-43d8-8b8b-848b14cde437 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:41:14 devstack sudo[96346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-993a130d-8c99-43d8-8b8b-848b14cde437 Jun 17 05:41:14 devstack sudo[96346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:41:15 devstack sudo[96346]: pam_unix(sudo:session): session closed for user root Jun 17 05:41:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-01075f49-3306-4de0-8224-6487995d4feb tempest-ServersNegativeTestJSON-825167853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-993a130d-8c99-43d8-8b8b-848b14cde437" returned: 0 in 0.579s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:41:15 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-01075f49-3306-4de0-8224-6487995d4feb tempest-ServersNegativeTestJSON-825167853 None] Lock "cinder-quobyte-993a130d-8c99-43d8-8b8b-848b14cde437" released by "delete_volume" :: held 1.380s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:41:15 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-01075f49-3306-4de0-8224-6487995d4feb tempest-ServersNegativeTestJSON-825167853 None] Created reservations ['e4795db7-7ad0-462b-8706-264cc8ae9470', '4245a25c-d5f4-424b-88f3-0d2c8c8b6c82', 'aa05fa06-84b0-4f57-88d9-02a708706745', 'e4730b67-0b04-4ca9-81d2-44f0ccb63e0f'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:41:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-01075f49-3306-4de0-8224-6487995d4feb tempest-ServersNegativeTestJSON-825167853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:41:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-01075f49-3306-4de0-8224-6487995d4feb tempest-ServersNegativeTestJSON-825167853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:41:15 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-01075f49-3306-4de0-8224-6487995d4feb tempest-ServersNegativeTestJSON-825167853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:41:15 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-01075f49-3306-4de0-8224-6487995d4feb tempest-ServersNegativeTestJSON-825167853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:41:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-01075f49-3306-4de0-8224-6487995d4feb tempest-ServersNegativeTestJSON-825167853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:41:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-01075f49-3306-4de0-8224-6487995d4feb tempest-ServersNegativeTestJSON-825167853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:41:15 devstack sudo[96349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:41:15 devstack sudo[96349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:41:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-71ee3b5b-e9dc-4b15-bfc5-65482f4b652f tempest-VolumeRetypeWithoutMigrationTest-462135676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:41:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-71ee3b5b-e9dc-4b15-bfc5-65482f4b652f tempest-VolumeRetypeWithoutMigrationTest-462135676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:41:16 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-71ee3b5b-e9dc-4b15-bfc5-65482f4b652f tempest-VolumeRetypeWithoutMigrationTest-462135676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:41:16 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-71ee3b5b-e9dc-4b15-bfc5-65482f4b652f tempest-VolumeRetypeWithoutMigrationTest-462135676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:41:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-71ee3b5b-e9dc-4b15-bfc5-65482f4b652f tempest-VolumeRetypeWithoutMigrationTest-462135676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:41:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-71ee3b5b-e9dc-4b15-bfc5-65482f4b652f tempest-VolumeRetypeWithoutMigrationTest-462135676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:41:16 devstack sudo[96352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:41:16 devstack sudo[96352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:41:16 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-d5a94f31-53ed-457f-a928-79b1283779d3 tempest-ServersNegativeTestJSON-825167853 None] Acquiring lock "cinder-0020ce9a-ef76-4ee9-8c25-51b509fb4f84-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:41:16 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-d5a94f31-53ed-457f-a928-79b1283779d3 tempest-ServersNegativeTestJSON-825167853 None] Lock "cinder-0020ce9a-ef76-4ee9-8c25-51b509fb4f84-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:41:16 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-d5a94f31-53ed-457f-a928-79b1283779d3 tempest-ServersNegativeTestJSON-825167853 None] Acquiring lock "cinder-quobyte-0020ce9a-ef76-4ee9-8c25-51b509fb4f84" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:41:16 devstack sudo[96349]: pam_unix(sudo:session): session closed for user root Jun 17 05:41:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-01075f49-3306-4de0-8224-6487995d4feb tempest-ServersNegativeTestJSON-825167853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.782s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:41:16 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-01075f49-3306-4de0-8224-6487995d4feb tempest-ServersNegativeTestJSON-825167853 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:41:16 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-01075f49-3306-4de0-8224-6487995d4feb tempest-ServersNegativeTestJSON-825167853 None] Deleted volume successfully. Jun 17 05:41:16 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-d5a94f31-53ed-457f-a928-79b1283779d3 tempest-ServersNegativeTestJSON-825167853 None] Lock "cinder-quobyte-0020ce9a-ef76-4ee9-8c25-51b509fb4f84" acquired by "delete_volume" :: waited 0.039s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:41:16 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-01075f49-3306-4de0-8224-6487995d4feb tempest-ServersNegativeTestJSON-825167853 None] Lock "cinder-993a130d-8c99-43d8-8b8b-848b14cde437-delete_volume" released by "delete_volume" :: held 2.423s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:41:16 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e94d22-787a-4e02-b272-2b7c17e32c1e]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:41:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-d5a94f31-53ed-457f-a928-79b1283779d3 tempest-ServersNegativeTestJSON-825167853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0020ce9a-ef76-4ee9-8c25-51b509fb4f84 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:41:16 devstack sudo[96354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0020ce9a-ef76-4ee9-8c25-51b509fb4f84 Jun 17 05:41:16 devstack sudo[96354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:41:16 devstack sudo[96352]: pam_unix(sudo:session): session closed for user root Jun 17 05:41:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-71ee3b5b-e9dc-4b15-bfc5-65482f4b652f tempest-VolumeRetypeWithoutMigrationTest-462135676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.695s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:41:16 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-71ee3b5b-e9dc-4b15-bfc5-65482f4b652f tempest-VolumeRetypeWithoutMigrationTest-462135676 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:41:16 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-71ee3b5b-e9dc-4b15-bfc5-65482f4b652f tempest-VolumeRetypeWithoutMigrationTest-462135676 None] Retype volume completed successfully. Jun 17 05:41:17 devstack sudo[96354]: pam_unix(sudo:session): session closed for user root Jun 17 05:41:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-d5a94f31-53ed-457f-a928-79b1283779d3 tempest-ServersNegativeTestJSON-825167853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0020ce9a-ef76-4ee9-8c25-51b509fb4f84" returned: 0 in 0.771s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:41:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-d5a94f31-53ed-457f-a928-79b1283779d3 tempest-ServersNegativeTestJSON-825167853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0020ce9a-ef76-4ee9-8c25-51b509fb4f84 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:41:17 devstack sudo[96360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0020ce9a-ef76-4ee9-8c25-51b509fb4f84 Jun 17 05:41:17 devstack sudo[96360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:41:17 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-ffde4404-c136-4924-9e04-acb363c5c302 tempest-VolumeRetypeWithoutMigrationTest-462135676 None] Acquiring lock "cinder-4a60c2b6-bc11-4039-8df3-60deced80187-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:41:17 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-ffde4404-c136-4924-9e04-acb363c5c302 tempest-VolumeRetypeWithoutMigrationTest-462135676 None] Lock "cinder-4a60c2b6-bc11-4039-8df3-60deced80187-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:41:17 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-ffde4404-c136-4924-9e04-acb363c5c302 tempest-VolumeRetypeWithoutMigrationTest-462135676 None] Acquiring lock "cinder-quobyte-4a60c2b6-bc11-4039-8df3-60deced80187" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:41:17 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-ffde4404-c136-4924-9e04-acb363c5c302 tempest-VolumeRetypeWithoutMigrationTest-462135676 None] Lock "cinder-quobyte-4a60c2b6-bc11-4039-8df3-60deced80187" acquired by "delete_volume" :: waited 0.023s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:41:17 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec1e161-fb5b-402f-8343-dc9f4c4c0026]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:41:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ffde4404-c136-4924-9e04-acb363c5c302 tempest-VolumeRetypeWithoutMigrationTest-462135676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4a60c2b6-bc11-4039-8df3-60deced80187 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:41:17 devstack sudo[96362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4a60c2b6-bc11-4039-8df3-60deced80187 Jun 17 05:41:17 devstack sudo[96362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:41:18 devstack sudo[96360]: pam_unix(sudo:session): session closed for user root Jun 17 05:41:18 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-d5a94f31-53ed-457f-a928-79b1283779d3 tempest-ServersNegativeTestJSON-825167853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0020ce9a-ef76-4ee9-8c25-51b509fb4f84" returned: 0 in 0.819s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:41:18 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-d5a94f31-53ed-457f-a928-79b1283779d3 tempest-ServersNegativeTestJSON-825167853 None] Lock "cinder-quobyte-0020ce9a-ef76-4ee9-8c25-51b509fb4f84" released by "delete_volume" :: held 1.653s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:41:18 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-d5a94f31-53ed-457f-a928-79b1283779d3 tempest-ServersNegativeTestJSON-825167853 None] Created reservations ['2b9a75f3-e7ed-4ffc-a135-4346f388e336', 'a8ce42d8-73f3-4479-865e-2f8583b4529d', '98fbe726-d463-4872-ae21-44a10fddf60a', '89410f95-3c7f-41c1-a235-b0269d945d21'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:41:18 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-d5a94f31-53ed-457f-a928-79b1283779d3 tempest-ServersNegativeTestJSON-825167853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:41:18 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-d5a94f31-53ed-457f-a928-79b1283779d3 tempest-ServersNegativeTestJSON-825167853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:41:18 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-d5a94f31-53ed-457f-a928-79b1283779d3 tempest-ServersNegativeTestJSON-825167853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:41:18 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-d5a94f31-53ed-457f-a928-79b1283779d3 tempest-ServersNegativeTestJSON-825167853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:41:18 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-d5a94f31-53ed-457f-a928-79b1283779d3 tempest-ServersNegativeTestJSON-825167853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:41:18 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-d5a94f31-53ed-457f-a928-79b1283779d3 tempest-ServersNegativeTestJSON-825167853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:41:18 devstack sudo[96365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:41:18 devstack sudo[96365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:41:18 devstack sudo[96362]: pam_unix(sudo:session): session closed for user root Jun 17 05:41:18 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ffde4404-c136-4924-9e04-acb363c5c302 tempest-VolumeRetypeWithoutMigrationTest-462135676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4a60c2b6-bc11-4039-8df3-60deced80187" returned: 0 in 0.907s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:41:18 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ffde4404-c136-4924-9e04-acb363c5c302 tempest-VolumeRetypeWithoutMigrationTest-462135676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4a60c2b6-bc11-4039-8df3-60deced80187 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:41:18 devstack sudo[96371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4a60c2b6-bc11-4039-8df3-60deced80187 Jun 17 05:41:18 devstack sudo[96371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:41:19 devstack sudo[96365]: pam_unix(sudo:session): session closed for user root Jun 17 05:41:19 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-d5a94f31-53ed-457f-a928-79b1283779d3 tempest-ServersNegativeTestJSON-825167853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.855s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:41:19 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-d5a94f31-53ed-457f-a928-79b1283779d3 tempest-ServersNegativeTestJSON-825167853 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:41:19 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-d5a94f31-53ed-457f-a928-79b1283779d3 tempest-ServersNegativeTestJSON-825167853 None] Deleted volume successfully. Jun 17 05:41:19 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-d5a94f31-53ed-457f-a928-79b1283779d3 tempest-ServersNegativeTestJSON-825167853 None] Lock "cinder-0020ce9a-ef76-4ee9-8c25-51b509fb4f84-delete_volume" released by "delete_volume" :: held 2.821s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:41:19 devstack sudo[96371]: pam_unix(sudo:session): session closed for user root Jun 17 05:41:19 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ffde4404-c136-4924-9e04-acb363c5c302 tempest-VolumeRetypeWithoutMigrationTest-462135676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4a60c2b6-bc11-4039-8df3-60deced80187" returned: 0 in 0.761s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:41:19 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-ffde4404-c136-4924-9e04-acb363c5c302 tempest-VolumeRetypeWithoutMigrationTest-462135676 None] Lock "cinder-quobyte-4a60c2b6-bc11-4039-8df3-60deced80187" released by "delete_volume" :: held 1.713s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:41:19 devstack cinder-volume[92083]: WARNING cinder.quota [None req-ffde4404-c136-4924-9e04-acb363c5c302 tempest-VolumeRetypeWithoutMigrationTest-462135676 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 17 05:41:19 devstack cinder-volume[92083]: WARNING cinder.quota [None req-ffde4404-c136-4924-9e04-acb363c5c302 tempest-VolumeRetypeWithoutMigrationTest-462135676 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 17 05:41:19 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-ffde4404-c136-4924-9e04-acb363c5c302 tempest-VolumeRetypeWithoutMigrationTest-462135676 None] Created reservations ['c7d262eb-dca4-4786-84be-aee141141345', '2ca6c837-03a6-4210-89ad-47deaa6901fb', '8f27ced7-58e3-4f7f-82cb-56b45ebab49a', '4e07904a-b00e-4117-afc1-535ba357efaa'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:41:19 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ffde4404-c136-4924-9e04-acb363c5c302 tempest-VolumeRetypeWithoutMigrationTest-462135676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:41:19 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ffde4404-c136-4924-9e04-acb363c5c302 tempest-VolumeRetypeWithoutMigrationTest-462135676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:41:19 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ffde4404-c136-4924-9e04-acb363c5c302 tempest-VolumeRetypeWithoutMigrationTest-462135676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:41:19 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ffde4404-c136-4924-9e04-acb363c5c302 tempest-VolumeRetypeWithoutMigrationTest-462135676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:41:19 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ffde4404-c136-4924-9e04-acb363c5c302 tempest-VolumeRetypeWithoutMigrationTest-462135676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:41:19 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ffde4404-c136-4924-9e04-acb363c5c302 tempest-VolumeRetypeWithoutMigrationTest-462135676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:41:19 devstack sudo[96375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:41:19 devstack sudo[96375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:41:20 devstack sudo[96375]: pam_unix(sudo:session): session closed for user root Jun 17 05:41:20 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ffde4404-c136-4924-9e04-acb363c5c302 tempest-VolumeRetypeWithoutMigrationTest-462135676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.818s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:41:20 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-ffde4404-c136-4924-9e04-acb363c5c302 tempest-VolumeRetypeWithoutMigrationTest-462135676 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:41:20 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-ffde4404-c136-4924-9e04-acb363c5c302 tempest-VolumeRetypeWithoutMigrationTest-462135676 None] Deleted volume successfully. Jun 17 05:41:20 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-ffde4404-c136-4924-9e04-acb363c5c302 tempest-VolumeRetypeWithoutMigrationTest-462135676 None] Lock "cinder-4a60c2b6-bc11-4039-8df3-60deced80187-delete_volume" released by "delete_volume" :: held 2.831s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:41:25 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-a609b619-46d0-4af1-b30b-3ffb09686d24 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:41:25 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a609b619-46d0-4af1-b30b-3ffb09686d24 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Flow 'volume_create_manager' (06b2cb0a-9ef6-4bc5-9387-1d0011a342d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:41:25 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a609b619-46d0-4af1-b30b-3ffb09686d24 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dde8347c-e5b0-4134-826f-3eee0615ff6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:41:25 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a609b619-46d0-4af1-b30b-3ffb09686d24 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dde8347c-e5b0-4134-826f-3eee0615ff6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:41:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2058133529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eeec333-34df-4e59-8ba8-b6ebb967ef86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='942825f792c544f3af43760af7651d98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:41:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:41:25Z,use_quota=True,user_id='107092501c8b45e69127a1a43110aedd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:41:25 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a609b619-46d0-4af1-b30b-3ffb09686d24 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5234bb7-b5df-4145-a7ab-9e680a7209c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:41:25 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a609b619-46d0-4af1-b30b-3ffb09686d24 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5234bb7-b5df-4145-a7ab-9e680a7209c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:41:25 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a609b619-46d0-4af1-b30b-3ffb09686d24 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96368e0a-4c2e-4f5d-b3e8-f06e93eccea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:41:25 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a609b619-46d0-4af1-b30b-3ffb09686d24 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96368e0a-4c2e-4f5d-b3e8-f06e93eccea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2eeec333-34df-4e59-8ba8-b6ebb967ef86', 'volume_name': 'volume-2eeec333-34df-4e59-8ba8-b6ebb967ef86', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:41:25 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a609b619-46d0-4af1-b30b-3ffb09686d24 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed2fdf1c-3ab9-477a-b452-ec834cb9f022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:41:25 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a609b619-46d0-4af1-b30b-3ffb09686d24 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed2fdf1c-3ab9-477a-b452-ec834cb9f022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:41:25 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a609b619-46d0-4af1-b30b-3ffb09686d24 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a7ac00c-387c-4faa-9e6b-41c793200f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:41:25 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-a609b619-46d0-4af1-b30b-3ffb09686d24 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Volume 2eeec333-34df-4e59-8ba8-b6ebb967ef86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2eeec333-34df-4e59-8ba8-b6ebb967ef86', 'volume_size': 1} Jun 17 05:41:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-a609b619-46d0-4af1-b30b-3ffb09686d24 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:41:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-a609b619-46d0-4af1-b30b-3ffb09686d24 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:41:25 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-a609b619-46d0-4af1-b30b-3ffb09686d24 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:41:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2058133529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eeec333-34df-4e59-8ba8-b6ebb967ef86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='942825f792c544f3af43760af7651d98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:41:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:41:25Z,use_quota=True,user_id='107092501c8b45e69127a1a43110aedd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:41:25 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-a609b619-46d0-4af1-b30b-3ffb09686d24 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Creating volume 2eeec333-34df-4e59-8ba8-b6ebb967ef86 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:41:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-a609b619-46d0-4af1-b30b-3ffb09686d24 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:41:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-a609b619-46d0-4af1-b30b-3ffb09686d24 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:41:25 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-a609b619-46d0-4af1-b30b-3ffb09686d24 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:41:25 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-a609b619-46d0-4af1-b30b-3ffb09686d24 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:41:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-a609b619-46d0-4af1-b30b-3ffb09686d24 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:41:25 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-a609b619-46d0-4af1-b30b-3ffb09686d24 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:41:25 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-a609b619-46d0-4af1-b30b-3ffb09686d24 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:41:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a609b619-46d0-4af1-b30b-3ffb09686d24 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2eeec333-34df-4e59-8ba8-b6ebb967ef86 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:41:25 devstack sudo[96464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2eeec333-34df-4e59-8ba8-b6ebb967ef86 1073741824 Jun 17 05:41:25 devstack sudo[96464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:41:26 devstack sudo[96464]: pam_unix(sudo:session): session closed for user root Jun 17 05:41:26 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a609b619-46d0-4af1-b30b-3ffb09686d24 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2eeec333-34df-4e59-8ba8-b6ebb967ef86 1073741824" returned: 0 in 0.823s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:41:26 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a609b619-46d0-4af1-b30b-3ffb09686d24 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2eeec333-34df-4e59-8ba8-b6ebb967ef86 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:41:26 devstack sudo[96470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2eeec333-34df-4e59-8ba8-b6ebb967ef86 Jun 17 05:41:26 devstack sudo[96470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:41:27 devstack sudo[96470]: pam_unix(sudo:session): session closed for user root Jun 17 05:41:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a609b619-46d0-4af1-b30b-3ffb09686d24 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2eeec333-34df-4e59-8ba8-b6ebb967ef86" returned: 0 in 0.654s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:41:27 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-a609b619-46d0-4af1-b30b-3ffb09686d24 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] <== create_volume: return (1553ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:41:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-a609b619-46d0-4af1-b30b-3ffb09686d24 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.555s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:41:27 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a609b619-46d0-4af1-b30b-3ffb09686d24 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a7ac00c-387c-4faa-9e6b-41c793200f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2eeec333-34df-4e59-8ba8-b6ebb967ef86', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:41:27 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a609b619-46d0-4af1-b30b-3ffb09686d24 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dff8c214-4e62-4b27-94ea-f0cc858abd8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:41:27 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-a609b619-46d0-4af1-b30b-3ffb09686d24 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Volume volume-2eeec333-34df-4e59-8ba8-b6ebb967ef86 (2eeec333-34df-4e59-8ba8-b6ebb967ef86): created successfully Jun 17 05:41:27 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a609b619-46d0-4af1-b30b-3ffb09686d24 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dff8c214-4e62-4b27-94ea-f0cc858abd8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:41:27 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a609b619-46d0-4af1-b30b-3ffb09686d24 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Flow 'volume_create_manager' (06b2cb0a-9ef6-4bc5-9387-1d0011a342d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:41:27 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-a609b619-46d0-4af1-b30b-3ffb09686d24 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Created volume successfully. Jun 17 05:41:27 devstack cinder-volume[92083]: DEBUG oslo_service.periodic_task [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92083) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 05:41:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:41:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:41:27 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:41:27 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:41:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:41:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:41:27 devstack sudo[96474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:41:27 devstack sudo[96474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:41:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-2315ac76-a9ac-4f59-ba29-ea1a2b6dbac7 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:41:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-2315ac76-a9ac-4f59-ba29-ea1a2b6dbac7 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:41:27 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-2315ac76-a9ac-4f59-ba29-ea1a2b6dbac7 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Creating offline snapshot 636918b3-56c5-4733-9bcc-7aa9fb2f2b3f of volume 2eeec333-34df-4e59-8ba8-b6ebb967ef86 {{(pid=92083) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 17 05:41:27 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a3f4c42-138e-4e6b-95da-144c39856019]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:41:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-2315ac76-a9ac-4f59-ba29-ea1a2b6dbac7 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2eeec333-34df-4e59-8ba8-b6ebb967ef86 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:41:27 devstack sudo[96476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2eeec333-34df-4e59-8ba8-b6ebb967ef86 Jun 17 05:41:27 devstack sudo[96476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:41:28 devstack sudo[96474]: pam_unix(sudo:session): session closed for user root Jun 17 05:41:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.815s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:41:28 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:41:28 devstack cinder-volume[92083]: DEBUG oslo_service.periodic_task [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running periodic task VolumeManager._thread_info {{(pid=92083) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 05:41:28 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] thread count: 8 {{(pid=92083) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 17 05:41:28 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] thread info: [<_MainThread(MainThread, started 133483869905024)>, , , , , , , ] {{(pid=92083) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 17 05:41:28 devstack sudo[96476]: pam_unix(sudo:session): session closed for user root Jun 17 05:41:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-2315ac76-a9ac-4f59-ba29-ea1a2b6dbac7 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2eeec333-34df-4e59-8ba8-b6ebb967ef86" returned: 0 in 0.949s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:41:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-2315ac76-a9ac-4f59-ba29-ea1a2b6dbac7 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2eeec333-34df-4e59-8ba8-b6ebb967ef86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2eeec333-34df-4e59-8ba8-b6ebb967ef86.636918b3-56c5-4733-9bcc-7aa9fb2f2b3f 1G {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:41:28 devstack sudo[96484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2eeec333-34df-4e59-8ba8-b6ebb967ef86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2eeec333-34df-4e59-8ba8-b6ebb967ef86.636918b3-56c5-4733-9bcc-7aa9fb2f2b3f 1G Jun 17 05:41:28 devstack sudo[96484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:41:29 devstack sudo[96484]: pam_unix(sudo:session): session closed for user root Jun 17 05:41:29 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-2315ac76-a9ac-4f59-ba29-ea1a2b6dbac7 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2eeec333-34df-4e59-8ba8-b6ebb967ef86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2eeec333-34df-4e59-8ba8-b6ebb967ef86.636918b3-56c5-4733-9bcc-7aa9fb2f2b3f 1G" returned: 0 in 0.825s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:41:29 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-2315ac76-a9ac-4f59-ba29-ea1a2b6dbac7 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2eeec333-34df-4e59-8ba8-b6ebb967ef86 -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2eeec333-34df-4e59-8ba8-b6ebb967ef86.636918b3-56c5-4733-9bcc-7aa9fb2f2b3f {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:41:29 devstack sudo[96490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2eeec333-34df-4e59-8ba8-b6ebb967ef86 -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2eeec333-34df-4e59-8ba8-b6ebb967ef86.636918b3-56c5-4733-9bcc-7aa9fb2f2b3f Jun 17 05:41:29 devstack sudo[96490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:41:30 devstack sudo[96490]: pam_unix(sudo:session): session closed for user root Jun 17 05:41:30 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-2315ac76-a9ac-4f59-ba29-ea1a2b6dbac7 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2eeec333-34df-4e59-8ba8-b6ebb967ef86 -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2eeec333-34df-4e59-8ba8-b6ebb967ef86.636918b3-56c5-4733-9bcc-7aa9fb2f2b3f" returned: 0 in 0.676s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:41:30 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [None req-2315ac76-a9ac-4f59-ba29-ea1a2b6dbac7 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2eeec333-34df-4e59-8ba8-b6ebb967ef86.636918b3-56c5-4733-9bcc-7aa9fb2f2b3f is being set with open permissions: ugo+rw Jun 17 05:41:30 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-2315ac76-a9ac-4f59-ba29-ea1a2b6dbac7 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2eeec333-34df-4e59-8ba8-b6ebb967ef86.636918b3-56c5-4733-9bcc-7aa9fb2f2b3f {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:41:30 devstack sudo[96495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2eeec333-34df-4e59-8ba8-b6ebb967ef86.636918b3-56c5-4733-9bcc-7aa9fb2f2b3f Jun 17 05:41:30 devstack sudo[96495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:41:30 devstack sudo[96495]: pam_unix(sudo:session): session closed for user root Jun 17 05:41:30 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-2315ac76-a9ac-4f59-ba29-ea1a2b6dbac7 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2eeec333-34df-4e59-8ba8-b6ebb967ef86.636918b3-56c5-4733-9bcc-7aa9fb2f2b3f" returned: 0 in 0.634s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:41:30 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-2315ac76-a9ac-4f59-ba29-ea1a2b6dbac7 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2eeec333-34df-4e59-8ba8-b6ebb967ef86.info {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:41:31 devstack sudo[96500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2eeec333-34df-4e59-8ba8-b6ebb967ef86.info Jun 17 05:41:31 devstack sudo[96500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:41:31 devstack sudo[96500]: pam_unix(sudo:session): session closed for user root Jun 17 05:41:31 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-2315ac76-a9ac-4f59-ba29-ea1a2b6dbac7 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2eeec333-34df-4e59-8ba8-b6ebb967ef86.info" returned: 0 in 0.606s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:41:31 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [None req-2315ac76-a9ac-4f59-ba29-ea1a2b6dbac7 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2eeec333-34df-4e59-8ba8-b6ebb967ef86.info is being set with open permissions: ugo+rw Jun 17 05:41:31 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-2315ac76-a9ac-4f59-ba29-ea1a2b6dbac7 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2eeec333-34df-4e59-8ba8-b6ebb967ef86.info {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:41:31 devstack sudo[96503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2eeec333-34df-4e59-8ba8-b6ebb967ef86.info Jun 17 05:41:31 devstack sudo[96503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:41:32 devstack sudo[96503]: pam_unix(sudo:session): session closed for user root Jun 17 05:41:32 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-2315ac76-a9ac-4f59-ba29-ea1a2b6dbac7 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2eeec333-34df-4e59-8ba8-b6ebb967ef86.info" returned: 0 in 0.707s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:41:32 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-2315ac76-a9ac-4f59-ba29-ea1a2b6dbac7 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.503s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:41:32 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-2315ac76-a9ac-4f59-ba29-ea1a2b6dbac7 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Create snapshot completed successfully Jun 17 05:41:33 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-40009e14-4448-4241-a298-47c965d1f856 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Acquiring lock "cinder-636918b3-56c5-4733-9bcc-7aa9fb2f2b3f-delete_snapshot" by "delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:41:33 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-40009e14-4448-4241-a298-47c965d1f856 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Lock "cinder-636918b3-56c5-4733-9bcc-7aa9fb2f2b3f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:41:33 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-40009e14-4448-4241-a298-47c965d1f856 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Acquiring lock "cinder-quobyte-2eeec333-34df-4e59-8ba8-b6ebb967ef86" by "delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:41:33 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-40009e14-4448-4241-a298-47c965d1f856 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Lock "cinder-quobyte-2eeec333-34df-4e59-8ba8-b6ebb967ef86" acquired by "delete_snapshot" :: waited 0.026s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:41:33 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-40009e14-4448-4241-a298-47c965d1f856 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Acquiring lock "cinder-quobyte-636918b3-56c5-4733-9bcc-7aa9fb2f2b3f" by "_delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:41:33 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-40009e14-4448-4241-a298-47c965d1f856 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Lock "cinder-quobyte-636918b3-56c5-4733-9bcc-7aa9fb2f2b3f" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:41:33 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-40009e14-4448-4241-a298-47c965d1f856 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Deleting offline snapshot 636918b3-56c5-4733-9bcc-7aa9fb2f2b3f of volume 2eeec333-34df-4e59-8ba8-b6ebb967ef86 {{(pid=92083) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 17 05:41:33 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-40009e14-4448-4241-a298-47c965d1f856 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] snapshot_file for this snap is: volume-2eeec333-34df-4e59-8ba8-b6ebb967ef86.636918b3-56c5-4733-9bcc-7aa9fb2f2b3f {{(pid=92083) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 17 05:41:33 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a1742f-2ba2-4ed9-827d-3da73b892e1f]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:41:33 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-40009e14-4448-4241-a298-47c965d1f856 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2eeec333-34df-4e59-8ba8-b6ebb967ef86.636918b3-56c5-4733-9bcc-7aa9fb2f2b3f {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:41:33 devstack sudo[96510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2eeec333-34df-4e59-8ba8-b6ebb967ef86.636918b3-56c5-4733-9bcc-7aa9fb2f2b3f Jun 17 05:41:33 devstack sudo[96510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:41:34 devstack cinder-volume[92083]: INFO cinder.volume.manager [req-6c9c07d7-f9dc-44f6-9587-b3cd665530ac req-27bb3b0f-85cb-4b90-b2b2-e49bcb35801e tempest-ServerActionsTestOtherA-2081174214 None] Terminate volume connection completed successfully. Jun 17 05:41:34 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [req-6c9c07d7-f9dc-44f6-9587-b3cd665530ac req-27bb3b0f-85cb-4b90-b2b2-e49bcb35801e tempest-ServerActionsTestOtherA-2081174214 None] Deleting attachment b2adbe8b-1a1e-43ee-804e-5330ae0387e5. {{(pid=92083) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 17 05:41:34 devstack sudo[96510]: pam_unix(sudo:session): session closed for user root Jun 17 05:41:34 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-40009e14-4448-4241-a298-47c965d1f856 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2eeec333-34df-4e59-8ba8-b6ebb967ef86.636918b3-56c5-4733-9bcc-7aa9fb2f2b3f" returned: 0 in 0.823s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:41:34 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-40009e14-4448-4241-a298-47c965d1f856 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2eeec333-34df-4e59-8ba8-b6ebb967ef86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92083) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 05:41:34 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c6d2ac-b103-4eb4-8a30-98c48b398bc4]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:41:34 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-40009e14-4448-4241-a298-47c965d1f856 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2eeec333-34df-4e59-8ba8-b6ebb967ef86 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:41:34 devstack sudo[96518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2eeec333-34df-4e59-8ba8-b6ebb967ef86 Jun 17 05:41:34 devstack sudo[96518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:41:35 devstack cinder-volume[92083]: INFO cinder.volume.manager [req-66831e1a-75ac-4927-b62a-b1d71deb51bb req-9fe90886-4397-42b8-813c-b47eec5ad7b7 tempest-AttachVolumeTestJSON-1295992640 None] Terminate volume connection completed successfully. Jun 17 05:41:35 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [req-66831e1a-75ac-4927-b62a-b1d71deb51bb req-9fe90886-4397-42b8-813c-b47eec5ad7b7 tempest-AttachVolumeTestJSON-1295992640 None] Deleting attachment aa98709a-cf97-4e24-8735-856b63b31af0. {{(pid=92083) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 17 05:41:35 devstack sudo[96518]: pam_unix(sudo:session): session closed for user root Jun 17 05:41:35 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-40009e14-4448-4241-a298-47c965d1f856 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2eeec333-34df-4e59-8ba8-b6ebb967ef86" returned: 0 in 0.827s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:41:35 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-40009e14-4448-4241-a298-47c965d1f856 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2eeec333-34df-4e59-8ba8-b6ebb967ef86.636918b3-56c5-4733-9bcc-7aa9fb2f2b3f {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:41:35 devstack sudo[96527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2eeec333-34df-4e59-8ba8-b6ebb967ef86.636918b3-56c5-4733-9bcc-7aa9fb2f2b3f Jun 17 05:41:35 devstack sudo[96527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:41:36 devstack sudo[96527]: pam_unix(sudo:session): session closed for user root Jun 17 05:41:36 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-40009e14-4448-4241-a298-47c965d1f856 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2eeec333-34df-4e59-8ba8-b6ebb967ef86.636918b3-56c5-4733-9bcc-7aa9fb2f2b3f" returned: 0 in 1.036s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:41:36 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-40009e14-4448-4241-a298-47c965d1f856 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2eeec333-34df-4e59-8ba8-b6ebb967ef86.636918b3-56c5-4733-9bcc-7aa9fb2f2b3f {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:41:36 devstack sudo[96533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2eeec333-34df-4e59-8ba8-b6ebb967ef86.636918b3-56c5-4733-9bcc-7aa9fb2f2b3f Jun 17 05:41:36 devstack sudo[96533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:41:37 devstack sudo[96533]: pam_unix(sudo:session): session closed for user root Jun 17 05:41:37 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-40009e14-4448-4241-a298-47c965d1f856 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2eeec333-34df-4e59-8ba8-b6ebb967ef86.636918b3-56c5-4733-9bcc-7aa9fb2f2b3f" returned: 0 in 0.676s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:41:37 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-40009e14-4448-4241-a298-47c965d1f856 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Lock "cinder-quobyte-636918b3-56c5-4733-9bcc-7aa9fb2f2b3f" released by "_delete_snapshot" :: held 3.545s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:41:37 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-40009e14-4448-4241-a298-47c965d1f856 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Lock "cinder-quobyte-2eeec333-34df-4e59-8ba8-b6ebb967ef86" released by "delete_snapshot" :: held 3.594s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:41:37 devstack cinder-volume[92083]: WARNING cinder.quota [None req-40009e14-4448-4241-a298-47c965d1f856 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 17 05:41:37 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-40009e14-4448-4241-a298-47c965d1f856 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Created reservations ['1fcf15a8-3205-4ce4-9d5d-1242602112bc', 'd699228d-08eb-42b7-85f3-8819deff52b2', '381831b6-3ac5-402e-8877-ee5c0d1133ad', 'fee44691-a7fa-4eb2-8722-2e7a6df74712'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:41:37 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-40009e14-4448-4241-a298-47c965d1f856 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Delete snapshot completed successfully. Jun 17 05:41:37 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-40009e14-4448-4241-a298-47c965d1f856 tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Lock "cinder-636918b3-56c5-4733-9bcc-7aa9fb2f2b3f-delete_snapshot" released by "delete_snapshot" :: held 3.896s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:41:37 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-b9a2e496-4638-40db-af02-dc5e9a47aa2d tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Acquiring lock "cinder-2eeec333-34df-4e59-8ba8-b6ebb967ef86-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:41:37 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-b9a2e496-4638-40db-af02-dc5e9a47aa2d tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Lock "cinder-2eeec333-34df-4e59-8ba8-b6ebb967ef86-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:41:38 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-b9a2e496-4638-40db-af02-dc5e9a47aa2d tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Acquiring lock "cinder-quobyte-2eeec333-34df-4e59-8ba8-b6ebb967ef86" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:41:38 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-b9a2e496-4638-40db-af02-dc5e9a47aa2d tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Lock "cinder-quobyte-2eeec333-34df-4e59-8ba8-b6ebb967ef86" acquired by "delete_volume" :: waited 0.045s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:41:38 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[7342abb5-36f9-4515-bf81-1b2a82cf723c]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:41:38 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b9a2e496-4638-40db-af02-dc5e9a47aa2d tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2eeec333-34df-4e59-8ba8-b6ebb967ef86 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:41:38 devstack sudo[96608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2eeec333-34df-4e59-8ba8-b6ebb967ef86 Jun 17 05:41:38 devstack sudo[96608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:41:39 devstack sudo[96608]: pam_unix(sudo:session): session closed for user root Jun 17 05:41:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b9a2e496-4638-40db-af02-dc5e9a47aa2d tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2eeec333-34df-4e59-8ba8-b6ebb967ef86" returned: 0 in 0.868s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:41:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b9a2e496-4638-40db-af02-dc5e9a47aa2d tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2eeec333-34df-4e59-8ba8-b6ebb967ef86 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:41:39 devstack sudo[96617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2eeec333-34df-4e59-8ba8-b6ebb967ef86 Jun 17 05:41:39 devstack sudo[96617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:41:39 devstack sudo[96617]: pam_unix(sudo:session): session closed for user root Jun 17 05:41:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b9a2e496-4638-40db-af02-dc5e9a47aa2d tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2eeec333-34df-4e59-8ba8-b6ebb967ef86" returned: 0 in 0.712s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:41:39 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-b9a2e496-4638-40db-af02-dc5e9a47aa2d tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Lock "cinder-quobyte-2eeec333-34df-4e59-8ba8-b6ebb967ef86" released by "delete_volume" :: held 1.701s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:41:39 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-b9a2e496-4638-40db-af02-dc5e9a47aa2d tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Created reservations ['9895f8c4-d289-497b-9abd-26f2c0af4093', 'caed8f3f-e47d-45ec-860c-8df8590801eb', '83c25754-3474-43d8-92cb-b6d638cd7405', 'ab128218-8fd2-4009-b61c-b164a585f826'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:41:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-b9a2e496-4638-40db-af02-dc5e9a47aa2d tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:41:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-b9a2e496-4638-40db-af02-dc5e9a47aa2d tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:41:39 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-b9a2e496-4638-40db-af02-dc5e9a47aa2d tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:41:39 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-b9a2e496-4638-40db-af02-dc5e9a47aa2d tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:41:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-b9a2e496-4638-40db-af02-dc5e9a47aa2d tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:41:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b9a2e496-4638-40db-af02-dc5e9a47aa2d tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:41:39 devstack sudo[96622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:41:39 devstack sudo[96622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:41:40 devstack sudo[96622]: pam_unix(sudo:session): session closed for user root Jun 17 05:41:40 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b9a2e496-4638-40db-af02-dc5e9a47aa2d tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.858s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:41:40 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-b9a2e496-4638-40db-af02-dc5e9a47aa2d tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:41:40 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-b9a2e496-4638-40db-af02-dc5e9a47aa2d tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Deleted volume successfully. Jun 17 05:41:40 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-b9a2e496-4638-40db-af02-dc5e9a47aa2d tempest-VolumeSnapshotQuotasNegativeTestJSON-647931083 None] Lock "cinder-2eeec333-34df-4e59-8ba8-b6ebb967ef86-delete_volume" released by "delete_volume" :: held 2.910s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:41:47 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-42859d43-819f-44e9-b40a-8efaea1e33a7 tempest-ServerActionsTestOtherA-2081174214 None] Acquiring lock "cinder-117e939d-3af9-4f51-b678-c1e8b1727c2e-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:41:47 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-42859d43-819f-44e9-b40a-8efaea1e33a7 tempest-ServerActionsTestOtherA-2081174214 None] Lock "cinder-117e939d-3af9-4f51-b678-c1e8b1727c2e-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:41:47 devstack cinder-volume[92083]: DEBUG dbcounter [-] [92083] Writing DB stats cinder:UPDATE=87,cinder:SELECT=76,cinder:INSERT=19,cinder:DELETE=7 {{(pid=92083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:41:47 devstack cinder-volume[92083]: DEBUG dbcounter [-] [92083] Writing DB stats cinder:UPDATE=75,cinder:DELETE=3,cinder:SELECT=72,cinder:INSERT=16 {{(pid=92083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:41:47 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-42859d43-819f-44e9-b40a-8efaea1e33a7 tempest-ServerActionsTestOtherA-2081174214 None] Acquiring lock "cinder-quobyte-117e939d-3af9-4f51-b678-c1e8b1727c2e" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:41:47 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-42859d43-819f-44e9-b40a-8efaea1e33a7 tempest-ServerActionsTestOtherA-2081174214 None] Lock "cinder-quobyte-117e939d-3af9-4f51-b678-c1e8b1727c2e" acquired by "delete_volume" :: waited 0.039s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:41:48 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[0544bae6-ad03-417f-9503-dabb03b4544c]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:41:48 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-42859d43-819f-44e9-b40a-8efaea1e33a7 tempest-ServerActionsTestOtherA-2081174214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-117e939d-3af9-4f51-b678-c1e8b1727c2e {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:41:48 devstack sudo[96645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-117e939d-3af9-4f51-b678-c1e8b1727c2e Jun 17 05:41:48 devstack sudo[96645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:41:48 devstack sudo[96645]: pam_unix(sudo:session): session closed for user root Jun 17 05:41:48 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-42859d43-819f-44e9-b40a-8efaea1e33a7 tempest-ServerActionsTestOtherA-2081174214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-117e939d-3af9-4f51-b678-c1e8b1727c2e" returned: 0 in 0.796s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:41:48 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-42859d43-819f-44e9-b40a-8efaea1e33a7 tempest-ServerActionsTestOtherA-2081174214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-117e939d-3af9-4f51-b678-c1e8b1727c2e {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:41:48 devstack sudo[96652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-117e939d-3af9-4f51-b678-c1e8b1727c2e Jun 17 05:41:48 devstack sudo[96652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:41:49 devstack sudo[96652]: pam_unix(sudo:session): session closed for user root Jun 17 05:41:49 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-42859d43-819f-44e9-b40a-8efaea1e33a7 tempest-ServerActionsTestOtherA-2081174214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-117e939d-3af9-4f51-b678-c1e8b1727c2e" returned: 0 in 0.711s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:41:49 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-42859d43-819f-44e9-b40a-8efaea1e33a7 tempest-ServerActionsTestOtherA-2081174214 None] Lock "cinder-quobyte-117e939d-3af9-4f51-b678-c1e8b1727c2e" released by "delete_volume" :: held 1.571s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:41:49 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-42859d43-819f-44e9-b40a-8efaea1e33a7 tempest-ServerActionsTestOtherA-2081174214 None] Created reservations ['6d557544-5bd6-4866-ac9d-9b2f15e91fe1', '54259a18-9895-432e-9fc8-e56dcd40cbd8', '5affc2c2-204f-4d18-ac39-bb0c36ebba80', '81803309-5ba7-4b7f-830a-b3c2272f26f7'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:41:49 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-42859d43-819f-44e9-b40a-8efaea1e33a7 tempest-ServerActionsTestOtherA-2081174214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:41:49 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-42859d43-819f-44e9-b40a-8efaea1e33a7 tempest-ServerActionsTestOtherA-2081174214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:41:49 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-42859d43-819f-44e9-b40a-8efaea1e33a7 tempest-ServerActionsTestOtherA-2081174214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:41:49 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-42859d43-819f-44e9-b40a-8efaea1e33a7 tempest-ServerActionsTestOtherA-2081174214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:41:49 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-42859d43-819f-44e9-b40a-8efaea1e33a7 tempest-ServerActionsTestOtherA-2081174214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:41:49 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-42859d43-819f-44e9-b40a-8efaea1e33a7 tempest-ServerActionsTestOtherA-2081174214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:41:49 devstack sudo[96664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:41:49 devstack sudo[96664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:41:50 devstack sudo[96664]: pam_unix(sudo:session): session closed for user root Jun 17 05:41:50 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-42859d43-819f-44e9-b40a-8efaea1e33a7 tempest-ServerActionsTestOtherA-2081174214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.631s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:41:50 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-42859d43-819f-44e9-b40a-8efaea1e33a7 tempest-ServerActionsTestOtherA-2081174214 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:41:50 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-42859d43-819f-44e9-b40a-8efaea1e33a7 tempest-ServerActionsTestOtherA-2081174214 None] Deleted volume successfully. Jun 17 05:41:50 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-42859d43-819f-44e9-b40a-8efaea1e33a7 tempest-ServerActionsTestOtherA-2081174214 None] Lock "cinder-117e939d-3af9-4f51-b678-c1e8b1727c2e-delete_volume" released by "delete_volume" :: held 2.494s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:41:59 devstack cinder-volume[92083]: DEBUG dbcounter [-] [92083] Writing DB stats cinder:SELECT=3,cinder:INSERT=1,cinder:UPDATE=11 {{(pid=92083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:42:00 devstack cinder-volume[92083]: DEBUG dbcounter [-] [92083] Writing DB stats cinder:SELECT=6,cinder:INSERT=3,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=92083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:42:08 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-c414126d-a691-40a3-846d-50ab695b4238 tempest-VolumesListAdminTestJSON-997131928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:42:08 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c414126d-a691-40a3-846d-50ab695b4238 tempest-VolumesListAdminTestJSON-997131928 None] Flow 'volume_create_manager' (9d15eb5f-3e36-4234-9545-0bd20c40798a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:42:08 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c414126d-a691-40a3-846d-50ab695b4238 tempest-VolumesListAdminTestJSON-997131928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6769125c-2f7e-482d-a22a-03d2132c4dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:42:08 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c414126d-a691-40a3-846d-50ab695b4238 tempest-VolumesListAdminTestJSON-997131928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6769125c-2f7e-482d-a22a-03d2132c4dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:42:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-150790739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b452718-d7e8-4f55-bbb7-692fd4e59a92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59ebe0de98114f549549625b0e0a209e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:42:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:42:09Z,use_quota=True,user_id='2fd8049422ba491f8003e39344137477',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:42:08 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c414126d-a691-40a3-846d-50ab695b4238 tempest-VolumesListAdminTestJSON-997131928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3325c2aa-4f6a-40e5-a62b-1421291fa1aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:42:08 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c414126d-a691-40a3-846d-50ab695b4238 tempest-VolumesListAdminTestJSON-997131928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3325c2aa-4f6a-40e5-a62b-1421291fa1aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:42:08 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c414126d-a691-40a3-846d-50ab695b4238 tempest-VolumesListAdminTestJSON-997131928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70262369-4e23-4923-9b18-78f73547fe03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:42:08 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c414126d-a691-40a3-846d-50ab695b4238 tempest-VolumesListAdminTestJSON-997131928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70262369-4e23-4923-9b18-78f73547fe03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b452718-d7e8-4f55-bbb7-692fd4e59a92', 'volume_name': 'volume-9b452718-d7e8-4f55-bbb7-692fd4e59a92', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:42:08 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c414126d-a691-40a3-846d-50ab695b4238 tempest-VolumesListAdminTestJSON-997131928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e4c0f9a-e9e5-482f-b511-00a22c6c57d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:42:08 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c414126d-a691-40a3-846d-50ab695b4238 tempest-VolumesListAdminTestJSON-997131928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e4c0f9a-e9e5-482f-b511-00a22c6c57d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:42:08 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c414126d-a691-40a3-846d-50ab695b4238 tempest-VolumesListAdminTestJSON-997131928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75b17b8c-0e28-42f4-82d3-823e052532af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:42:08 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-c414126d-a691-40a3-846d-50ab695b4238 tempest-VolumesListAdminTestJSON-997131928 None] Volume 9b452718-d7e8-4f55-bbb7-692fd4e59a92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b452718-d7e8-4f55-bbb7-692fd4e59a92', 'volume_size': 1} Jun 17 05:42:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-c414126d-a691-40a3-846d-50ab695b4238 tempest-VolumesListAdminTestJSON-997131928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:42:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-c414126d-a691-40a3-846d-50ab695b4238 tempest-VolumesListAdminTestJSON-997131928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:42:08 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-c414126d-a691-40a3-846d-50ab695b4238 tempest-VolumesListAdminTestJSON-997131928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:42:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-150790739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b452718-d7e8-4f55-bbb7-692fd4e59a92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59ebe0de98114f549549625b0e0a209e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:42:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:42:09Z,use_quota=True,user_id='2fd8049422ba491f8003e39344137477',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:42:08 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-c414126d-a691-40a3-846d-50ab695b4238 tempest-VolumesListAdminTestJSON-997131928 None] Creating volume 9b452718-d7e8-4f55-bbb7-692fd4e59a92 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:42:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-c414126d-a691-40a3-846d-50ab695b4238 tempest-VolumesListAdminTestJSON-997131928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:42:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-c414126d-a691-40a3-846d-50ab695b4238 tempest-VolumesListAdminTestJSON-997131928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:42:08 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-c414126d-a691-40a3-846d-50ab695b4238 tempest-VolumesListAdminTestJSON-997131928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:42:08 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-c414126d-a691-40a3-846d-50ab695b4238 tempest-VolumesListAdminTestJSON-997131928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:42:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-c414126d-a691-40a3-846d-50ab695b4238 tempest-VolumesListAdminTestJSON-997131928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:42:08 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-c414126d-a691-40a3-846d-50ab695b4238 tempest-VolumesListAdminTestJSON-997131928 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:42:08 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-c414126d-a691-40a3-846d-50ab695b4238 tempest-VolumesListAdminTestJSON-997131928 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:42:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c414126d-a691-40a3-846d-50ab695b4238 tempest-VolumesListAdminTestJSON-997131928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9b452718-d7e8-4f55-bbb7-692fd4e59a92 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:42:08 devstack sudo[96878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9b452718-d7e8-4f55-bbb7-692fd4e59a92 1073741824 Jun 17 05:42:08 devstack sudo[96878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:42:09 devstack sudo[96878]: pam_unix(sudo:session): session closed for user root Jun 17 05:42:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c414126d-a691-40a3-846d-50ab695b4238 tempest-VolumesListAdminTestJSON-997131928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9b452718-d7e8-4f55-bbb7-692fd4e59a92 1073741824" returned: 0 in 0.838s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:42:09 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [req-76236f18-04aa-4727-accb-bcef3d0dc51e req-700cb35c-3934-43e5-afc2-db26f49690e3 tempest-VolumesSnapshotsTestJSON-2017906004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:42:09 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [req-76236f18-04aa-4727-accb-bcef3d0dc51e req-700cb35c-3934-43e5-afc2-db26f49690e3 tempest-VolumesSnapshotsTestJSON-2017906004 None] Flow 'volume_create_manager' (f0dcf48b-bb0d-43d0-b4d5-715026f2a2ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:42:09 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [req-76236f18-04aa-4727-accb-bcef3d0dc51e req-700cb35c-3934-43e5-afc2-db26f49690e3 tempest-VolumesSnapshotsTestJSON-2017906004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ffcfa00-d4ec-40fa-a7a5-de1b686bdf94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:42:09 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [req-76236f18-04aa-4727-accb-bcef3d0dc51e req-700cb35c-3934-43e5-afc2-db26f49690e3 tempest-VolumesSnapshotsTestJSON-2017906004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ffcfa00-d4ec-40fa-a7a5-de1b686bdf94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:42:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-239845549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22d183f5-fa81-44a6-8914-bc9207ba77a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea185c005ca94d30a7980feac3883e63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:42:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:42:10Z,use_quota=True,user_id='35cd7b918cee4f74b3afa361f80369d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:42:09 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [req-76236f18-04aa-4727-accb-bcef3d0dc51e req-700cb35c-3934-43e5-afc2-db26f49690e3 tempest-VolumesSnapshotsTestJSON-2017906004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6850a1ab-a704-49c5-ab89-17b5c673379a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:42:09 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [req-76236f18-04aa-4727-accb-bcef3d0dc51e req-700cb35c-3934-43e5-afc2-db26f49690e3 tempest-VolumesSnapshotsTestJSON-2017906004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6850a1ab-a704-49c5-ab89-17b5c673379a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:42:09 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [req-76236f18-04aa-4727-accb-bcef3d0dc51e req-700cb35c-3934-43e5-afc2-db26f49690e3 tempest-VolumesSnapshotsTestJSON-2017906004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d7a7de1-6f98-4b22-a33d-19c22e1bfa86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:42:09 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [req-76236f18-04aa-4727-accb-bcef3d0dc51e req-700cb35c-3934-43e5-afc2-db26f49690e3 tempest-VolumesSnapshotsTestJSON-2017906004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d7a7de1-6f98-4b22-a33d-19c22e1bfa86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22d183f5-fa81-44a6-8914-bc9207ba77a2', 'volume_name': 'volume-22d183f5-fa81-44a6-8914-bc9207ba77a2', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:42:09 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [req-76236f18-04aa-4727-accb-bcef3d0dc51e req-700cb35c-3934-43e5-afc2-db26f49690e3 tempest-VolumesSnapshotsTestJSON-2017906004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (707f9712-a645-4341-80c6-91f7df1a87e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:42:09 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [req-76236f18-04aa-4727-accb-bcef3d0dc51e req-700cb35c-3934-43e5-afc2-db26f49690e3 tempest-VolumesSnapshotsTestJSON-2017906004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (707f9712-a645-4341-80c6-91f7df1a87e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:42:09 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [req-76236f18-04aa-4727-accb-bcef3d0dc51e req-700cb35c-3934-43e5-afc2-db26f49690e3 tempest-VolumesSnapshotsTestJSON-2017906004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a0058f8-3ecf-441c-9e17-c14f06c05610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:42:09 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [req-76236f18-04aa-4727-accb-bcef3d0dc51e req-700cb35c-3934-43e5-afc2-db26f49690e3 tempest-VolumesSnapshotsTestJSON-2017906004 None] Volume 22d183f5-fa81-44a6-8914-bc9207ba77a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22d183f5-fa81-44a6-8914-bc9207ba77a2', 'volume_size': 1} Jun 17 05:42:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-76236f18-04aa-4727-accb-bcef3d0dc51e req-700cb35c-3934-43e5-afc2-db26f49690e3 tempest-VolumesSnapshotsTestJSON-2017906004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:42:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c414126d-a691-40a3-846d-50ab695b4238 tempest-VolumesListAdminTestJSON-997131928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9b452718-d7e8-4f55-bbb7-692fd4e59a92 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:42:09 devstack sudo[96884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9b452718-d7e8-4f55-bbb7-692fd4e59a92 Jun 17 05:42:09 devstack sudo[96884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:42:10 devstack sudo[96884]: pam_unix(sudo:session): session closed for user root Jun 17 05:42:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c414126d-a691-40a3-846d-50ab695b4238 tempest-VolumesListAdminTestJSON-997131928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9b452718-d7e8-4f55-bbb7-692fd4e59a92" returned: 0 in 0.586s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:42:10 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-c414126d-a691-40a3-846d-50ab695b4238 tempest-VolumesListAdminTestJSON-997131928 None] <== create_volume: return (1574ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:42:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-c414126d-a691-40a3-846d-50ab695b4238 tempest-VolumesListAdminTestJSON-997131928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.578s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:42:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-76236f18-04aa-4727-accb-bcef3d0dc51e req-700cb35c-3934-43e5-afc2-db26f49690e3 tempest-VolumesSnapshotsTestJSON-2017906004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.598s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:42:10 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [req-76236f18-04aa-4727-accb-bcef3d0dc51e req-700cb35c-3934-43e5-afc2-db26f49690e3 tempest-VolumesSnapshotsTestJSON-2017906004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:42:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-239845549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22d183f5-fa81-44a6-8914-bc9207ba77a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea185c005ca94d30a7980feac3883e63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:42:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:42:10Z,use_quota=True,user_id='35cd7b918cee4f74b3afa361f80369d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:42:10 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [req-76236f18-04aa-4727-accb-bcef3d0dc51e req-700cb35c-3934-43e5-afc2-db26f49690e3 tempest-VolumesSnapshotsTestJSON-2017906004 None] Creating volume 22d183f5-fa81-44a6-8914-bc9207ba77a2 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:42:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-76236f18-04aa-4727-accb-bcef3d0dc51e req-700cb35c-3934-43e5-afc2-db26f49690e3 tempest-VolumesSnapshotsTestJSON-2017906004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:42:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-76236f18-04aa-4727-accb-bcef3d0dc51e req-700cb35c-3934-43e5-afc2-db26f49690e3 tempest-VolumesSnapshotsTestJSON-2017906004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:42:10 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [req-76236f18-04aa-4727-accb-bcef3d0dc51e req-700cb35c-3934-43e5-afc2-db26f49690e3 tempest-VolumesSnapshotsTestJSON-2017906004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:42:10 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [req-76236f18-04aa-4727-accb-bcef3d0dc51e req-700cb35c-3934-43e5-afc2-db26f49690e3 tempest-VolumesSnapshotsTestJSON-2017906004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:42:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-76236f18-04aa-4727-accb-bcef3d0dc51e req-700cb35c-3934-43e5-afc2-db26f49690e3 tempest-VolumesSnapshotsTestJSON-2017906004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:42:10 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [req-76236f18-04aa-4727-accb-bcef3d0dc51e req-700cb35c-3934-43e5-afc2-db26f49690e3 tempest-VolumesSnapshotsTestJSON-2017906004 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:42:10 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [req-76236f18-04aa-4727-accb-bcef3d0dc51e req-700cb35c-3934-43e5-afc2-db26f49690e3 tempest-VolumesSnapshotsTestJSON-2017906004 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:42:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-76236f18-04aa-4727-accb-bcef3d0dc51e req-700cb35c-3934-43e5-afc2-db26f49690e3 tempest-VolumesSnapshotsTestJSON-2017906004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-22d183f5-fa81-44a6-8914-bc9207ba77a2 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:42:10 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c414126d-a691-40a3-846d-50ab695b4238 tempest-VolumesListAdminTestJSON-997131928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75b17b8c-0e28-42f4-82d3-823e052532af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b452718-d7e8-4f55-bbb7-692fd4e59a92', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:42:10 devstack sudo[96887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-22d183f5-fa81-44a6-8914-bc9207ba77a2 1073741824 Jun 17 05:42:10 devstack sudo[96887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:42:10 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c414126d-a691-40a3-846d-50ab695b4238 tempest-VolumesListAdminTestJSON-997131928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dea9433-de5b-42c9-a355-03685b373c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:42:10 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-c414126d-a691-40a3-846d-50ab695b4238 tempest-VolumesListAdminTestJSON-997131928 None] Volume volume-9b452718-d7e8-4f55-bbb7-692fd4e59a92 (9b452718-d7e8-4f55-bbb7-692fd4e59a92): created successfully Jun 17 05:42:10 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c414126d-a691-40a3-846d-50ab695b4238 tempest-VolumesListAdminTestJSON-997131928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dea9433-de5b-42c9-a355-03685b373c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:42:10 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c414126d-a691-40a3-846d-50ab695b4238 tempest-VolumesListAdminTestJSON-997131928 None] Flow 'volume_create_manager' (9d15eb5f-3e36-4234-9545-0bd20c40798a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:42:10 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-c414126d-a691-40a3-846d-50ab695b4238 tempest-VolumesListAdminTestJSON-997131928 None] Created volume successfully. Jun 17 05:42:11 devstack sudo[96887]: pam_unix(sudo:session): session closed for user root Jun 17 05:42:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-76236f18-04aa-4727-accb-bcef3d0dc51e req-700cb35c-3934-43e5-afc2-db26f49690e3 tempest-VolumesSnapshotsTestJSON-2017906004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-22d183f5-fa81-44a6-8914-bc9207ba77a2 1073741824" returned: 0 in 0.856s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:42:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-76236f18-04aa-4727-accb-bcef3d0dc51e req-700cb35c-3934-43e5-afc2-db26f49690e3 tempest-VolumesSnapshotsTestJSON-2017906004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-22d183f5-fa81-44a6-8914-bc9207ba77a2 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:42:11 devstack sudo[96893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-22d183f5-fa81-44a6-8914-bc9207ba77a2 Jun 17 05:42:11 devstack sudo[96893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:42:11 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-96d5e9ee-9b60-4e7f-9c28-85330e767f07 tempest-VolumesListAdminTestJSON-997131928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:42:11 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-96d5e9ee-9b60-4e7f-9c28-85330e767f07 tempest-VolumesListAdminTestJSON-997131928 None] Flow 'volume_create_manager' (0320567a-4281-43ba-80db-a619fb0a1926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:42:11 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-96d5e9ee-9b60-4e7f-9c28-85330e767f07 tempest-VolumesListAdminTestJSON-997131928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f358814-9e12-47ef-83ed-eb92a495fc31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:42:11 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-96d5e9ee-9b60-4e7f-9c28-85330e767f07 tempest-VolumesListAdminTestJSON-997131928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f358814-9e12-47ef-83ed-eb92a495fc31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:42:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-310801880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1190bca0-f86e-4961-8131-28927b5ad324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59ebe0de98114f549549625b0e0a209e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:42:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:42:11Z,use_quota=True,user_id='2fd8049422ba491f8003e39344137477',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:42:11 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-96d5e9ee-9b60-4e7f-9c28-85330e767f07 tempest-VolumesListAdminTestJSON-997131928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a69d5c30-4c84-4d0e-a48c-d0d0ae730c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:42:11 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-96d5e9ee-9b60-4e7f-9c28-85330e767f07 tempest-VolumesListAdminTestJSON-997131928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a69d5c30-4c84-4d0e-a48c-d0d0ae730c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:42:11 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-96d5e9ee-9b60-4e7f-9c28-85330e767f07 tempest-VolumesListAdminTestJSON-997131928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a24da6a9-0d3a-40e5-8953-163018b42c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:42:11 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-96d5e9ee-9b60-4e7f-9c28-85330e767f07 tempest-VolumesListAdminTestJSON-997131928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a24da6a9-0d3a-40e5-8953-163018b42c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1190bca0-f86e-4961-8131-28927b5ad324', 'volume_name': 'volume-1190bca0-f86e-4961-8131-28927b5ad324', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:42:11 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-96d5e9ee-9b60-4e7f-9c28-85330e767f07 tempest-VolumesListAdminTestJSON-997131928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d675156a-df78-4d80-9681-91ca4880f9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:42:11 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-96d5e9ee-9b60-4e7f-9c28-85330e767f07 tempest-VolumesListAdminTestJSON-997131928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d675156a-df78-4d80-9681-91ca4880f9b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:42:11 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-96d5e9ee-9b60-4e7f-9c28-85330e767f07 tempest-VolumesListAdminTestJSON-997131928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4ca4773-779e-43a6-bde7-d715185e5541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:42:11 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-96d5e9ee-9b60-4e7f-9c28-85330e767f07 tempest-VolumesListAdminTestJSON-997131928 None] Volume 1190bca0-f86e-4961-8131-28927b5ad324: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1190bca0-f86e-4961-8131-28927b5ad324', 'volume_size': 1} Jun 17 05:42:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-96d5e9ee-9b60-4e7f-9c28-85330e767f07 tempest-VolumesListAdminTestJSON-997131928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:42:11 devstack sudo[96893]: pam_unix(sudo:session): session closed for user root Jun 17 05:42:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-76236f18-04aa-4727-accb-bcef3d0dc51e req-700cb35c-3934-43e5-afc2-db26f49690e3 tempest-VolumesSnapshotsTestJSON-2017906004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-22d183f5-fa81-44a6-8914-bc9207ba77a2" returned: 0 in 0.766s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:42:12 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [req-76236f18-04aa-4727-accb-bcef3d0dc51e req-700cb35c-3934-43e5-afc2-db26f49690e3 tempest-VolumesSnapshotsTestJSON-2017906004 None] <== create_volume: return (1677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:42:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-76236f18-04aa-4727-accb-bcef3d0dc51e req-700cb35c-3934-43e5-afc2-db26f49690e3 tempest-VolumesSnapshotsTestJSON-2017906004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.682s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:42:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-96d5e9ee-9b60-4e7f-9c28-85330e767f07 tempest-VolumesListAdminTestJSON-997131928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.441s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:42:12 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-96d5e9ee-9b60-4e7f-9c28-85330e767f07 tempest-VolumesListAdminTestJSON-997131928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:42:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-310801880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1190bca0-f86e-4961-8131-28927b5ad324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59ebe0de98114f549549625b0e0a209e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:42:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:42:11Z,use_quota=True,user_id='2fd8049422ba491f8003e39344137477',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:42:12 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-96d5e9ee-9b60-4e7f-9c28-85330e767f07 tempest-VolumesListAdminTestJSON-997131928 None] Creating volume 1190bca0-f86e-4961-8131-28927b5ad324 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:42:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-96d5e9ee-9b60-4e7f-9c28-85330e767f07 tempest-VolumesListAdminTestJSON-997131928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:42:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-96d5e9ee-9b60-4e7f-9c28-85330e767f07 tempest-VolumesListAdminTestJSON-997131928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:42:12 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-96d5e9ee-9b60-4e7f-9c28-85330e767f07 tempest-VolumesListAdminTestJSON-997131928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:42:12 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-96d5e9ee-9b60-4e7f-9c28-85330e767f07 tempest-VolumesListAdminTestJSON-997131928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:42:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-96d5e9ee-9b60-4e7f-9c28-85330e767f07 tempest-VolumesListAdminTestJSON-997131928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:42:12 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-96d5e9ee-9b60-4e7f-9c28-85330e767f07 tempest-VolumesListAdminTestJSON-997131928 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:42:12 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-96d5e9ee-9b60-4e7f-9c28-85330e767f07 tempest-VolumesListAdminTestJSON-997131928 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:42:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-96d5e9ee-9b60-4e7f-9c28-85330e767f07 tempest-VolumesListAdminTestJSON-997131928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1190bca0-f86e-4961-8131-28927b5ad324 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:42:12 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [req-76236f18-04aa-4727-accb-bcef3d0dc51e req-700cb35c-3934-43e5-afc2-db26f49690e3 tempest-VolumesSnapshotsTestJSON-2017906004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a0058f8-3ecf-441c-9e17-c14f06c05610) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22d183f5-fa81-44a6-8914-bc9207ba77a2', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:42:12 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [req-76236f18-04aa-4727-accb-bcef3d0dc51e req-700cb35c-3934-43e5-afc2-db26f49690e3 tempest-VolumesSnapshotsTestJSON-2017906004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad347adc-f440-4f80-a4a0-94438f96f067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:42:12 devstack sudo[96896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1190bca0-f86e-4961-8131-28927b5ad324 1073741824 Jun 17 05:42:12 devstack sudo[96896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:42:12 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [req-76236f18-04aa-4727-accb-bcef3d0dc51e req-700cb35c-3934-43e5-afc2-db26f49690e3 tempest-VolumesSnapshotsTestJSON-2017906004 None] Volume volume-22d183f5-fa81-44a6-8914-bc9207ba77a2 (22d183f5-fa81-44a6-8914-bc9207ba77a2): created successfully Jun 17 05:42:12 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [req-76236f18-04aa-4727-accb-bcef3d0dc51e req-700cb35c-3934-43e5-afc2-db26f49690e3 tempest-VolumesSnapshotsTestJSON-2017906004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad347adc-f440-4f80-a4a0-94438f96f067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:42:12 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [req-76236f18-04aa-4727-accb-bcef3d0dc51e req-700cb35c-3934-43e5-afc2-db26f49690e3 tempest-VolumesSnapshotsTestJSON-2017906004 None] Flow 'volume_create_manager' (f0dcf48b-bb0d-43d0-b4d5-715026f2a2ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:42:12 devstack cinder-volume[92083]: INFO cinder.volume.manager [req-76236f18-04aa-4727-accb-bcef3d0dc51e req-700cb35c-3934-43e5-afc2-db26f49690e3 tempest-VolumesSnapshotsTestJSON-2017906004 None] Created volume successfully. Jun 17 05:42:12 devstack sudo[96896]: pam_unix(sudo:session): session closed for user root Jun 17 05:42:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-96d5e9ee-9b60-4e7f-9c28-85330e767f07 tempest-VolumesListAdminTestJSON-997131928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1190bca0-f86e-4961-8131-28927b5ad324 1073741824" returned: 0 in 0.779s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:42:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-96d5e9ee-9b60-4e7f-9c28-85330e767f07 tempest-VolumesListAdminTestJSON-997131928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1190bca0-f86e-4961-8131-28927b5ad324 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:42:12 devstack sudo[96901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1190bca0-f86e-4961-8131-28927b5ad324 Jun 17 05:42:12 devstack sudo[96901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:42:13 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-eae56fea-a629-4cfc-bcff-bffa9e549f0f req-6c014864-f5a7-4e6b-bd26-6519b771c4e4 tempest-VolumesSnapshotsTestJSON-2017906004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:42:13 devstack sudo[96901]: pam_unix(sudo:session): session closed for user root Jun 17 05:42:13 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-96d5e9ee-9b60-4e7f-9c28-85330e767f07 tempest-VolumesListAdminTestJSON-997131928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1190bca0-f86e-4961-8131-28927b5ad324" returned: 0 in 0.659s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:42:13 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-96d5e9ee-9b60-4e7f-9c28-85330e767f07 tempest-VolumesListAdminTestJSON-997131928 None] <== create_volume: return (1484ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:42:13 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-96d5e9ee-9b60-4e7f-9c28-85330e767f07 tempest-VolumesListAdminTestJSON-997131928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.491s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:42:13 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-eae56fea-a629-4cfc-bcff-bffa9e549f0f req-6c014864-f5a7-4e6b-bd26-6519b771c4e4 tempest-VolumesSnapshotsTestJSON-2017906004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.296s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:42:13 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [req-eae56fea-a629-4cfc-bcff-bffa9e549f0f req-6c014864-f5a7-4e6b-bd26-6519b771c4e4 tempest-VolumesSnapshotsTestJSON-2017906004 None] Creating offline snapshot 757e994a-2847-43b5-8424-2f4bfe365d55 of volume 22d183f5-fa81-44a6-8914-bc9207ba77a2 {{(pid=92083) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 17 05:42:13 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-96d5e9ee-9b60-4e7f-9c28-85330e767f07 tempest-VolumesListAdminTestJSON-997131928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4ca4773-779e-43a6-bde7-d715185e5541) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1190bca0-f86e-4961-8131-28927b5ad324', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:42:13 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-96d5e9ee-9b60-4e7f-9c28-85330e767f07 tempest-VolumesListAdminTestJSON-997131928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7800c1e2-8c21-4789-b0b2-46e47a147d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:42:13 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f9173df-e1ef-4b4d-981c-a4ff0d263d89]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:42:13 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-eae56fea-a629-4cfc-bcff-bffa9e549f0f req-6c014864-f5a7-4e6b-bd26-6519b771c4e4 tempest-VolumesSnapshotsTestJSON-2017906004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-22d183f5-fa81-44a6-8914-bc9207ba77a2 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:42:13 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-96d5e9ee-9b60-4e7f-9c28-85330e767f07 tempest-VolumesListAdminTestJSON-997131928 None] Volume volume-1190bca0-f86e-4961-8131-28927b5ad324 (1190bca0-f86e-4961-8131-28927b5ad324): created successfully Jun 17 05:42:13 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-96d5e9ee-9b60-4e7f-9c28-85330e767f07 tempest-VolumesListAdminTestJSON-997131928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7800c1e2-8c21-4789-b0b2-46e47a147d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:42:13 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-96d5e9ee-9b60-4e7f-9c28-85330e767f07 tempest-VolumesListAdminTestJSON-997131928 None] Flow 'volume_create_manager' (0320567a-4281-43ba-80db-a619fb0a1926) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:42:13 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-96d5e9ee-9b60-4e7f-9c28-85330e767f07 tempest-VolumesListAdminTestJSON-997131928 None] Created volume successfully. Jun 17 05:42:13 devstack sudo[96904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-22d183f5-fa81-44a6-8914-bc9207ba77a2 Jun 17 05:42:13 devstack sudo[96904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:42:14 devstack sudo[96904]: pam_unix(sudo:session): session closed for user root Jun 17 05:42:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-eae56fea-a629-4cfc-bcff-bffa9e549f0f req-6c014864-f5a7-4e6b-bd26-6519b771c4e4 tempest-VolumesSnapshotsTestJSON-2017906004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-22d183f5-fa81-44a6-8914-bc9207ba77a2" returned: 0 in 0.720s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:42:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-eae56fea-a629-4cfc-bcff-bffa9e549f0f req-6c014864-f5a7-4e6b-bd26-6519b771c4e4 tempest-VolumesSnapshotsTestJSON-2017906004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-22d183f5-fa81-44a6-8914-bc9207ba77a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-22d183f5-fa81-44a6-8914-bc9207ba77a2.757e994a-2847-43b5-8424-2f4bfe365d55 1G {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:42:14 devstack sudo[96912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-22d183f5-fa81-44a6-8914-bc9207ba77a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-22d183f5-fa81-44a6-8914-bc9207ba77a2.757e994a-2847-43b5-8424-2f4bfe365d55 1G Jun 17 05:42:14 devstack sudo[96912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:42:15 devstack sudo[96912]: pam_unix(sudo:session): session closed for user root Jun 17 05:42:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-eae56fea-a629-4cfc-bcff-bffa9e549f0f req-6c014864-f5a7-4e6b-bd26-6519b771c4e4 tempest-VolumesSnapshotsTestJSON-2017906004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-22d183f5-fa81-44a6-8914-bc9207ba77a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-22d183f5-fa81-44a6-8914-bc9207ba77a2.757e994a-2847-43b5-8424-2f4bfe365d55 1G" returned: 0 in 0.855s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:42:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-eae56fea-a629-4cfc-bcff-bffa9e549f0f req-6c014864-f5a7-4e6b-bd26-6519b771c4e4 tempest-VolumesSnapshotsTestJSON-2017906004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22d183f5-fa81-44a6-8914-bc9207ba77a2 -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-22d183f5-fa81-44a6-8914-bc9207ba77a2.757e994a-2847-43b5-8424-2f4bfe365d55 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:42:15 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-09e4eda6-e31f-429a-a0a4-737f653cdab4 tempest-VolumesListAdminTestJSON-997131928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:42:15 devstack sudo[96921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22d183f5-fa81-44a6-8914-bc9207ba77a2 -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-22d183f5-fa81-44a6-8914-bc9207ba77a2.757e994a-2847-43b5-8424-2f4bfe365d55 Jun 17 05:42:15 devstack sudo[96921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:42:15 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-09e4eda6-e31f-429a-a0a4-737f653cdab4 tempest-VolumesListAdminTestJSON-997131928 None] Flow 'volume_create_manager' (2d9a5bac-1e27-45e8-8b88-33770b071dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:42:15 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-09e4eda6-e31f-429a-a0a4-737f653cdab4 tempest-VolumesListAdminTestJSON-997131928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f535849-5dc9-49e1-a2db-a65b342613df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:42:15 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-09e4eda6-e31f-429a-a0a4-737f653cdab4 tempest-VolumesListAdminTestJSON-997131928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f535849-5dc9-49e1-a2db-a65b342613df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:42:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1757901099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed281854-d17a-4e6a-82f7-7b8ad19c407e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59ebe0de98114f549549625b0e0a209e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:42:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:42:15Z,use_quota=True,user_id='2fd8049422ba491f8003e39344137477',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:42:15 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-09e4eda6-e31f-429a-a0a4-737f653cdab4 tempest-VolumesListAdminTestJSON-997131928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77a48710-4ea8-4222-85c6-d9dc067f0862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:42:15 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-09e4eda6-e31f-429a-a0a4-737f653cdab4 tempest-VolumesListAdminTestJSON-997131928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77a48710-4ea8-4222-85c6-d9dc067f0862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:42:15 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-09e4eda6-e31f-429a-a0a4-737f653cdab4 tempest-VolumesListAdminTestJSON-997131928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0fa377a-6d4a-4c69-bfc4-02d72ffb6c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:42:15 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-09e4eda6-e31f-429a-a0a4-737f653cdab4 tempest-VolumesListAdminTestJSON-997131928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0fa377a-6d4a-4c69-bfc4-02d72ffb6c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed281854-d17a-4e6a-82f7-7b8ad19c407e', 'volume_name': 'volume-ed281854-d17a-4e6a-82f7-7b8ad19c407e', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:42:15 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-09e4eda6-e31f-429a-a0a4-737f653cdab4 tempest-VolumesListAdminTestJSON-997131928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (940a4c95-8a5f-4e14-ab11-98394a1f8591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:42:15 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-09e4eda6-e31f-429a-a0a4-737f653cdab4 tempest-VolumesListAdminTestJSON-997131928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (940a4c95-8a5f-4e14-ab11-98394a1f8591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:42:15 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-09e4eda6-e31f-429a-a0a4-737f653cdab4 tempest-VolumesListAdminTestJSON-997131928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e81ceec-9489-4dab-a9dc-fad39083be5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:42:15 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-09e4eda6-e31f-429a-a0a4-737f653cdab4 tempest-VolumesListAdminTestJSON-997131928 None] Volume ed281854-d17a-4e6a-82f7-7b8ad19c407e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed281854-d17a-4e6a-82f7-7b8ad19c407e', 'volume_size': 1} Jun 17 05:42:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-09e4eda6-e31f-429a-a0a4-737f653cdab4 tempest-VolumesListAdminTestJSON-997131928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:42:15 devstack sudo[96921]: pam_unix(sudo:session): session closed for user root Jun 17 05:42:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-eae56fea-a629-4cfc-bcff-bffa9e549f0f req-6c014864-f5a7-4e6b-bd26-6519b771c4e4 tempest-VolumesSnapshotsTestJSON-2017906004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22d183f5-fa81-44a6-8914-bc9207ba77a2 -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-22d183f5-fa81-44a6-8914-bc9207ba77a2.757e994a-2847-43b5-8424-2f4bfe365d55" returned: 0 in 0.684s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:42:15 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [req-eae56fea-a629-4cfc-bcff-bffa9e549f0f req-6c014864-f5a7-4e6b-bd26-6519b771c4e4 tempest-VolumesSnapshotsTestJSON-2017906004 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-22d183f5-fa81-44a6-8914-bc9207ba77a2.757e994a-2847-43b5-8424-2f4bfe365d55 is being set with open permissions: ugo+rw Jun 17 05:42:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-eae56fea-a629-4cfc-bcff-bffa9e549f0f req-6c014864-f5a7-4e6b-bd26-6519b771c4e4 tempest-VolumesSnapshotsTestJSON-2017906004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-22d183f5-fa81-44a6-8914-bc9207ba77a2.757e994a-2847-43b5-8424-2f4bfe365d55 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:42:15 devstack sudo[96942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-22d183f5-fa81-44a6-8914-bc9207ba77a2.757e994a-2847-43b5-8424-2f4bfe365d55 Jun 17 05:42:15 devstack sudo[96942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:42:16 devstack sudo[96942]: pam_unix(sudo:session): session closed for user root Jun 17 05:42:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-eae56fea-a629-4cfc-bcff-bffa9e549f0f req-6c014864-f5a7-4e6b-bd26-6519b771c4e4 tempest-VolumesSnapshotsTestJSON-2017906004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-22d183f5-fa81-44a6-8914-bc9207ba77a2.757e994a-2847-43b5-8424-2f4bfe365d55" returned: 0 in 0.591s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:42:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-eae56fea-a629-4cfc-bcff-bffa9e549f0f req-6c014864-f5a7-4e6b-bd26-6519b771c4e4 tempest-VolumesSnapshotsTestJSON-2017906004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-22d183f5-fa81-44a6-8914-bc9207ba77a2.info {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:42:16 devstack sudo[96947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-22d183f5-fa81-44a6-8914-bc9207ba77a2.info Jun 17 05:42:16 devstack sudo[96947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:42:17 devstack sudo[96947]: pam_unix(sudo:session): session closed for user root Jun 17 05:42:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-eae56fea-a629-4cfc-bcff-bffa9e549f0f req-6c014864-f5a7-4e6b-bd26-6519b771c4e4 tempest-VolumesSnapshotsTestJSON-2017906004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-22d183f5-fa81-44a6-8914-bc9207ba77a2.info" returned: 0 in 0.589s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:42:17 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [req-eae56fea-a629-4cfc-bcff-bffa9e549f0f req-6c014864-f5a7-4e6b-bd26-6519b771c4e4 tempest-VolumesSnapshotsTestJSON-2017906004 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-22d183f5-fa81-44a6-8914-bc9207ba77a2.info is being set with open permissions: ugo+rw Jun 17 05:42:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-eae56fea-a629-4cfc-bcff-bffa9e549f0f req-6c014864-f5a7-4e6b-bd26-6519b771c4e4 tempest-VolumesSnapshotsTestJSON-2017906004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-22d183f5-fa81-44a6-8914-bc9207ba77a2.info {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:42:17 devstack sudo[96950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-22d183f5-fa81-44a6-8914-bc9207ba77a2.info Jun 17 05:42:17 devstack sudo[96950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:42:17 devstack sudo[96950]: pam_unix(sudo:session): session closed for user root Jun 17 05:42:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-eae56fea-a629-4cfc-bcff-bffa9e549f0f req-6c014864-f5a7-4e6b-bd26-6519b771c4e4 tempest-VolumesSnapshotsTestJSON-2017906004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-22d183f5-fa81-44a6-8914-bc9207ba77a2.info" returned: 0 in 0.589s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:42:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-eae56fea-a629-4cfc-bcff-bffa9e549f0f req-6c014864-f5a7-4e6b-bd26-6519b771c4e4 tempest-VolumesSnapshotsTestJSON-2017906004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.127s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:42:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-09e4eda6-e31f-429a-a0a4-737f653cdab4 tempest-VolumesListAdminTestJSON-997131928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.402s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:42:17 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-09e4eda6-e31f-429a-a0a4-737f653cdab4 tempest-VolumesListAdminTestJSON-997131928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:42:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1757901099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed281854-d17a-4e6a-82f7-7b8ad19c407e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59ebe0de98114f549549625b0e0a209e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:42:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:42:15Z,use_quota=True,user_id='2fd8049422ba491f8003e39344137477',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:42:17 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-09e4eda6-e31f-429a-a0a4-737f653cdab4 tempest-VolumesListAdminTestJSON-997131928 None] Creating volume ed281854-d17a-4e6a-82f7-7b8ad19c407e {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:42:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-09e4eda6-e31f-429a-a0a4-737f653cdab4 tempest-VolumesListAdminTestJSON-997131928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:42:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-09e4eda6-e31f-429a-a0a4-737f653cdab4 tempest-VolumesListAdminTestJSON-997131928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:42:17 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-09e4eda6-e31f-429a-a0a4-737f653cdab4 tempest-VolumesListAdminTestJSON-997131928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:42:17 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-09e4eda6-e31f-429a-a0a4-737f653cdab4 tempest-VolumesListAdminTestJSON-997131928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:42:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-09e4eda6-e31f-429a-a0a4-737f653cdab4 tempest-VolumesListAdminTestJSON-997131928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:42:17 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-09e4eda6-e31f-429a-a0a4-737f653cdab4 tempest-VolumesListAdminTestJSON-997131928 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:42:17 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-09e4eda6-e31f-429a-a0a4-737f653cdab4 tempest-VolumesListAdminTestJSON-997131928 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:42:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-09e4eda6-e31f-429a-a0a4-737f653cdab4 tempest-VolumesListAdminTestJSON-997131928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ed281854-d17a-4e6a-82f7-7b8ad19c407e 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:42:17 devstack sudo[96953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ed281854-d17a-4e6a-82f7-7b8ad19c407e 1073741824 Jun 17 05:42:17 devstack sudo[96953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:42:17 devstack cinder-volume[92083]: INFO cinder.volume.manager [req-eae56fea-a629-4cfc-bcff-bffa9e549f0f req-6c014864-f5a7-4e6b-bd26-6519b771c4e4 tempest-VolumesSnapshotsTestJSON-2017906004 None] Create snapshot completed successfully Jun 17 05:42:18 devstack sudo[96953]: pam_unix(sudo:session): session closed for user root Jun 17 05:42:18 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-09e4eda6-e31f-429a-a0a4-737f653cdab4 tempest-VolumesListAdminTestJSON-997131928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ed281854-d17a-4e6a-82f7-7b8ad19c407e 1073741824" returned: 0 in 1.086s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:42:18 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-09e4eda6-e31f-429a-a0a4-737f653cdab4 tempest-VolumesListAdminTestJSON-997131928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ed281854-d17a-4e6a-82f7-7b8ad19c407e {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:42:18 devstack sudo[97035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ed281854-d17a-4e6a-82f7-7b8ad19c407e Jun 17 05:42:18 devstack sudo[97035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:42:18 devstack cinder-volume[92083]: DEBUG cinder.coordination [req-7367d963-8101-4951-ac2f-9cbf3be2cec8 req-249aeca2-2d41-4004-bc95-d509d1902412 tempest-VolumesSnapshotsTestJSON-2017906004 None] Acquiring lock "cinder-757e994a-2847-43b5-8424-2f4bfe365d55-delete_snapshot" by "delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:42:18 devstack cinder-volume[92083]: DEBUG cinder.coordination [req-7367d963-8101-4951-ac2f-9cbf3be2cec8 req-249aeca2-2d41-4004-bc95-d509d1902412 tempest-VolumesSnapshotsTestJSON-2017906004 None] Lock "cinder-757e994a-2847-43b5-8424-2f4bfe365d55-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:42:18 devstack cinder-volume[92083]: DEBUG cinder.coordination [req-7367d963-8101-4951-ac2f-9cbf3be2cec8 req-249aeca2-2d41-4004-bc95-d509d1902412 tempest-VolumesSnapshotsTestJSON-2017906004 None] Acquiring lock "cinder-quobyte-22d183f5-fa81-44a6-8914-bc9207ba77a2" by "delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:42:18 devstack cinder-volume[92083]: DEBUG cinder.coordination [req-7367d963-8101-4951-ac2f-9cbf3be2cec8 req-249aeca2-2d41-4004-bc95-d509d1902412 tempest-VolumesSnapshotsTestJSON-2017906004 None] Lock "cinder-quobyte-22d183f5-fa81-44a6-8914-bc9207ba77a2" acquired by "delete_snapshot" :: waited 0.024s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:42:18 devstack cinder-volume[92083]: DEBUG cinder.coordination [req-7367d963-8101-4951-ac2f-9cbf3be2cec8 req-249aeca2-2d41-4004-bc95-d509d1902412 tempest-VolumesSnapshotsTestJSON-2017906004 None] Acquiring lock "cinder-quobyte-757e994a-2847-43b5-8424-2f4bfe365d55" by "_delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:42:18 devstack cinder-volume[92083]: DEBUG cinder.coordination [req-7367d963-8101-4951-ac2f-9cbf3be2cec8 req-249aeca2-2d41-4004-bc95-d509d1902412 tempest-VolumesSnapshotsTestJSON-2017906004 None] Lock "cinder-quobyte-757e994a-2847-43b5-8424-2f4bfe365d55" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:42:18 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [req-7367d963-8101-4951-ac2f-9cbf3be2cec8 req-249aeca2-2d41-4004-bc95-d509d1902412 tempest-VolumesSnapshotsTestJSON-2017906004 None] Deleting offline snapshot 757e994a-2847-43b5-8424-2f4bfe365d55 of volume 22d183f5-fa81-44a6-8914-bc9207ba77a2 {{(pid=92083) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 17 05:42:18 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [req-7367d963-8101-4951-ac2f-9cbf3be2cec8 req-249aeca2-2d41-4004-bc95-d509d1902412 tempest-VolumesSnapshotsTestJSON-2017906004 None] snapshot_file for this snap is: volume-22d183f5-fa81-44a6-8914-bc9207ba77a2.757e994a-2847-43b5-8424-2f4bfe365d55 {{(pid=92083) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 17 05:42:19 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2298731-c23d-45f2-93b3-7bf3f689832b]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:42:19 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-7367d963-8101-4951-ac2f-9cbf3be2cec8 req-249aeca2-2d41-4004-bc95-d509d1902412 tempest-VolumesSnapshotsTestJSON-2017906004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-22d183f5-fa81-44a6-8914-bc9207ba77a2.757e994a-2847-43b5-8424-2f4bfe365d55 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:42:19 devstack sudo[97041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-22d183f5-fa81-44a6-8914-bc9207ba77a2.757e994a-2847-43b5-8424-2f4bfe365d55 Jun 17 05:42:19 devstack sudo[97041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:42:19 devstack sudo[97035]: pam_unix(sudo:session): session closed for user root Jun 17 05:42:19 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-09e4eda6-e31f-429a-a0a4-737f653cdab4 tempest-VolumesListAdminTestJSON-997131928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ed281854-d17a-4e6a-82f7-7b8ad19c407e" returned: 0 in 0.703s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:42:19 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-09e4eda6-e31f-429a-a0a4-737f653cdab4 tempest-VolumesListAdminTestJSON-997131928 None] <== create_volume: return (1874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:42:19 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-09e4eda6-e31f-429a-a0a4-737f653cdab4 tempest-VolumesListAdminTestJSON-997131928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.879s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:42:19 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-09e4eda6-e31f-429a-a0a4-737f653cdab4 tempest-VolumesListAdminTestJSON-997131928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e81ceec-9489-4dab-a9dc-fad39083be5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed281854-d17a-4e6a-82f7-7b8ad19c407e', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:42:19 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-09e4eda6-e31f-429a-a0a4-737f653cdab4 tempest-VolumesListAdminTestJSON-997131928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48237a4f-15f0-46be-81a0-632a5b624625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:42:19 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-09e4eda6-e31f-429a-a0a4-737f653cdab4 tempest-VolumesListAdminTestJSON-997131928 None] Volume volume-ed281854-d17a-4e6a-82f7-7b8ad19c407e (ed281854-d17a-4e6a-82f7-7b8ad19c407e): created successfully Jun 17 05:42:19 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-09e4eda6-e31f-429a-a0a4-737f653cdab4 tempest-VolumesListAdminTestJSON-997131928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48237a4f-15f0-46be-81a0-632a5b624625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:42:19 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-09e4eda6-e31f-429a-a0a4-737f653cdab4 tempest-VolumesListAdminTestJSON-997131928 None] Flow 'volume_create_manager' (2d9a5bac-1e27-45e8-8b88-33770b071dab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:42:19 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-09e4eda6-e31f-429a-a0a4-737f653cdab4 tempest-VolumesListAdminTestJSON-997131928 None] Created volume successfully. Jun 17 05:42:19 devstack sudo[97041]: pam_unix(sudo:session): session closed for user root Jun 17 05:42:19 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-7367d963-8101-4951-ac2f-9cbf3be2cec8 req-249aeca2-2d41-4004-bc95-d509d1902412 tempest-VolumesSnapshotsTestJSON-2017906004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-22d183f5-fa81-44a6-8914-bc9207ba77a2.757e994a-2847-43b5-8424-2f4bfe365d55" returned: 0 in 0.860s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:42:19 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [req-7367d963-8101-4951-ac2f-9cbf3be2cec8 req-249aeca2-2d41-4004-bc95-d509d1902412 tempest-VolumesSnapshotsTestJSON-2017906004 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22d183f5-fa81-44a6-8914-bc9207ba77a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92083) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 05:42:19 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[7769ae87-935e-42c6-ad2d-1bcec7ef4402]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:42:19 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-7367d963-8101-4951-ac2f-9cbf3be2cec8 req-249aeca2-2d41-4004-bc95-d509d1902412 tempest-VolumesSnapshotsTestJSON-2017906004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-22d183f5-fa81-44a6-8914-bc9207ba77a2 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:42:20 devstack sudo[97054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-22d183f5-fa81-44a6-8914-bc9207ba77a2 Jun 17 05:42:20 devstack sudo[97054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:42:20 devstack sudo[97054]: pam_unix(sudo:session): session closed for user root Jun 17 05:42:20 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-7367d963-8101-4951-ac2f-9cbf3be2cec8 req-249aeca2-2d41-4004-bc95-d509d1902412 tempest-VolumesSnapshotsTestJSON-2017906004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-22d183f5-fa81-44a6-8914-bc9207ba77a2" returned: 0 in 0.767s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:42:20 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-7367d963-8101-4951-ac2f-9cbf3be2cec8 req-249aeca2-2d41-4004-bc95-d509d1902412 tempest-VolumesSnapshotsTestJSON-2017906004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-22d183f5-fa81-44a6-8914-bc9207ba77a2.757e994a-2847-43b5-8424-2f4bfe365d55 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:42:20 devstack sudo[97062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-22d183f5-fa81-44a6-8914-bc9207ba77a2.757e994a-2847-43b5-8424-2f4bfe365d55 Jun 17 05:42:20 devstack sudo[97062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:42:21 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-797dd2ed-2455-4b24-b391-6d812ceddaa9 tempest-VolumesListAdminTestJSON-1995670669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:42:21 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-797dd2ed-2455-4b24-b391-6d812ceddaa9 tempest-VolumesListAdminTestJSON-1995670669 None] Flow 'volume_create_manager' (3333f815-6f73-4dfb-8116-a6585a78ec16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:42:21 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-797dd2ed-2455-4b24-b391-6d812ceddaa9 tempest-VolumesListAdminTestJSON-1995670669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c489dfa-1438-4e7b-9ec9-ca2c6d81201b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:42:21 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-797dd2ed-2455-4b24-b391-6d812ceddaa9 tempest-VolumesListAdminTestJSON-1995670669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c489dfa-1438-4e7b-9ec9-ca2c6d81201b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:42:21Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8f0f309-5bd6-4e8a-bf3c-f01711e65086,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f06061985214b9db04589d1e3fb8cf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:42:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:42:21Z,use_quota=True,user_id='59611cbdf686489e8193d3f303eddf14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:42:21 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-797dd2ed-2455-4b24-b391-6d812ceddaa9 tempest-VolumesListAdminTestJSON-1995670669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ceee200-139c-42ae-bff8-9dc49225028a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:42:21 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-797dd2ed-2455-4b24-b391-6d812ceddaa9 tempest-VolumesListAdminTestJSON-1995670669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ceee200-139c-42ae-bff8-9dc49225028a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:42:21 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-797dd2ed-2455-4b24-b391-6d812ceddaa9 tempest-VolumesListAdminTestJSON-1995670669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (076d62c1-f83c-49dc-be00-51a4f1ebad48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:42:21 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-797dd2ed-2455-4b24-b391-6d812ceddaa9 tempest-VolumesListAdminTestJSON-1995670669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (076d62c1-f83c-49dc-be00-51a4f1ebad48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8f0f309-5bd6-4e8a-bf3c-f01711e65086', 'volume_name': 'volume-a8f0f309-5bd6-4e8a-bf3c-f01711e65086', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:42:21 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-797dd2ed-2455-4b24-b391-6d812ceddaa9 tempest-VolumesListAdminTestJSON-1995670669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2193411a-47e7-4538-a91e-c976b8aa29a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:42:21 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-797dd2ed-2455-4b24-b391-6d812ceddaa9 tempest-VolumesListAdminTestJSON-1995670669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2193411a-47e7-4538-a91e-c976b8aa29a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:42:21 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-797dd2ed-2455-4b24-b391-6d812ceddaa9 tempest-VolumesListAdminTestJSON-1995670669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6529571-68af-4e68-a720-1f7ff5265334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:42:21 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-797dd2ed-2455-4b24-b391-6d812ceddaa9 tempest-VolumesListAdminTestJSON-1995670669 None] Volume a8f0f309-5bd6-4e8a-bf3c-f01711e65086: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8f0f309-5bd6-4e8a-bf3c-f01711e65086', 'volume_size': 1} Jun 17 05:42:21 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-797dd2ed-2455-4b24-b391-6d812ceddaa9 tempest-VolumesListAdminTestJSON-1995670669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:42:21 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-797dd2ed-2455-4b24-b391-6d812ceddaa9 tempest-VolumesListAdminTestJSON-1995670669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:42:21 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-797dd2ed-2455-4b24-b391-6d812ceddaa9 tempest-VolumesListAdminTestJSON-1995670669 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:42:21Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8f0f309-5bd6-4e8a-bf3c-f01711e65086,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f06061985214b9db04589d1e3fb8cf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:42:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:42:21Z,use_quota=True,user_id='59611cbdf686489e8193d3f303eddf14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:42:21 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-797dd2ed-2455-4b24-b391-6d812ceddaa9 tempest-VolumesListAdminTestJSON-1995670669 None] Creating volume a8f0f309-5bd6-4e8a-bf3c-f01711e65086 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:42:21 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-797dd2ed-2455-4b24-b391-6d812ceddaa9 tempest-VolumesListAdminTestJSON-1995670669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:42:21 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-797dd2ed-2455-4b24-b391-6d812ceddaa9 tempest-VolumesListAdminTestJSON-1995670669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:42:21 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-797dd2ed-2455-4b24-b391-6d812ceddaa9 tempest-VolumesListAdminTestJSON-1995670669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:42:21 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-797dd2ed-2455-4b24-b391-6d812ceddaa9 tempest-VolumesListAdminTestJSON-1995670669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:42:21 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-797dd2ed-2455-4b24-b391-6d812ceddaa9 tempest-VolumesListAdminTestJSON-1995670669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:42:21 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-797dd2ed-2455-4b24-b391-6d812ceddaa9 tempest-VolumesListAdminTestJSON-1995670669 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:42:21 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-797dd2ed-2455-4b24-b391-6d812ceddaa9 tempest-VolumesListAdminTestJSON-1995670669 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:42:21 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-797dd2ed-2455-4b24-b391-6d812ceddaa9 tempest-VolumesListAdminTestJSON-1995670669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a8f0f309-5bd6-4e8a-bf3c-f01711e65086 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:42:21 devstack sudo[97068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a8f0f309-5bd6-4e8a-bf3c-f01711e65086 1073741824 Jun 17 05:42:21 devstack sudo[97068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:42:21 devstack sudo[97062]: pam_unix(sudo:session): session closed for user root Jun 17 05:42:21 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-7367d963-8101-4951-ac2f-9cbf3be2cec8 req-249aeca2-2d41-4004-bc95-d509d1902412 tempest-VolumesSnapshotsTestJSON-2017906004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-22d183f5-fa81-44a6-8914-bc9207ba77a2.757e994a-2847-43b5-8424-2f4bfe365d55" returned: 0 in 0.769s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:42:21 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-7367d963-8101-4951-ac2f-9cbf3be2cec8 req-249aeca2-2d41-4004-bc95-d509d1902412 tempest-VolumesSnapshotsTestJSON-2017906004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-22d183f5-fa81-44a6-8914-bc9207ba77a2.757e994a-2847-43b5-8424-2f4bfe365d55 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:42:21 devstack sudo[97070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-22d183f5-fa81-44a6-8914-bc9207ba77a2.757e994a-2847-43b5-8424-2f4bfe365d55 Jun 17 05:42:21 devstack sudo[97070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:42:22 devstack sudo[97070]: pam_unix(sudo:session): session closed for user root Jun 17 05:42:22 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-7367d963-8101-4951-ac2f-9cbf3be2cec8 req-249aeca2-2d41-4004-bc95-d509d1902412 tempest-VolumesSnapshotsTestJSON-2017906004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-22d183f5-fa81-44a6-8914-bc9207ba77a2.757e994a-2847-43b5-8424-2f4bfe365d55" returned: 0 in 0.668s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:42:22 devstack sudo[97068]: pam_unix(sudo:session): session closed for user root Jun 17 05:42:22 devstack cinder-volume[92083]: DEBUG cinder.coordination [req-7367d963-8101-4951-ac2f-9cbf3be2cec8 req-249aeca2-2d41-4004-bc95-d509d1902412 tempest-VolumesSnapshotsTestJSON-2017906004 None] Lock "cinder-quobyte-757e994a-2847-43b5-8424-2f4bfe365d55" released by "_delete_snapshot" :: held 3.206s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:42:22 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-797dd2ed-2455-4b24-b391-6d812ceddaa9 tempest-VolumesListAdminTestJSON-1995670669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a8f0f309-5bd6-4e8a-bf3c-f01711e65086 1073741824" returned: 0 in 0.829s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:42:22 devstack cinder-volume[92083]: DEBUG cinder.coordination [req-7367d963-8101-4951-ac2f-9cbf3be2cec8 req-249aeca2-2d41-4004-bc95-d509d1902412 tempest-VolumesSnapshotsTestJSON-2017906004 None] Lock "cinder-quobyte-22d183f5-fa81-44a6-8914-bc9207ba77a2" released by "delete_snapshot" :: held 3.241s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:42:22 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-797dd2ed-2455-4b24-b391-6d812ceddaa9 tempest-VolumesListAdminTestJSON-1995670669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a8f0f309-5bd6-4e8a-bf3c-f01711e65086 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:42:22 devstack sudo[97077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a8f0f309-5bd6-4e8a-bf3c-f01711e65086 Jun 17 05:42:22 devstack sudo[97077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:42:22 devstack cinder-volume[92083]: DEBUG cinder.quota [req-7367d963-8101-4951-ac2f-9cbf3be2cec8 req-249aeca2-2d41-4004-bc95-d509d1902412 tempest-VolumesSnapshotsTestJSON-2017906004 None] Created reservations ['bb5bbcb4-9a65-4ae9-a24e-6e21b19781a3', '7d4a4c94-96a1-4b64-ab26-4e77d1f1bad1', '836aa185-79d0-4215-8da4-2fce5d68a3dd', 'b9a5e4e7-7bb4-4f1b-921a-3b05ba49b673'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:42:22 devstack cinder-volume[92083]: INFO cinder.volume.manager [req-7367d963-8101-4951-ac2f-9cbf3be2cec8 req-249aeca2-2d41-4004-bc95-d509d1902412 tempest-VolumesSnapshotsTestJSON-2017906004 None] Delete snapshot completed successfully. Jun 17 05:42:22 devstack cinder-volume[92083]: DEBUG cinder.coordination [req-7367d963-8101-4951-ac2f-9cbf3be2cec8 req-249aeca2-2d41-4004-bc95-d509d1902412 tempest-VolumesSnapshotsTestJSON-2017906004 None] Lock "cinder-757e994a-2847-43b5-8424-2f4bfe365d55-delete_snapshot" released by "delete_snapshot" :: held 3.456s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:42:22 devstack sudo[97077]: pam_unix(sudo:session): session closed for user root Jun 17 05:42:22 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-797dd2ed-2455-4b24-b391-6d812ceddaa9 tempest-VolumesListAdminTestJSON-1995670669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a8f0f309-5bd6-4e8a-bf3c-f01711e65086" returned: 0 in 0.680s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:42:22 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-797dd2ed-2455-4b24-b391-6d812ceddaa9 tempest-VolumesListAdminTestJSON-1995670669 None] <== create_volume: return (1579ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:42:22 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-797dd2ed-2455-4b24-b391-6d812ceddaa9 tempest-VolumesListAdminTestJSON-1995670669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.583s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:42:22 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-797dd2ed-2455-4b24-b391-6d812ceddaa9 tempest-VolumesListAdminTestJSON-1995670669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6529571-68af-4e68-a720-1f7ff5265334) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8f0f309-5bd6-4e8a-bf3c-f01711e65086', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:42:22 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-797dd2ed-2455-4b24-b391-6d812ceddaa9 tempest-VolumesListAdminTestJSON-1995670669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (262a4861-57c3-4b34-91a1-9dbf1e06bff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:42:22 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-797dd2ed-2455-4b24-b391-6d812ceddaa9 tempest-VolumesListAdminTestJSON-1995670669 None] Volume volume-a8f0f309-5bd6-4e8a-bf3c-f01711e65086 (a8f0f309-5bd6-4e8a-bf3c-f01711e65086): created successfully Jun 17 05:42:22 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-797dd2ed-2455-4b24-b391-6d812ceddaa9 tempest-VolumesListAdminTestJSON-1995670669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (262a4861-57c3-4b34-91a1-9dbf1e06bff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:42:22 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-797dd2ed-2455-4b24-b391-6d812ceddaa9 tempest-VolumesListAdminTestJSON-1995670669 None] Flow 'volume_create_manager' (3333f815-6f73-4dfb-8116-a6585a78ec16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:42:22 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-797dd2ed-2455-4b24-b391-6d812ceddaa9 tempest-VolumesListAdminTestJSON-1995670669 None] Created volume successfully. Jun 17 05:42:23 devstack cinder-volume[92083]: DEBUG cinder.coordination [req-2cdd13b4-98a0-4fe5-803c-140b7f6b47b0 req-ebe1141a-4670-4a8d-925b-29b3f6b28430 tempest-VolumesSnapshotsTestJSON-2017906004 None] Acquiring lock "cinder-22d183f5-fa81-44a6-8914-bc9207ba77a2-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:42:23 devstack cinder-volume[92083]: DEBUG cinder.coordination [req-2cdd13b4-98a0-4fe5-803c-140b7f6b47b0 req-ebe1141a-4670-4a8d-925b-29b3f6b28430 tempest-VolumesSnapshotsTestJSON-2017906004 None] Lock "cinder-22d183f5-fa81-44a6-8914-bc9207ba77a2-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:42:23 devstack cinder-volume[92083]: DEBUG cinder.coordination [req-2cdd13b4-98a0-4fe5-803c-140b7f6b47b0 req-ebe1141a-4670-4a8d-925b-29b3f6b28430 tempest-VolumesSnapshotsTestJSON-2017906004 None] Acquiring lock "cinder-quobyte-22d183f5-fa81-44a6-8914-bc9207ba77a2" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:42:23 devstack cinder-volume[92083]: DEBUG cinder.coordination [req-2cdd13b4-98a0-4fe5-803c-140b7f6b47b0 req-ebe1141a-4670-4a8d-925b-29b3f6b28430 tempest-VolumesSnapshotsTestJSON-2017906004 None] Lock "cinder-quobyte-22d183f5-fa81-44a6-8914-bc9207ba77a2" acquired by "delete_volume" :: waited 0.021s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:42:23 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[1345ae34-88d4-4f0a-b33d-913b50147978]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:42:23 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-2cdd13b4-98a0-4fe5-803c-140b7f6b47b0 req-ebe1141a-4670-4a8d-925b-29b3f6b28430 tempest-VolumesSnapshotsTestJSON-2017906004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-22d183f5-fa81-44a6-8914-bc9207ba77a2 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:42:23 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-60b0560c-a840-4938-ab3f-134c89322592 tempest-VolumesListAdminTestJSON-1995670669 None] Acquiring lock "cinder-a8f0f309-5bd6-4e8a-bf3c-f01711e65086-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:42:23 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-60b0560c-a840-4938-ab3f-134c89322592 tempest-VolumesListAdminTestJSON-1995670669 None] Lock "cinder-a8f0f309-5bd6-4e8a-bf3c-f01711e65086-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:42:23 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-60b0560c-a840-4938-ab3f-134c89322592 tempest-VolumesListAdminTestJSON-1995670669 None] Acquiring lock "cinder-quobyte-a8f0f309-5bd6-4e8a-bf3c-f01711e65086" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:42:23 devstack sudo[97117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-22d183f5-fa81-44a6-8914-bc9207ba77a2 Jun 17 05:42:23 devstack sudo[97117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:42:23 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-60b0560c-a840-4938-ab3f-134c89322592 tempest-VolumesListAdminTestJSON-1995670669 None] Lock "cinder-quobyte-a8f0f309-5bd6-4e8a-bf3c-f01711e65086" acquired by "delete_volume" :: waited 0.022s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:42:23 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c533ab6-ce18-40ac-8951-d1cf8da6e732]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:42:23 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-60b0560c-a840-4938-ab3f-134c89322592 tempest-VolumesListAdminTestJSON-1995670669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a8f0f309-5bd6-4e8a-bf3c-f01711e65086 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:42:23 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-cffe44c4-340a-44b4-a8d5-d7bdf0f7735b tempest-VolumesListAdminTestJSON-997131928 None] Acquiring lock "cinder-ed281854-d17a-4e6a-82f7-7b8ad19c407e-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:42:23 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-cffe44c4-340a-44b4-a8d5-d7bdf0f7735b tempest-VolumesListAdminTestJSON-997131928 None] Lock "cinder-ed281854-d17a-4e6a-82f7-7b8ad19c407e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:42:23 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-cffe44c4-340a-44b4-a8d5-d7bdf0f7735b tempest-VolumesListAdminTestJSON-997131928 None] Acquiring lock "cinder-quobyte-ed281854-d17a-4e6a-82f7-7b8ad19c407e" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:42:23 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-cffe44c4-340a-44b4-a8d5-d7bdf0f7735b tempest-VolumesListAdminTestJSON-997131928 None] Lock "cinder-quobyte-ed281854-d17a-4e6a-82f7-7b8ad19c407e" acquired by "delete_volume" :: waited 0.027s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:42:23 devstack sudo[97119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a8f0f309-5bd6-4e8a-bf3c-f01711e65086 Jun 17 05:42:23 devstack sudo[97119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:42:23 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaea6b7e-6eab-4e21-9ed0-4e969f615f7f]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:42:23 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-cffe44c4-340a-44b4-a8d5-d7bdf0f7735b tempest-VolumesListAdminTestJSON-997131928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ed281854-d17a-4e6a-82f7-7b8ad19c407e {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:42:23 devstack sudo[97121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ed281854-d17a-4e6a-82f7-7b8ad19c407e Jun 17 05:42:23 devstack sudo[97121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:42:24 devstack sudo[97117]: pam_unix(sudo:session): session closed for user root Jun 17 05:42:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-2cdd13b4-98a0-4fe5-803c-140b7f6b47b0 req-ebe1141a-4670-4a8d-925b-29b3f6b28430 tempest-VolumesSnapshotsTestJSON-2017906004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-22d183f5-fa81-44a6-8914-bc9207ba77a2" returned: 0 in 0.803s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:42:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-2cdd13b4-98a0-4fe5-803c-140b7f6b47b0 req-ebe1141a-4670-4a8d-925b-29b3f6b28430 tempest-VolumesSnapshotsTestJSON-2017906004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-22d183f5-fa81-44a6-8914-bc9207ba77a2 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:42:24 devstack sudo[97128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-22d183f5-fa81-44a6-8914-bc9207ba77a2 Jun 17 05:42:24 devstack sudo[97128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:42:24 devstack sudo[97119]: pam_unix(sudo:session): session closed for user root Jun 17 05:42:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-60b0560c-a840-4938-ab3f-134c89322592 tempest-VolumesListAdminTestJSON-1995670669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a8f0f309-5bd6-4e8a-bf3c-f01711e65086" returned: 0 in 0.844s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:42:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-60b0560c-a840-4938-ab3f-134c89322592 tempest-VolumesListAdminTestJSON-1995670669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a8f0f309-5bd6-4e8a-bf3c-f01711e65086 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:42:24 devstack sudo[97135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a8f0f309-5bd6-4e8a-bf3c-f01711e65086 Jun 17 05:42:24 devstack sudo[97135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:42:24 devstack sudo[97121]: pam_unix(sudo:session): session closed for user root Jun 17 05:42:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-cffe44c4-340a-44b4-a8d5-d7bdf0f7735b tempest-VolumesListAdminTestJSON-997131928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ed281854-d17a-4e6a-82f7-7b8ad19c407e" returned: 0 in 0.923s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:42:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-cffe44c4-340a-44b4-a8d5-d7bdf0f7735b tempest-VolumesListAdminTestJSON-997131928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ed281854-d17a-4e6a-82f7-7b8ad19c407e {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:42:24 devstack sudo[97137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ed281854-d17a-4e6a-82f7-7b8ad19c407e Jun 17 05:42:24 devstack sudo[97137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:42:25 devstack sudo[97128]: pam_unix(sudo:session): session closed for user root Jun 17 05:42:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-2cdd13b4-98a0-4fe5-803c-140b7f6b47b0 req-ebe1141a-4670-4a8d-925b-29b3f6b28430 tempest-VolumesSnapshotsTestJSON-2017906004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-22d183f5-fa81-44a6-8914-bc9207ba77a2" returned: 0 in 0.773s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:42:25 devstack cinder-volume[92083]: DEBUG cinder.coordination [req-2cdd13b4-98a0-4fe5-803c-140b7f6b47b0 req-ebe1141a-4670-4a8d-925b-29b3f6b28430 tempest-VolumesSnapshotsTestJSON-2017906004 None] Lock "cinder-quobyte-22d183f5-fa81-44a6-8914-bc9207ba77a2" released by "delete_volume" :: held 1.672s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:42:25 devstack cinder-volume[92083]: DEBUG cinder.quota [req-2cdd13b4-98a0-4fe5-803c-140b7f6b47b0 req-ebe1141a-4670-4a8d-925b-29b3f6b28430 tempest-VolumesSnapshotsTestJSON-2017906004 None] Created reservations ['c29374e2-fc15-481d-83d1-ccc8955806c5', '91773e09-f34d-44eb-833c-817a7c6e8774', 'be940a29-5fd4-4205-b203-0820d938dee7', 'b4843d22-7d5d-47c4-981d-6258d878fad2'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:42:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-2cdd13b4-98a0-4fe5-803c-140b7f6b47b0 req-ebe1141a-4670-4a8d-925b-29b3f6b28430 tempest-VolumesSnapshotsTestJSON-2017906004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:42:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-2cdd13b4-98a0-4fe5-803c-140b7f6b47b0 req-ebe1141a-4670-4a8d-925b-29b3f6b28430 tempest-VolumesSnapshotsTestJSON-2017906004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:42:25 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [req-2cdd13b4-98a0-4fe5-803c-140b7f6b47b0 req-ebe1141a-4670-4a8d-925b-29b3f6b28430 tempest-VolumesSnapshotsTestJSON-2017906004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:42:25 devstack sudo[97135]: pam_unix(sudo:session): session closed for user root Jun 17 05:42:25 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [req-2cdd13b4-98a0-4fe5-803c-140b7f6b47b0 req-ebe1141a-4670-4a8d-925b-29b3f6b28430 tempest-VolumesSnapshotsTestJSON-2017906004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:42:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-2cdd13b4-98a0-4fe5-803c-140b7f6b47b0 req-ebe1141a-4670-4a8d-925b-29b3f6b28430 tempest-VolumesSnapshotsTestJSON-2017906004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:42:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-2cdd13b4-98a0-4fe5-803c-140b7f6b47b0 req-ebe1141a-4670-4a8d-925b-29b3f6b28430 tempest-VolumesSnapshotsTestJSON-2017906004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:42:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-60b0560c-a840-4938-ab3f-134c89322592 tempest-VolumesListAdminTestJSON-1995670669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a8f0f309-5bd6-4e8a-bf3c-f01711e65086" returned: 0 in 0.740s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:42:25 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-60b0560c-a840-4938-ab3f-134c89322592 tempest-VolumesListAdminTestJSON-1995670669 None] Lock "cinder-quobyte-a8f0f309-5bd6-4e8a-bf3c-f01711e65086" released by "delete_volume" :: held 1.639s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:42:25 devstack sudo[97141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:42:25 devstack sudo[97141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:42:25 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-60b0560c-a840-4938-ab3f-134c89322592 tempest-VolumesListAdminTestJSON-1995670669 None] Created reservations ['b80fa636-2e35-42d5-9a8a-ed489ac5a74e', 'd22ca1ff-7fec-4a49-a2c2-e84dcbfdc8e4', '4cc53c23-bcf7-4225-b673-325a5440d328', '344b3a38-a2a8-41a9-b539-87abf2e706a1'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:42:25 devstack sudo[97137]: pam_unix(sudo:session): session closed for user root Jun 17 05:42:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-cffe44c4-340a-44b4-a8d5-d7bdf0f7735b tempest-VolumesListAdminTestJSON-997131928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ed281854-d17a-4e6a-82f7-7b8ad19c407e" returned: 0 in 0.715s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:42:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-60b0560c-a840-4938-ab3f-134c89322592 tempest-VolumesListAdminTestJSON-1995670669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:42:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-60b0560c-a840-4938-ab3f-134c89322592 tempest-VolumesListAdminTestJSON-1995670669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:42:25 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-60b0560c-a840-4938-ab3f-134c89322592 tempest-VolumesListAdminTestJSON-1995670669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:42:25 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-60b0560c-a840-4938-ab3f-134c89322592 tempest-VolumesListAdminTestJSON-1995670669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:42:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-60b0560c-a840-4938-ab3f-134c89322592 tempest-VolumesListAdminTestJSON-1995670669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:42:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-60b0560c-a840-4938-ab3f-134c89322592 tempest-VolumesListAdminTestJSON-1995670669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:42:25 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-cffe44c4-340a-44b4-a8d5-d7bdf0f7735b tempest-VolumesListAdminTestJSON-997131928 None] Lock "cinder-quobyte-ed281854-d17a-4e6a-82f7-7b8ad19c407e" released by "delete_volume" :: held 1.701s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:42:25 devstack sudo[97144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:42:25 devstack sudo[97144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:42:25 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-cffe44c4-340a-44b4-a8d5-d7bdf0f7735b tempest-VolumesListAdminTestJSON-997131928 None] Created reservations ['99f45b47-543b-4ba2-a6d1-11ee02f6fe04', '47400ece-6dae-4799-8bd5-e3694fe6efcf', 'eaaf275e-bdf6-4dc6-8d0a-ed96d262e1c4', '9d93ff4a-34a6-44cc-80cd-c5bf955b13a2'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:42:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-cffe44c4-340a-44b4-a8d5-d7bdf0f7735b tempest-VolumesListAdminTestJSON-997131928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:42:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-cffe44c4-340a-44b4-a8d5-d7bdf0f7735b tempest-VolumesListAdminTestJSON-997131928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:42:25 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-cffe44c4-340a-44b4-a8d5-d7bdf0f7735b tempest-VolumesListAdminTestJSON-997131928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:42:25 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-cffe44c4-340a-44b4-a8d5-d7bdf0f7735b tempest-VolumesListAdminTestJSON-997131928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:42:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-cffe44c4-340a-44b4-a8d5-d7bdf0f7735b tempest-VolumesListAdminTestJSON-997131928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:42:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-cffe44c4-340a-44b4-a8d5-d7bdf0f7735b tempest-VolumesListAdminTestJSON-997131928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:42:25 devstack sudo[97146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:42:25 devstack sudo[97146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:42:26 devstack sudo[97141]: pam_unix(sudo:session): session closed for user root Jun 17 05:42:26 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-2cdd13b4-98a0-4fe5-803c-140b7f6b47b0 req-ebe1141a-4670-4a8d-925b-29b3f6b28430 tempest-VolumesSnapshotsTestJSON-2017906004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.869s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:42:26 devstack cinder-volume[92083]: DEBUG cinder.manager [req-2cdd13b4-98a0-4fe5-803c-140b7f6b47b0 req-ebe1141a-4670-4a8d-925b-29b3f6b28430 tempest-VolumesSnapshotsTestJSON-2017906004 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:42:26 devstack cinder-volume[92083]: INFO cinder.volume.manager [req-2cdd13b4-98a0-4fe5-803c-140b7f6b47b0 req-ebe1141a-4670-4a8d-925b-29b3f6b28430 tempest-VolumesSnapshotsTestJSON-2017906004 None] Deleted volume successfully. Jun 17 05:42:26 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-729b68b4-1beb-4a1f-8210-63fffc11bfd1 tempest-VolumesListAdminTestJSON-997131928 None] Acquiring lock "cinder-1190bca0-f86e-4961-8131-28927b5ad324-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:42:26 devstack cinder-volume[92083]: DEBUG cinder.coordination [req-2cdd13b4-98a0-4fe5-803c-140b7f6b47b0 req-ebe1141a-4670-4a8d-925b-29b3f6b28430 tempest-VolumesSnapshotsTestJSON-2017906004 None] Lock "cinder-22d183f5-fa81-44a6-8914-bc9207ba77a2-delete_volume" released by "delete_volume" :: held 2.808s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:42:26 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-729b68b4-1beb-4a1f-8210-63fffc11bfd1 tempest-VolumesListAdminTestJSON-997131928 None] Lock "cinder-1190bca0-f86e-4961-8131-28927b5ad324-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:42:26 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-729b68b4-1beb-4a1f-8210-63fffc11bfd1 tempest-VolumesListAdminTestJSON-997131928 None] Acquiring lock "cinder-quobyte-1190bca0-f86e-4961-8131-28927b5ad324" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:42:26 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-729b68b4-1beb-4a1f-8210-63fffc11bfd1 tempest-VolumesListAdminTestJSON-997131928 None] Lock "cinder-quobyte-1190bca0-f86e-4961-8131-28927b5ad324" acquired by "delete_volume" :: waited 0.025s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:42:26 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9cd7a17-bcff-44ba-adc6-22d81c5eb9b8]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:42:26 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-729b68b4-1beb-4a1f-8210-63fffc11bfd1 tempest-VolumesListAdminTestJSON-997131928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1190bca0-f86e-4961-8131-28927b5ad324 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:42:26 devstack sudo[97144]: pam_unix(sudo:session): session closed for user root Jun 17 05:42:26 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-60b0560c-a840-4938-ab3f-134c89322592 tempest-VolumesListAdminTestJSON-1995670669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.893s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:42:26 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-60b0560c-a840-4938-ab3f-134c89322592 tempest-VolumesListAdminTestJSON-1995670669 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:42:26 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-60b0560c-a840-4938-ab3f-134c89322592 tempest-VolumesListAdminTestJSON-1995670669 None] Deleted volume successfully. Jun 17 05:42:26 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-60b0560c-a840-4938-ab3f-134c89322592 tempest-VolumesListAdminTestJSON-1995670669 None] Lock "cinder-a8f0f309-5bd6-4e8a-bf3c-f01711e65086-delete_volume" released by "delete_volume" :: held 2.852s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:42:26 devstack sudo[97150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1190bca0-f86e-4961-8131-28927b5ad324 Jun 17 05:42:26 devstack sudo[97150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:42:26 devstack sudo[97146]: pam_unix(sudo:session): session closed for user root Jun 17 05:42:26 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-cffe44c4-340a-44b4-a8d5-d7bdf0f7735b tempest-VolumesListAdminTestJSON-997131928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.993s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:42:26 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-cffe44c4-340a-44b4-a8d5-d7bdf0f7735b tempest-VolumesListAdminTestJSON-997131928 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:42:26 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-cffe44c4-340a-44b4-a8d5-d7bdf0f7735b tempest-VolumesListAdminTestJSON-997131928 None] Deleted volume successfully. Jun 17 05:42:26 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-cffe44c4-340a-44b4-a8d5-d7bdf0f7735b tempest-VolumesListAdminTestJSON-997131928 None] Lock "cinder-ed281854-d17a-4e6a-82f7-7b8ad19c407e-delete_volume" released by "delete_volume" :: held 2.918s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:42:27 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-82b5413d-fc7b-4e19-ae3b-34b5c1d65f94 tempest-AttachVolumeShelveTestJSON-18917466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:42:27 devstack sudo[97150]: pam_unix(sudo:session): session closed for user root Jun 17 05:42:27 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-82b5413d-fc7b-4e19-ae3b-34b5c1d65f94 tempest-AttachVolumeShelveTestJSON-18917466 None] Flow 'volume_create_manager' (9c88c16d-7e28-41d0-9832-edfd5fc26c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:42:27 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-82b5413d-fc7b-4e19-ae3b-34b5c1d65f94 tempest-AttachVolumeShelveTestJSON-18917466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17c04a91-fbb7-45d6-aefb-ac51305e32e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:42:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-729b68b4-1beb-4a1f-8210-63fffc11bfd1 tempest-VolumesListAdminTestJSON-997131928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1190bca0-f86e-4961-8131-28927b5ad324" returned: 0 in 1.092s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:42:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-729b68b4-1beb-4a1f-8210-63fffc11bfd1 tempest-VolumesListAdminTestJSON-997131928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1190bca0-f86e-4961-8131-28927b5ad324 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:42:27 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-82b5413d-fc7b-4e19-ae3b-34b5c1d65f94 tempest-AttachVolumeShelveTestJSON-18917466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17c04a91-fbb7-45d6-aefb-ac51305e32e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:42:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-349458217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bc4ff05-fc19-4d1e-bab3-dba182bab2c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93ca4f29b39d454f99f68638ab30a62e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:42:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:42:27Z,use_quota=True,user_id='04ec6a2cee2a4296b212ab142a01446d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:42:27 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-82b5413d-fc7b-4e19-ae3b-34b5c1d65f94 tempest-AttachVolumeShelveTestJSON-18917466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49d210ea-4434-4237-9b6e-4e188b3f3391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:42:27 devstack sudo[97158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1190bca0-f86e-4961-8131-28927b5ad324 Jun 17 05:42:27 devstack sudo[97158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:42:27 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-82b5413d-fc7b-4e19-ae3b-34b5c1d65f94 tempest-AttachVolumeShelveTestJSON-18917466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49d210ea-4434-4237-9b6e-4e188b3f3391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:42:27 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-82b5413d-fc7b-4e19-ae3b-34b5c1d65f94 tempest-AttachVolumeShelveTestJSON-18917466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d63ced5-8c1d-47fa-b81e-b682b27c4a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:42:27 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-82b5413d-fc7b-4e19-ae3b-34b5c1d65f94 tempest-AttachVolumeShelveTestJSON-18917466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d63ced5-8c1d-47fa-b81e-b682b27c4a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bc4ff05-fc19-4d1e-bab3-dba182bab2c1', 'volume_name': 'volume-4bc4ff05-fc19-4d1e-bab3-dba182bab2c1', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:42:27 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-82b5413d-fc7b-4e19-ae3b-34b5c1d65f94 tempest-AttachVolumeShelveTestJSON-18917466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (465dc741-5b1c-4330-b4a7-b04480c2942c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:42:27 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-82b5413d-fc7b-4e19-ae3b-34b5c1d65f94 tempest-AttachVolumeShelveTestJSON-18917466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (465dc741-5b1c-4330-b4a7-b04480c2942c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:42:27 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-82b5413d-fc7b-4e19-ae3b-34b5c1d65f94 tempest-AttachVolumeShelveTestJSON-18917466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eecf743b-d2d0-4ee1-a9cd-3978af301ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:42:27 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-82b5413d-fc7b-4e19-ae3b-34b5c1d65f94 tempest-AttachVolumeShelveTestJSON-18917466 None] Volume 4bc4ff05-fc19-4d1e-bab3-dba182bab2c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bc4ff05-fc19-4d1e-bab3-dba182bab2c1', 'volume_size': 1} Jun 17 05:42:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-82b5413d-fc7b-4e19-ae3b-34b5c1d65f94 tempest-AttachVolumeShelveTestJSON-18917466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:42:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-82b5413d-fc7b-4e19-ae3b-34b5c1d65f94 tempest-AttachVolumeShelveTestJSON-18917466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:42:27 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-82b5413d-fc7b-4e19-ae3b-34b5c1d65f94 tempest-AttachVolumeShelveTestJSON-18917466 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:42:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-349458217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bc4ff05-fc19-4d1e-bab3-dba182bab2c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93ca4f29b39d454f99f68638ab30a62e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:42:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:42:27Z,use_quota=True,user_id='04ec6a2cee2a4296b212ab142a01446d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:42:27 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-82b5413d-fc7b-4e19-ae3b-34b5c1d65f94 tempest-AttachVolumeShelveTestJSON-18917466 None] Creating volume 4bc4ff05-fc19-4d1e-bab3-dba182bab2c1 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:42:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-82b5413d-fc7b-4e19-ae3b-34b5c1d65f94 tempest-AttachVolumeShelveTestJSON-18917466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:42:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-82b5413d-fc7b-4e19-ae3b-34b5c1d65f94 tempest-AttachVolumeShelveTestJSON-18917466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:42:27 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-82b5413d-fc7b-4e19-ae3b-34b5c1d65f94 tempest-AttachVolumeShelveTestJSON-18917466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:42:27 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-82b5413d-fc7b-4e19-ae3b-34b5c1d65f94 tempest-AttachVolumeShelveTestJSON-18917466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:42:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-82b5413d-fc7b-4e19-ae3b-34b5c1d65f94 tempest-AttachVolumeShelveTestJSON-18917466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:42:27 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-82b5413d-fc7b-4e19-ae3b-34b5c1d65f94 tempest-AttachVolumeShelveTestJSON-18917466 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:42:27 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-82b5413d-fc7b-4e19-ae3b-34b5c1d65f94 tempest-AttachVolumeShelveTestJSON-18917466 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:42:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-82b5413d-fc7b-4e19-ae3b-34b5c1d65f94 tempest-AttachVolumeShelveTestJSON-18917466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4bc4ff05-fc19-4d1e-bab3-dba182bab2c1 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:42:27 devstack sudo[97160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4bc4ff05-fc19-4d1e-bab3-dba182bab2c1 1073741824 Jun 17 05:42:27 devstack sudo[97160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:42:27 devstack cinder-volume[92083]: DEBUG oslo_service.periodic_task [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92083) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 05:42:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:42:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:42:27 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:42:27 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:42:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:42:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:42:27 devstack sudo[97162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:42:27 devstack sudo[97162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:42:28 devstack sudo[97158]: pam_unix(sudo:session): session closed for user root Jun 17 05:42:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-729b68b4-1beb-4a1f-8210-63fffc11bfd1 tempest-VolumesListAdminTestJSON-997131928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1190bca0-f86e-4961-8131-28927b5ad324" returned: 0 in 0.917s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:42:28 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-729b68b4-1beb-4a1f-8210-63fffc11bfd1 tempest-VolumesListAdminTestJSON-997131928 None] Lock "cinder-quobyte-1190bca0-f86e-4961-8131-28927b5ad324" released by "delete_volume" :: held 2.082s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:42:28 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-729b68b4-1beb-4a1f-8210-63fffc11bfd1 tempest-VolumesListAdminTestJSON-997131928 None] Created reservations ['232ec3d5-1e5d-46dd-a7cf-c74c9e71f1eb', '16b0e954-f94e-4453-b1d0-6217ec0a7aa3', '21a92447-cd5c-48e1-a1c6-d400e9641dd5', 'be056cba-be1a-4a38-8be2-ccbd8a87403b'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:42:28 devstack sudo[97160]: pam_unix(sudo:session): session closed for user root Jun 17 05:42:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-82b5413d-fc7b-4e19-ae3b-34b5c1d65f94 tempest-AttachVolumeShelveTestJSON-18917466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4bc4ff05-fc19-4d1e-bab3-dba182bab2c1 1073741824" returned: 0 in 1.075s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:42:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-729b68b4-1beb-4a1f-8210-63fffc11bfd1 tempest-VolumesListAdminTestJSON-997131928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:42:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-729b68b4-1beb-4a1f-8210-63fffc11bfd1 tempest-VolumesListAdminTestJSON-997131928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:42:28 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-729b68b4-1beb-4a1f-8210-63fffc11bfd1 tempest-VolumesListAdminTestJSON-997131928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:42:28 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-729b68b4-1beb-4a1f-8210-63fffc11bfd1 tempest-VolumesListAdminTestJSON-997131928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:42:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-729b68b4-1beb-4a1f-8210-63fffc11bfd1 tempest-VolumesListAdminTestJSON-997131928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:42:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-729b68b4-1beb-4a1f-8210-63fffc11bfd1 tempest-VolumesListAdminTestJSON-997131928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:42:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-82b5413d-fc7b-4e19-ae3b-34b5c1d65f94 tempest-AttachVolumeShelveTestJSON-18917466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4bc4ff05-fc19-4d1e-bab3-dba182bab2c1 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:42:28 devstack sudo[97172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:42:28 devstack sudo[97172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:42:28 devstack sudo[97174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4bc4ff05-fc19-4d1e-bab3-dba182bab2c1 Jun 17 05:42:28 devstack sudo[97174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:42:28 devstack sudo[97162]: pam_unix(sudo:session): session closed for user root Jun 17 05:42:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 1.140s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:42:28 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:42:28 devstack cinder-volume[92083]: DEBUG oslo_service.periodic_task [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running periodic task VolumeManager._thread_info {{(pid=92083) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 05:42:28 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] thread count: 8 {{(pid=92083) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 17 05:42:28 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] thread info: [<_MainThread(MainThread, started 133483869905024)>, , , , , , , ] {{(pid=92083) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 17 05:42:29 devstack sudo[97172]: pam_unix(sudo:session): session closed for user root Jun 17 05:42:29 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-729b68b4-1beb-4a1f-8210-63fffc11bfd1 tempest-VolumesListAdminTestJSON-997131928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.770s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:42:29 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-729b68b4-1beb-4a1f-8210-63fffc11bfd1 tempest-VolumesListAdminTestJSON-997131928 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:42:29 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-729b68b4-1beb-4a1f-8210-63fffc11bfd1 tempest-VolumesListAdminTestJSON-997131928 None] Deleted volume successfully. Jun 17 05:42:29 devstack sudo[97174]: pam_unix(sudo:session): session closed for user root Jun 17 05:42:29 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-82b5413d-fc7b-4e19-ae3b-34b5c1d65f94 tempest-AttachVolumeShelveTestJSON-18917466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4bc4ff05-fc19-4d1e-bab3-dba182bab2c1" returned: 0 in 0.766s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:42:29 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-82b5413d-fc7b-4e19-ae3b-34b5c1d65f94 tempest-AttachVolumeShelveTestJSON-18917466 None] <== create_volume: return (1947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:42:29 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-82b5413d-fc7b-4e19-ae3b-34b5c1d65f94 tempest-AttachVolumeShelveTestJSON-18917466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.951s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:42:29 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-82b5413d-fc7b-4e19-ae3b-34b5c1d65f94 tempest-AttachVolumeShelveTestJSON-18917466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eecf743b-d2d0-4ee1-a9cd-3978af301ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bc4ff05-fc19-4d1e-bab3-dba182bab2c1', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:42:29 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-82b5413d-fc7b-4e19-ae3b-34b5c1d65f94 tempest-AttachVolumeShelveTestJSON-18917466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d193f298-1b61-4f67-aefc-12d67549dc4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:42:29 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-729b68b4-1beb-4a1f-8210-63fffc11bfd1 tempest-VolumesListAdminTestJSON-997131928 None] Lock "cinder-1190bca0-f86e-4961-8131-28927b5ad324-delete_volume" released by "delete_volume" :: held 3.286s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:42:29 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-82b5413d-fc7b-4e19-ae3b-34b5c1d65f94 tempest-AttachVolumeShelveTestJSON-18917466 None] Volume volume-4bc4ff05-fc19-4d1e-bab3-dba182bab2c1 (4bc4ff05-fc19-4d1e-bab3-dba182bab2c1): created successfully Jun 17 05:42:29 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-82b5413d-fc7b-4e19-ae3b-34b5c1d65f94 tempest-AttachVolumeShelveTestJSON-18917466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d193f298-1b61-4f67-aefc-12d67549dc4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:42:29 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-82b5413d-fc7b-4e19-ae3b-34b5c1d65f94 tempest-AttachVolumeShelveTestJSON-18917466 None] Flow 'volume_create_manager' (9c88c16d-7e28-41d0-9832-edfd5fc26c31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:42:29 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-82b5413d-fc7b-4e19-ae3b-34b5c1d65f94 tempest-AttachVolumeShelveTestJSON-18917466 None] Created volume successfully. Jun 17 05:42:29 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-0f65e87b-1fc7-4d81-beff-0d051bd8b25c tempest-VolumesListAdminTestJSON-997131928 None] Acquiring lock "cinder-9b452718-d7e8-4f55-bbb7-692fd4e59a92-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:42:29 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-0f65e87b-1fc7-4d81-beff-0d051bd8b25c tempest-VolumesListAdminTestJSON-997131928 None] Lock "cinder-9b452718-d7e8-4f55-bbb7-692fd4e59a92-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:42:29 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-0f65e87b-1fc7-4d81-beff-0d051bd8b25c tempest-VolumesListAdminTestJSON-997131928 None] Acquiring lock "cinder-quobyte-9b452718-d7e8-4f55-bbb7-692fd4e59a92" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:42:29 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-0f65e87b-1fc7-4d81-beff-0d051bd8b25c tempest-VolumesListAdminTestJSON-997131928 None] Lock "cinder-quobyte-9b452718-d7e8-4f55-bbb7-692fd4e59a92" acquired by "delete_volume" :: waited 0.021s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:42:29 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f5f0a0-b970-44e2-8729-32b6cf404e64]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:42:29 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0f65e87b-1fc7-4d81-beff-0d051bd8b25c tempest-VolumesListAdminTestJSON-997131928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9b452718-d7e8-4f55-bbb7-692fd4e59a92 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:42:29 devstack sudo[97180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9b452718-d7e8-4f55-bbb7-692fd4e59a92 Jun 17 05:42:29 devstack sudo[97180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:42:30 devstack sudo[97180]: pam_unix(sudo:session): session closed for user root Jun 17 05:42:30 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0f65e87b-1fc7-4d81-beff-0d051bd8b25c tempest-VolumesListAdminTestJSON-997131928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9b452718-d7e8-4f55-bbb7-692fd4e59a92" returned: 0 in 0.783s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:42:30 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0f65e87b-1fc7-4d81-beff-0d051bd8b25c tempest-VolumesListAdminTestJSON-997131928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9b452718-d7e8-4f55-bbb7-692fd4e59a92 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:42:30 devstack sudo[97189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9b452718-d7e8-4f55-bbb7-692fd4e59a92 Jun 17 05:42:30 devstack sudo[97189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:42:30 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [req-9db6853c-8d64-4e71-8335-67dcde9a58f1 req-9960501a-cc78-4c1a-ac1f-794c6ba1d034 tempest-VolumesGetTestJSON-337311054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:42:30 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [req-9db6853c-8d64-4e71-8335-67dcde9a58f1 req-9960501a-cc78-4c1a-ac1f-794c6ba1d034 tempest-VolumesGetTestJSON-337311054 None] Flow 'volume_create_manager' (7123a0ce-ffa2-4037-8493-3a2a83008b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:42:30 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [req-9db6853c-8d64-4e71-8335-67dcde9a58f1 req-9960501a-cc78-4c1a-ac1f-794c6ba1d034 tempest-VolumesGetTestJSON-337311054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (295a72f5-f8c6-46b8-a538-e101d259cf39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:42:30 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [req-9db6853c-8d64-4e71-8335-67dcde9a58f1 req-9960501a-cc78-4c1a-ac1f-794c6ba1d034 tempest-VolumesGetTestJSON-337311054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (295a72f5-f8c6-46b8-a538-e101d259cf39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:42:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-233678124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32d1c4e8-c66c-42f6-9041-444995482fb0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='51f1a620831c4dc18f09a876b084d028',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:42:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:42:31Z,use_quota=True,user_id='8e72599e2e034a63981dfe1b4056c906',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:42:30 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [req-9db6853c-8d64-4e71-8335-67dcde9a58f1 req-9960501a-cc78-4c1a-ac1f-794c6ba1d034 tempest-VolumesGetTestJSON-337311054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93bdb244-a104-46ad-a48e-bb705f6b15c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:42:30 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [req-9db6853c-8d64-4e71-8335-67dcde9a58f1 req-9960501a-cc78-4c1a-ac1f-794c6ba1d034 tempest-VolumesGetTestJSON-337311054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93bdb244-a104-46ad-a48e-bb705f6b15c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:42:30 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [req-9db6853c-8d64-4e71-8335-67dcde9a58f1 req-9960501a-cc78-4c1a-ac1f-794c6ba1d034 tempest-VolumesGetTestJSON-337311054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e6d9490-8705-4888-a9e8-ff39cba4e18c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:42:30 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [req-9db6853c-8d64-4e71-8335-67dcde9a58f1 req-9960501a-cc78-4c1a-ac1f-794c6ba1d034 tempest-VolumesGetTestJSON-337311054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e6d9490-8705-4888-a9e8-ff39cba4e18c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32d1c4e8-c66c-42f6-9041-444995482fb0', 'volume_name': 'volume-32d1c4e8-c66c-42f6-9041-444995482fb0', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:42:30 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [req-9db6853c-8d64-4e71-8335-67dcde9a58f1 req-9960501a-cc78-4c1a-ac1f-794c6ba1d034 tempest-VolumesGetTestJSON-337311054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ffd4e00-7d45-4de0-9e2b-e2da359bce86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:42:30 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [req-9db6853c-8d64-4e71-8335-67dcde9a58f1 req-9960501a-cc78-4c1a-ac1f-794c6ba1d034 tempest-VolumesGetTestJSON-337311054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ffd4e00-7d45-4de0-9e2b-e2da359bce86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:42:30 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [req-9db6853c-8d64-4e71-8335-67dcde9a58f1 req-9960501a-cc78-4c1a-ac1f-794c6ba1d034 tempest-VolumesGetTestJSON-337311054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9601df70-b731-4aac-af92-3980c434cba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:42:30 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [req-9db6853c-8d64-4e71-8335-67dcde9a58f1 req-9960501a-cc78-4c1a-ac1f-794c6ba1d034 tempest-VolumesGetTestJSON-337311054 None] Volume 32d1c4e8-c66c-42f6-9041-444995482fb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32d1c4e8-c66c-42f6-9041-444995482fb0', 'volume_size': 1} Jun 17 05:42:30 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-9db6853c-8d64-4e71-8335-67dcde9a58f1 req-9960501a-cc78-4c1a-ac1f-794c6ba1d034 tempest-VolumesGetTestJSON-337311054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:42:30 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-9db6853c-8d64-4e71-8335-67dcde9a58f1 req-9960501a-cc78-4c1a-ac1f-794c6ba1d034 tempest-VolumesGetTestJSON-337311054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:42:30 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [req-9db6853c-8d64-4e71-8335-67dcde9a58f1 req-9960501a-cc78-4c1a-ac1f-794c6ba1d034 tempest-VolumesGetTestJSON-337311054 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:42:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-233678124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32d1c4e8-c66c-42f6-9041-444995482fb0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='51f1a620831c4dc18f09a876b084d028',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:42:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:42:31Z,use_quota=True,user_id='8e72599e2e034a63981dfe1b4056c906',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:42:30 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [req-9db6853c-8d64-4e71-8335-67dcde9a58f1 req-9960501a-cc78-4c1a-ac1f-794c6ba1d034 tempest-VolumesGetTestJSON-337311054 None] Creating volume 32d1c4e8-c66c-42f6-9041-444995482fb0 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:42:30 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-9db6853c-8d64-4e71-8335-67dcde9a58f1 req-9960501a-cc78-4c1a-ac1f-794c6ba1d034 tempest-VolumesGetTestJSON-337311054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:42:30 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-9db6853c-8d64-4e71-8335-67dcde9a58f1 req-9960501a-cc78-4c1a-ac1f-794c6ba1d034 tempest-VolumesGetTestJSON-337311054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:42:30 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [req-9db6853c-8d64-4e71-8335-67dcde9a58f1 req-9960501a-cc78-4c1a-ac1f-794c6ba1d034 tempest-VolumesGetTestJSON-337311054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:42:30 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [req-9db6853c-8d64-4e71-8335-67dcde9a58f1 req-9960501a-cc78-4c1a-ac1f-794c6ba1d034 tempest-VolumesGetTestJSON-337311054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:42:30 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-9db6853c-8d64-4e71-8335-67dcde9a58f1 req-9960501a-cc78-4c1a-ac1f-794c6ba1d034 tempest-VolumesGetTestJSON-337311054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:42:30 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [req-9db6853c-8d64-4e71-8335-67dcde9a58f1 req-9960501a-cc78-4c1a-ac1f-794c6ba1d034 tempest-VolumesGetTestJSON-337311054 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:42:30 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [req-9db6853c-8d64-4e71-8335-67dcde9a58f1 req-9960501a-cc78-4c1a-ac1f-794c6ba1d034 tempest-VolumesGetTestJSON-337311054 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:42:30 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-9db6853c-8d64-4e71-8335-67dcde9a58f1 req-9960501a-cc78-4c1a-ac1f-794c6ba1d034 tempest-VolumesGetTestJSON-337311054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-32d1c4e8-c66c-42f6-9041-444995482fb0 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:42:30 devstack sudo[97191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-32d1c4e8-c66c-42f6-9041-444995482fb0 1073741824 Jun 17 05:42:30 devstack sudo[97191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:42:31 devstack sudo[97189]: pam_unix(sudo:session): session closed for user root Jun 17 05:42:31 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0f65e87b-1fc7-4d81-beff-0d051bd8b25c tempest-VolumesListAdminTestJSON-997131928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9b452718-d7e8-4f55-bbb7-692fd4e59a92" returned: 0 in 0.792s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:42:31 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-0f65e87b-1fc7-4d81-beff-0d051bd8b25c tempest-VolumesListAdminTestJSON-997131928 None] Lock "cinder-quobyte-9b452718-d7e8-4f55-bbb7-692fd4e59a92" released by "delete_volume" :: held 1.624s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:42:31 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-0f65e87b-1fc7-4d81-beff-0d051bd8b25c tempest-VolumesListAdminTestJSON-997131928 None] Created reservations ['66bd13be-13e8-4a66-a587-f806dc98004d', 'd0516f62-ac86-4a2c-b6cf-418b4e0a7d33', '05b0733e-b7e4-4b75-9b0f-7dc8315aa9b6', 'd2db7987-3c03-43d3-aa8b-2aad35172aaf'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:42:31 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-0f65e87b-1fc7-4d81-beff-0d051bd8b25c tempest-VolumesListAdminTestJSON-997131928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:42:31 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-0f65e87b-1fc7-4d81-beff-0d051bd8b25c tempest-VolumesListAdminTestJSON-997131928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:42:31 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-0f65e87b-1fc7-4d81-beff-0d051bd8b25c tempest-VolumesListAdminTestJSON-997131928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:42:31 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-0f65e87b-1fc7-4d81-beff-0d051bd8b25c tempest-VolumesListAdminTestJSON-997131928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:42:31 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-0f65e87b-1fc7-4d81-beff-0d051bd8b25c tempest-VolumesListAdminTestJSON-997131928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:42:31 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0f65e87b-1fc7-4d81-beff-0d051bd8b25c tempest-VolumesListAdminTestJSON-997131928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:42:31 devstack sudo[97199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:42:31 devstack sudo[97199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:42:31 devstack sudo[97191]: pam_unix(sudo:session): session closed for user root Jun 17 05:42:31 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-9db6853c-8d64-4e71-8335-67dcde9a58f1 req-9960501a-cc78-4c1a-ac1f-794c6ba1d034 tempest-VolumesGetTestJSON-337311054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-32d1c4e8-c66c-42f6-9041-444995482fb0 1073741824" returned: 0 in 0.898s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:42:31 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-9db6853c-8d64-4e71-8335-67dcde9a58f1 req-9960501a-cc78-4c1a-ac1f-794c6ba1d034 tempest-VolumesGetTestJSON-337311054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-32d1c4e8-c66c-42f6-9041-444995482fb0 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:42:31 devstack sudo[97203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-32d1c4e8-c66c-42f6-9041-444995482fb0 Jun 17 05:42:31 devstack sudo[97203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:42:32 devstack sudo[97199]: pam_unix(sudo:session): session closed for user root Jun 17 05:42:32 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0f65e87b-1fc7-4d81-beff-0d051bd8b25c tempest-VolumesListAdminTestJSON-997131928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.741s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:42:32 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-0f65e87b-1fc7-4d81-beff-0d051bd8b25c tempest-VolumesListAdminTestJSON-997131928 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:42:32 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-0f65e87b-1fc7-4d81-beff-0d051bd8b25c tempest-VolumesListAdminTestJSON-997131928 None] Deleted volume successfully. Jun 17 05:42:32 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-0f65e87b-1fc7-4d81-beff-0d051bd8b25c tempest-VolumesListAdminTestJSON-997131928 None] Lock "cinder-9b452718-d7e8-4f55-bbb7-692fd4e59a92-delete_volume" released by "delete_volume" :: held 2.616s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:42:32 devstack sudo[97203]: pam_unix(sudo:session): session closed for user root Jun 17 05:42:32 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-9db6853c-8d64-4e71-8335-67dcde9a58f1 req-9960501a-cc78-4c1a-ac1f-794c6ba1d034 tempest-VolumesGetTestJSON-337311054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-32d1c4e8-c66c-42f6-9041-444995482fb0" returned: 0 in 0.724s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:42:32 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [req-9db6853c-8d64-4e71-8335-67dcde9a58f1 req-9960501a-cc78-4c1a-ac1f-794c6ba1d034 tempest-VolumesGetTestJSON-337311054 None] <== create_volume: return (1672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:42:32 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-9db6853c-8d64-4e71-8335-67dcde9a58f1 req-9960501a-cc78-4c1a-ac1f-794c6ba1d034 tempest-VolumesGetTestJSON-337311054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.674s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:42:32 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [req-9db6853c-8d64-4e71-8335-67dcde9a58f1 req-9960501a-cc78-4c1a-ac1f-794c6ba1d034 tempest-VolumesGetTestJSON-337311054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9601df70-b731-4aac-af92-3980c434cba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32d1c4e8-c66c-42f6-9041-444995482fb0', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:42:32 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [req-9db6853c-8d64-4e71-8335-67dcde9a58f1 req-9960501a-cc78-4c1a-ac1f-794c6ba1d034 tempest-VolumesGetTestJSON-337311054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcf08e01-01b2-48e9-8b46-9d137948d0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:42:32 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [req-9db6853c-8d64-4e71-8335-67dcde9a58f1 req-9960501a-cc78-4c1a-ac1f-794c6ba1d034 tempest-VolumesGetTestJSON-337311054 None] Volume volume-32d1c4e8-c66c-42f6-9041-444995482fb0 (32d1c4e8-c66c-42f6-9041-444995482fb0): created successfully Jun 17 05:42:32 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [req-9db6853c-8d64-4e71-8335-67dcde9a58f1 req-9960501a-cc78-4c1a-ac1f-794c6ba1d034 tempest-VolumesGetTestJSON-337311054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcf08e01-01b2-48e9-8b46-9d137948d0b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:42:32 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [req-9db6853c-8d64-4e71-8335-67dcde9a58f1 req-9960501a-cc78-4c1a-ac1f-794c6ba1d034 tempest-VolumesGetTestJSON-337311054 None] Flow 'volume_create_manager' (7123a0ce-ffa2-4037-8493-3a2a83008b53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:42:32 devstack cinder-volume[92083]: INFO cinder.volume.manager [req-9db6853c-8d64-4e71-8335-67dcde9a58f1 req-9960501a-cc78-4c1a-ac1f-794c6ba1d034 tempest-VolumesGetTestJSON-337311054 None] Created volume successfully. Jun 17 05:42:33 devstack cinder-volume[92083]: DEBUG cinder.coordination [req-c2c5fc57-d04d-44aa-95a0-3b3144faa948 req-c876719f-0ac9-4a94-8c07-74b87aa8531c tempest-VolumesGetTestJSON-337311054 None] Acquiring lock "cinder-32d1c4e8-c66c-42f6-9041-444995482fb0-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:42:33 devstack cinder-volume[92083]: DEBUG cinder.coordination [req-c2c5fc57-d04d-44aa-95a0-3b3144faa948 req-c876719f-0ac9-4a94-8c07-74b87aa8531c tempest-VolumesGetTestJSON-337311054 None] Lock "cinder-32d1c4e8-c66c-42f6-9041-444995482fb0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:42:33 devstack cinder-volume[92083]: DEBUG cinder.coordination [req-c2c5fc57-d04d-44aa-95a0-3b3144faa948 req-c876719f-0ac9-4a94-8c07-74b87aa8531c tempest-VolumesGetTestJSON-337311054 None] Acquiring lock "cinder-quobyte-32d1c4e8-c66c-42f6-9041-444995482fb0" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:42:33 devstack cinder-volume[92083]: DEBUG cinder.coordination [req-c2c5fc57-d04d-44aa-95a0-3b3144faa948 req-c876719f-0ac9-4a94-8c07-74b87aa8531c tempest-VolumesGetTestJSON-337311054 None] Lock "cinder-quobyte-32d1c4e8-c66c-42f6-9041-444995482fb0" acquired by "delete_volume" :: waited 0.026s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:42:33 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d62a74c-1dae-4611-8f5a-dca26dea372a]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:42:33 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-c2c5fc57-d04d-44aa-95a0-3b3144faa948 req-c876719f-0ac9-4a94-8c07-74b87aa8531c tempest-VolumesGetTestJSON-337311054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-32d1c4e8-c66c-42f6-9041-444995482fb0 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:42:34 devstack sudo[97245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-32d1c4e8-c66c-42f6-9041-444995482fb0 Jun 17 05:42:34 devstack sudo[97245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:42:34 devstack sudo[97245]: pam_unix(sudo:session): session closed for user root Jun 17 05:42:34 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-c2c5fc57-d04d-44aa-95a0-3b3144faa948 req-c876719f-0ac9-4a94-8c07-74b87aa8531c tempest-VolumesGetTestJSON-337311054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-32d1c4e8-c66c-42f6-9041-444995482fb0" returned: 0 in 0.997s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:42:34 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-c2c5fc57-d04d-44aa-95a0-3b3144faa948 req-c876719f-0ac9-4a94-8c07-74b87aa8531c tempest-VolumesGetTestJSON-337311054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-32d1c4e8-c66c-42f6-9041-444995482fb0 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:42:34 devstack sudo[97251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-32d1c4e8-c66c-42f6-9041-444995482fb0 Jun 17 05:42:34 devstack sudo[97251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:42:35 devstack sudo[97251]: pam_unix(sudo:session): session closed for user root Jun 17 05:42:35 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-c2c5fc57-d04d-44aa-95a0-3b3144faa948 req-c876719f-0ac9-4a94-8c07-74b87aa8531c tempest-VolumesGetTestJSON-337311054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-32d1c4e8-c66c-42f6-9041-444995482fb0" returned: 0 in 0.745s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:42:35 devstack cinder-volume[92083]: DEBUG cinder.coordination [req-c2c5fc57-d04d-44aa-95a0-3b3144faa948 req-c876719f-0ac9-4a94-8c07-74b87aa8531c tempest-VolumesGetTestJSON-337311054 None] Lock "cinder-quobyte-32d1c4e8-c66c-42f6-9041-444995482fb0" released by "delete_volume" :: held 1.808s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:42:35 devstack cinder-volume[92083]: DEBUG cinder.quota [req-c2c5fc57-d04d-44aa-95a0-3b3144faa948 req-c876719f-0ac9-4a94-8c07-74b87aa8531c tempest-VolumesGetTestJSON-337311054 None] Created reservations ['a6c25782-6ad6-4987-88a9-6ed656c36e98', '4816d941-0df6-44d7-b0b6-d2b639fcb747', '264af949-d065-42ec-88a5-eb0990138482', '98f8b81d-0d41-4442-b1c6-b9897d0e1ea3'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:42:35 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-c2c5fc57-d04d-44aa-95a0-3b3144faa948 req-c876719f-0ac9-4a94-8c07-74b87aa8531c tempest-VolumesGetTestJSON-337311054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:42:35 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-c2c5fc57-d04d-44aa-95a0-3b3144faa948 req-c876719f-0ac9-4a94-8c07-74b87aa8531c tempest-VolumesGetTestJSON-337311054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:42:35 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [req-c2c5fc57-d04d-44aa-95a0-3b3144faa948 req-c876719f-0ac9-4a94-8c07-74b87aa8531c tempest-VolumesGetTestJSON-337311054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:42:35 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [req-c2c5fc57-d04d-44aa-95a0-3b3144faa948 req-c876719f-0ac9-4a94-8c07-74b87aa8531c tempest-VolumesGetTestJSON-337311054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:42:35 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-c2c5fc57-d04d-44aa-95a0-3b3144faa948 req-c876719f-0ac9-4a94-8c07-74b87aa8531c tempest-VolumesGetTestJSON-337311054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:42:35 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-c2c5fc57-d04d-44aa-95a0-3b3144faa948 req-c876719f-0ac9-4a94-8c07-74b87aa8531c tempest-VolumesGetTestJSON-337311054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:42:35 devstack sudo[97254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:42:35 devstack sudo[97254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:42:36 devstack sudo[97254]: pam_unix(sudo:session): session closed for user root Jun 17 05:42:36 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-c2c5fc57-d04d-44aa-95a0-3b3144faa948 req-c876719f-0ac9-4a94-8c07-74b87aa8531c tempest-VolumesGetTestJSON-337311054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.744s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:42:36 devstack cinder-volume[92083]: DEBUG cinder.manager [req-c2c5fc57-d04d-44aa-95a0-3b3144faa948 req-c876719f-0ac9-4a94-8c07-74b87aa8531c tempest-VolumesGetTestJSON-337311054 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:42:36 devstack cinder-volume[92083]: INFO cinder.volume.manager [req-c2c5fc57-d04d-44aa-95a0-3b3144faa948 req-c876719f-0ac9-4a94-8c07-74b87aa8531c tempest-VolumesGetTestJSON-337311054 None] Deleted volume successfully. Jun 17 05:42:36 devstack cinder-volume[92083]: DEBUG cinder.coordination [req-c2c5fc57-d04d-44aa-95a0-3b3144faa948 req-c876719f-0ac9-4a94-8c07-74b87aa8531c tempest-VolumesGetTestJSON-337311054 None] Lock "cinder-32d1c4e8-c66c-42f6-9041-444995482fb0-delete_volume" released by "delete_volume" :: held 2.882s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:42:41 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-3732d9ad-0c79-411e-b165-4d7e0f22c273 tempest-GroupSnapshotsTest-649875217 None] Group tempest-GroupSnapshotsTest-Group-1902953862: creating Jun 17 05:42:41 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-12e04f88-9531-4e42-aa6f-d795fd614f35 tempest-VolumesMetadataTest-570277687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:42:41 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-12e04f88-9531-4e42-aa6f-d795fd614f35 tempest-VolumesMetadataTest-570277687 None] Flow 'volume_create_manager' (9813e26c-33e4-43ab-8721-e2b47f8b9d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:42:41 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-12e04f88-9531-4e42-aa6f-d795fd614f35 tempest-VolumesMetadataTest-570277687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a51150a8-b864-4e17-80f1-976989e102b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:42:41 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-3732d9ad-0c79-411e-b165-4d7e0f22c273 tempest-GroupSnapshotsTest-649875217 None] Group tempest-GroupSnapshotsTest-Group-1902953862: created successfully Jun 17 05:42:41 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-12e04f88-9531-4e42-aa6f-d795fd614f35 tempest-VolumesMetadataTest-570277687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a51150a8-b864-4e17-80f1-976989e102b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:42:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1251300479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41d21b92-e60b-4699-bca2-03b3a55fd086,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1531f475bf543859f5d3e4102bc0669',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:42:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:42:42Z,use_quota=True,user_id='b6f9321b83d94ef9820dee500800c44c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:42:42 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-12e04f88-9531-4e42-aa6f-d795fd614f35 tempest-VolumesMetadataTest-570277687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9279effb-7816-473b-a9c4-3224a1899192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:42:42 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-12e04f88-9531-4e42-aa6f-d795fd614f35 tempest-VolumesMetadataTest-570277687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9279effb-7816-473b-a9c4-3224a1899192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:42:42 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-12e04f88-9531-4e42-aa6f-d795fd614f35 tempest-VolumesMetadataTest-570277687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8b32e79-b7e4-4d10-a923-6ee3093a22ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:42:42 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-12e04f88-9531-4e42-aa6f-d795fd614f35 tempest-VolumesMetadataTest-570277687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8b32e79-b7e4-4d10-a923-6ee3093a22ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41d21b92-e60b-4699-bca2-03b3a55fd086', 'volume_name': 'volume-41d21b92-e60b-4699-bca2-03b3a55fd086', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:42:42 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-12e04f88-9531-4e42-aa6f-d795fd614f35 tempest-VolumesMetadataTest-570277687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a46cc4b6-7fb8-46a9-8158-1d2cd30fb18d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:42:42 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-12e04f88-9531-4e42-aa6f-d795fd614f35 tempest-VolumesMetadataTest-570277687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a46cc4b6-7fb8-46a9-8158-1d2cd30fb18d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:42:42 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-12e04f88-9531-4e42-aa6f-d795fd614f35 tempest-VolumesMetadataTest-570277687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e71d4a0-feb8-4603-83b5-e49e180e4871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:42:42 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-12e04f88-9531-4e42-aa6f-d795fd614f35 tempest-VolumesMetadataTest-570277687 None] Volume 41d21b92-e60b-4699-bca2-03b3a55fd086: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41d21b92-e60b-4699-bca2-03b3a55fd086', 'volume_size': 1} Jun 17 05:42:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-12e04f88-9531-4e42-aa6f-d795fd614f35 tempest-VolumesMetadataTest-570277687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:42:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-12e04f88-9531-4e42-aa6f-d795fd614f35 tempest-VolumesMetadataTest-570277687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:42:42 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-12e04f88-9531-4e42-aa6f-d795fd614f35 tempest-VolumesMetadataTest-570277687 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:42:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1251300479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41d21b92-e60b-4699-bca2-03b3a55fd086,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1531f475bf543859f5d3e4102bc0669',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:42:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:42:42Z,use_quota=True,user_id='b6f9321b83d94ef9820dee500800c44c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:42:42 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-12e04f88-9531-4e42-aa6f-d795fd614f35 tempest-VolumesMetadataTest-570277687 None] Creating volume 41d21b92-e60b-4699-bca2-03b3a55fd086 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:42:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-12e04f88-9531-4e42-aa6f-d795fd614f35 tempest-VolumesMetadataTest-570277687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:42:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-12e04f88-9531-4e42-aa6f-d795fd614f35 tempest-VolumesMetadataTest-570277687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:42:42 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-12e04f88-9531-4e42-aa6f-d795fd614f35 tempest-VolumesMetadataTest-570277687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:42:42 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-12e04f88-9531-4e42-aa6f-d795fd614f35 tempest-VolumesMetadataTest-570277687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:42:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-12e04f88-9531-4e42-aa6f-d795fd614f35 tempest-VolumesMetadataTest-570277687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:42:42 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-12e04f88-9531-4e42-aa6f-d795fd614f35 tempest-VolumesMetadataTest-570277687 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:42:42 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-12e04f88-9531-4e42-aa6f-d795fd614f35 tempest-VolumesMetadataTest-570277687 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:42:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-12e04f88-9531-4e42-aa6f-d795fd614f35 tempest-VolumesMetadataTest-570277687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-41d21b92-e60b-4699-bca2-03b3a55fd086 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:42:42 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-3732d9ad-0c79-411e-b165-4d7e0f22c273 tempest-GroupSnapshotsTest-649875217 None] Create group completed successfully. Jun 17 05:42:42 devstack sudo[97291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-41d21b92-e60b-4699-bca2-03b3a55fd086 1073741824 Jun 17 05:42:42 devstack sudo[97291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:42:43 devstack sudo[97291]: pam_unix(sudo:session): session closed for user root Jun 17 05:42:43 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-12e04f88-9531-4e42-aa6f-d795fd614f35 tempest-VolumesMetadataTest-570277687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-41d21b92-e60b-4699-bca2-03b3a55fd086 1073741824" returned: 0 in 1.473s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:42:43 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-12e04f88-9531-4e42-aa6f-d795fd614f35 tempest-VolumesMetadataTest-570277687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-41d21b92-e60b-4699-bca2-03b3a55fd086 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:42:43 devstack sudo[97384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-41d21b92-e60b-4699-bca2-03b3a55fd086 Jun 17 05:42:43 devstack sudo[97384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:42:43 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-774f5320-ff67-4ec1-9796-4f54f935848e tempest-GroupSnapshotsTest-649875217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:42:43 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-774f5320-ff67-4ec1-9796-4f54f935848e tempest-GroupSnapshotsTest-649875217 None] Flow 'volume_create_manager' (103af46a-e5f9-4520-95dd-1ce4171cf3d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:42:43 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-774f5320-ff67-4ec1-9796-4f54f935848e tempest-GroupSnapshotsTest-649875217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff1ba15c-72a1-4a53-9b0d-efa4554770b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:42:44 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-774f5320-ff67-4ec1-9796-4f54f935848e tempest-GroupSnapshotsTest-649875217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff1ba15c-72a1-4a53-9b0d-efa4554770b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:42:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1617687245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4ef6f4c0-aad9-4cb2-887c-c14501c56eea,host='devstack@QuobyteHD#QuobyteHD',id=bc469e96-6a80-4098-b18b-80236a7307fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be4b791c6d8248eea35b95220d502055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:42:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:42:44Z,use_quota=True,user_id='42d27ebd58fd4929b3814c4c838ced2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27fbd820-d067-4b7e-a4de-bd9efcf9c6dd),volume_type_id=27fbd820-d067-4b7e-a4de-bd9efcf9c6dd)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:42:44 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-774f5320-ff67-4ec1-9796-4f54f935848e tempest-GroupSnapshotsTest-649875217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (113aefb2-4f54-4a68-a975-0fdd4fd21111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:42:44 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-774f5320-ff67-4ec1-9796-4f54f935848e tempest-GroupSnapshotsTest-649875217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (113aefb2-4f54-4a68-a975-0fdd4fd21111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:42:44 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-774f5320-ff67-4ec1-9796-4f54f935848e tempest-GroupSnapshotsTest-649875217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72eafcd3-e036-45ef-8d49-c89dcf7f6b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:42:44 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-774f5320-ff67-4ec1-9796-4f54f935848e tempest-GroupSnapshotsTest-649875217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72eafcd3-e036-45ef-8d49-c89dcf7f6b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc469e96-6a80-4098-b18b-80236a7307fa', 'volume_name': 'volume-bc469e96-6a80-4098-b18b-80236a7307fa', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:42:44 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-774f5320-ff67-4ec1-9796-4f54f935848e tempest-GroupSnapshotsTest-649875217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0c8b65c-0683-4f44-a382-453e2260214e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:42:44 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-774f5320-ff67-4ec1-9796-4f54f935848e tempest-GroupSnapshotsTest-649875217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0c8b65c-0683-4f44-a382-453e2260214e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:42:44 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-774f5320-ff67-4ec1-9796-4f54f935848e tempest-GroupSnapshotsTest-649875217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48d497ed-a383-422c-b639-5ec1124fc66a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:42:44 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-774f5320-ff67-4ec1-9796-4f54f935848e tempest-GroupSnapshotsTest-649875217 None] Volume bc469e96-6a80-4098-b18b-80236a7307fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc469e96-6a80-4098-b18b-80236a7307fa', 'volume_size': 1} Jun 17 05:42:44 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-774f5320-ff67-4ec1-9796-4f54f935848e tempest-GroupSnapshotsTest-649875217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:42:44 devstack sudo[97384]: pam_unix(sudo:session): session closed for user root Jun 17 05:42:44 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-12e04f88-9531-4e42-aa6f-d795fd614f35 tempest-VolumesMetadataTest-570277687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-41d21b92-e60b-4699-bca2-03b3a55fd086" returned: 0 in 0.902s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:42:44 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-12e04f88-9531-4e42-aa6f-d795fd614f35 tempest-VolumesMetadataTest-570277687 None] <== create_volume: return (2449ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:42:44 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-12e04f88-9531-4e42-aa6f-d795fd614f35 tempest-VolumesMetadataTest-570277687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.451s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:42:44 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-774f5320-ff67-4ec1-9796-4f54f935848e tempest-GroupSnapshotsTest-649875217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.377s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:42:44 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-774f5320-ff67-4ec1-9796-4f54f935848e tempest-GroupSnapshotsTest-649875217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4ef6f4c0-aad9-4cb2-887c-c14501c56eea,created_at=2026-06-17T03:42:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1617687245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4ef6f4c0-aad9-4cb2-887c-c14501c56eea,host='devstack@QuobyteHD#QuobyteHD',id=bc469e96-6a80-4098-b18b-80236a7307fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be4b791c6d8248eea35b95220d502055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:42:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:42:44Z,use_quota=True,user_id='42d27ebd58fd4929b3814c4c838ced2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27fbd820-d067-4b7e-a4de-bd9efcf9c6dd),volume_type_id=27fbd820-d067-4b7e-a4de-bd9efcf9c6dd)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:42:44 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-774f5320-ff67-4ec1-9796-4f54f935848e tempest-GroupSnapshotsTest-649875217 None] Creating volume bc469e96-6a80-4098-b18b-80236a7307fa {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:42:44 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-774f5320-ff67-4ec1-9796-4f54f935848e tempest-GroupSnapshotsTest-649875217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:42:44 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-774f5320-ff67-4ec1-9796-4f54f935848e tempest-GroupSnapshotsTest-649875217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:42:44 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-774f5320-ff67-4ec1-9796-4f54f935848e tempest-GroupSnapshotsTest-649875217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:42:44 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-774f5320-ff67-4ec1-9796-4f54f935848e tempest-GroupSnapshotsTest-649875217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:42:44 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-774f5320-ff67-4ec1-9796-4f54f935848e tempest-GroupSnapshotsTest-649875217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:42:44 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-774f5320-ff67-4ec1-9796-4f54f935848e tempest-GroupSnapshotsTest-649875217 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:42:44 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-774f5320-ff67-4ec1-9796-4f54f935848e tempest-GroupSnapshotsTest-649875217 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:42:44 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-774f5320-ff67-4ec1-9796-4f54f935848e tempest-GroupSnapshotsTest-649875217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bc469e96-6a80-4098-b18b-80236a7307fa 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:42:44 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-12e04f88-9531-4e42-aa6f-d795fd614f35 tempest-VolumesMetadataTest-570277687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e71d4a0-feb8-4603-83b5-e49e180e4871) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41d21b92-e60b-4699-bca2-03b3a55fd086', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:42:44 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-12e04f88-9531-4e42-aa6f-d795fd614f35 tempest-VolumesMetadataTest-570277687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2886344-ae5c-4946-8b9a-aa2033a2f9de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:42:44 devstack sudo[97388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bc469e96-6a80-4098-b18b-80236a7307fa 1073741824 Jun 17 05:42:44 devstack sudo[97388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:42:44 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-12e04f88-9531-4e42-aa6f-d795fd614f35 tempest-VolumesMetadataTest-570277687 None] Volume volume-41d21b92-e60b-4699-bca2-03b3a55fd086 (41d21b92-e60b-4699-bca2-03b3a55fd086): created successfully Jun 17 05:42:44 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-12e04f88-9531-4e42-aa6f-d795fd614f35 tempest-VolumesMetadataTest-570277687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2886344-ae5c-4946-8b9a-aa2033a2f9de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:42:44 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-12e04f88-9531-4e42-aa6f-d795fd614f35 tempest-VolumesMetadataTest-570277687 None] Flow 'volume_create_manager' (9813e26c-33e4-43ab-8721-e2b47f8b9d10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:42:44 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-12e04f88-9531-4e42-aa6f-d795fd614f35 tempest-VolumesMetadataTest-570277687 None] Created volume successfully. Jun 17 05:42:46 devstack sudo[97388]: pam_unix(sudo:session): session closed for user root Jun 17 05:42:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-774f5320-ff67-4ec1-9796-4f54f935848e tempest-GroupSnapshotsTest-649875217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bc469e96-6a80-4098-b18b-80236a7307fa 1073741824" returned: 0 in 1.861s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:42:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-774f5320-ff67-4ec1-9796-4f54f935848e tempest-GroupSnapshotsTest-649875217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bc469e96-6a80-4098-b18b-80236a7307fa {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:42:46 devstack sudo[97406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bc469e96-6a80-4098-b18b-80236a7307fa Jun 17 05:42:46 devstack sudo[97406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:42:46 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-c24c0a0c-85ad-47c4-87ff-04e9a4b85841 tempest-VolumesMetadataTest-570277687 None] Acquiring lock "cinder-41d21b92-e60b-4699-bca2-03b3a55fd086-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:42:46 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-c24c0a0c-85ad-47c4-87ff-04e9a4b85841 tempest-VolumesMetadataTest-570277687 None] Lock "cinder-41d21b92-e60b-4699-bca2-03b3a55fd086-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:42:46 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-c24c0a0c-85ad-47c4-87ff-04e9a4b85841 tempest-VolumesMetadataTest-570277687 None] Acquiring lock "cinder-quobyte-41d21b92-e60b-4699-bca2-03b3a55fd086" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:42:47 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-c24c0a0c-85ad-47c4-87ff-04e9a4b85841 tempest-VolumesMetadataTest-570277687 None] Lock "cinder-quobyte-41d21b92-e60b-4699-bca2-03b3a55fd086" acquired by "delete_volume" :: waited 0.038s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:42:47 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[9629068a-bc8f-438c-bbeb-85954228e4db]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:42:47 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c24c0a0c-85ad-47c4-87ff-04e9a4b85841 tempest-VolumesMetadataTest-570277687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-41d21b92-e60b-4699-bca2-03b3a55fd086 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:42:47 devstack sudo[97414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-41d21b92-e60b-4699-bca2-03b3a55fd086 Jun 17 05:42:47 devstack sudo[97414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:42:47 devstack sudo[97406]: pam_unix(sudo:session): session closed for user root Jun 17 05:42:47 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-774f5320-ff67-4ec1-9796-4f54f935848e tempest-GroupSnapshotsTest-649875217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bc469e96-6a80-4098-b18b-80236a7307fa" returned: 0 in 1.484s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:42:47 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-774f5320-ff67-4ec1-9796-4f54f935848e tempest-GroupSnapshotsTest-649875217 None] <== create_volume: return (3464ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:42:47 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-774f5320-ff67-4ec1-9796-4f54f935848e tempest-GroupSnapshotsTest-649875217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.467s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:42:48 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-774f5320-ff67-4ec1-9796-4f54f935848e tempest-GroupSnapshotsTest-649875217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48d497ed-a383-422c-b639-5ec1124fc66a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc469e96-6a80-4098-b18b-80236a7307fa', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:42:48 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-774f5320-ff67-4ec1-9796-4f54f935848e tempest-GroupSnapshotsTest-649875217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2e8150b-3c52-4779-9e47-6178982f95bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:42:48 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-774f5320-ff67-4ec1-9796-4f54f935848e tempest-GroupSnapshotsTest-649875217 None] Volume volume-bc469e96-6a80-4098-b18b-80236a7307fa (bc469e96-6a80-4098-b18b-80236a7307fa): created successfully Jun 17 05:42:48 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-774f5320-ff67-4ec1-9796-4f54f935848e tempest-GroupSnapshotsTest-649875217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2e8150b-3c52-4779-9e47-6178982f95bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:42:48 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-774f5320-ff67-4ec1-9796-4f54f935848e tempest-GroupSnapshotsTest-649875217 None] Flow 'volume_create_manager' (103af46a-e5f9-4520-95dd-1ce4171cf3d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:42:48 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-774f5320-ff67-4ec1-9796-4f54f935848e tempest-GroupSnapshotsTest-649875217 None] Created volume successfully. Jun 17 05:42:48 devstack sudo[97414]: pam_unix(sudo:session): session closed for user root Jun 17 05:42:48 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c24c0a0c-85ad-47c4-87ff-04e9a4b85841 tempest-VolumesMetadataTest-570277687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-41d21b92-e60b-4699-bca2-03b3a55fd086" returned: 0 in 1.519s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:42:48 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c24c0a0c-85ad-47c4-87ff-04e9a4b85841 tempest-VolumesMetadataTest-570277687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-41d21b92-e60b-4699-bca2-03b3a55fd086 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:42:48 devstack sudo[97423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-41d21b92-e60b-4699-bca2-03b3a55fd086 Jun 17 05:42:48 devstack sudo[97423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:42:49 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-54978b86-0631-400d-8d4f-ab16147095a8 tempest-GroupSnapshotsTest-649875217 None] GroupSnapshot 1d3fa85e-e975-4d46-9945-8f84e61b9a22: creating. Jun 17 05:42:49 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-54978b86-0631-400d-8d4f-ab16147095a8 tempest-GroupSnapshotsTest-649875217 None] Group snapshot 1d3fa85e-e975-4d46-9945-8f84e61b9a22: creating. {{(pid=92083) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 17 05:42:49 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-54978b86-0631-400d-8d4f-ab16147095a8 tempest-GroupSnapshotsTest-649875217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:42:49 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-54978b86-0631-400d-8d4f-ab16147095a8 tempest-GroupSnapshotsTest-649875217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:42:49 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-54978b86-0631-400d-8d4f-ab16147095a8 tempest-GroupSnapshotsTest-649875217 None] Creating offline snapshot 68a9d7ac-1d3e-4565-a7f1-e433691586bb of volume bc469e96-6a80-4098-b18b-80236a7307fa {{(pid=92083) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 17 05:42:49 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a3313d-d4ea-493d-8c13-dec15622d943]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:42:49 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-54978b86-0631-400d-8d4f-ab16147095a8 tempest-GroupSnapshotsTest-649875217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bc469e96-6a80-4098-b18b-80236a7307fa {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:42:49 devstack sudo[97423]: pam_unix(sudo:session): session closed for user root Jun 17 05:42:49 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c24c0a0c-85ad-47c4-87ff-04e9a4b85841 tempest-VolumesMetadataTest-570277687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-41d21b92-e60b-4699-bca2-03b3a55fd086" returned: 0 in 0.843s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:42:49 devstack sudo[97427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bc469e96-6a80-4098-b18b-80236a7307fa Jun 17 05:42:49 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-c24c0a0c-85ad-47c4-87ff-04e9a4b85841 tempest-VolumesMetadataTest-570277687 None] Lock "cinder-quobyte-41d21b92-e60b-4699-bca2-03b3a55fd086" released by "delete_volume" :: held 2.461s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:42:49 devstack sudo[97427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:42:49 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-c24c0a0c-85ad-47c4-87ff-04e9a4b85841 tempest-VolumesMetadataTest-570277687 None] Created reservations ['8fb1f023-722a-46b4-bec2-99d2ca1b472c', '3d0c6f74-43aa-4c33-9439-ac05da916ddb', 'de87085e-a74c-453d-8c78-80cea03a2930', 'cda9a104-864f-4f96-b7f1-5fe5ee02ccf4'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:42:49 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-c24c0a0c-85ad-47c4-87ff-04e9a4b85841 tempest-VolumesMetadataTest-570277687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:42:49 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-c24c0a0c-85ad-47c4-87ff-04e9a4b85841 tempest-VolumesMetadataTest-570277687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:42:49 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-c24c0a0c-85ad-47c4-87ff-04e9a4b85841 tempest-VolumesMetadataTest-570277687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:42:49 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-c24c0a0c-85ad-47c4-87ff-04e9a4b85841 tempest-VolumesMetadataTest-570277687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:42:49 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-c24c0a0c-85ad-47c4-87ff-04e9a4b85841 tempest-VolumesMetadataTest-570277687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:42:49 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c24c0a0c-85ad-47c4-87ff-04e9a4b85841 tempest-VolumesMetadataTest-570277687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:42:49 devstack sudo[97429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:42:49 devstack sudo[97429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:42:50 devstack sudo[97427]: pam_unix(sudo:session): session closed for user root Jun 17 05:42:50 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-54978b86-0631-400d-8d4f-ab16147095a8 tempest-GroupSnapshotsTest-649875217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bc469e96-6a80-4098-b18b-80236a7307fa" returned: 0 in 1.149s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:42:50 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-54978b86-0631-400d-8d4f-ab16147095a8 tempest-GroupSnapshotsTest-649875217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bc469e96-6a80-4098-b18b-80236a7307fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bc469e96-6a80-4098-b18b-80236a7307fa.68a9d7ac-1d3e-4565-a7f1-e433691586bb 1G {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:42:50 devstack sudo[97434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bc469e96-6a80-4098-b18b-80236a7307fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bc469e96-6a80-4098-b18b-80236a7307fa.68a9d7ac-1d3e-4565-a7f1-e433691586bb 1G Jun 17 05:42:50 devstack sudo[97434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:42:51 devstack sudo[97429]: pam_unix(sudo:session): session closed for user root Jun 17 05:42:51 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c24c0a0c-85ad-47c4-87ff-04e9a4b85841 tempest-VolumesMetadataTest-570277687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 1.292s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:42:51 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-c24c0a0c-85ad-47c4-87ff-04e9a4b85841 tempest-VolumesMetadataTest-570277687 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:42:51 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-c24c0a0c-85ad-47c4-87ff-04e9a4b85841 tempest-VolumesMetadataTest-570277687 None] Deleted volume successfully. Jun 17 05:42:51 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-c24c0a0c-85ad-47c4-87ff-04e9a4b85841 tempest-VolumesMetadataTest-570277687 None] Lock "cinder-41d21b92-e60b-4699-bca2-03b3a55fd086-delete_volume" released by "delete_volume" :: held 4.327s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:42:51 devstack sudo[97434]: pam_unix(sudo:session): session closed for user root Jun 17 05:42:51 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-54978b86-0631-400d-8d4f-ab16147095a8 tempest-GroupSnapshotsTest-649875217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bc469e96-6a80-4098-b18b-80236a7307fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bc469e96-6a80-4098-b18b-80236a7307fa.68a9d7ac-1d3e-4565-a7f1-e433691586bb 1G" returned: 0 in 1.300s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:42:51 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-54978b86-0631-400d-8d4f-ab16147095a8 tempest-GroupSnapshotsTest-649875217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc469e96-6a80-4098-b18b-80236a7307fa -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bc469e96-6a80-4098-b18b-80236a7307fa.68a9d7ac-1d3e-4565-a7f1-e433691586bb {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:42:51 devstack sudo[97443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc469e96-6a80-4098-b18b-80236a7307fa -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bc469e96-6a80-4098-b18b-80236a7307fa.68a9d7ac-1d3e-4565-a7f1-e433691586bb Jun 17 05:42:51 devstack sudo[97443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:42:52 devstack sudo[97443]: pam_unix(sudo:session): session closed for user root Jun 17 05:42:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-54978b86-0631-400d-8d4f-ab16147095a8 tempest-GroupSnapshotsTest-649875217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc469e96-6a80-4098-b18b-80236a7307fa -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bc469e96-6a80-4098-b18b-80236a7307fa.68a9d7ac-1d3e-4565-a7f1-e433691586bb" returned: 0 in 0.875s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:42:52 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [None req-54978b86-0631-400d-8d4f-ab16147095a8 tempest-GroupSnapshotsTest-649875217 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bc469e96-6a80-4098-b18b-80236a7307fa.68a9d7ac-1d3e-4565-a7f1-e433691586bb is being set with open permissions: ugo+rw: NotImplementedError Jun 17 05:42:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-54978b86-0631-400d-8d4f-ab16147095a8 tempest-GroupSnapshotsTest-649875217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bc469e96-6a80-4098-b18b-80236a7307fa.68a9d7ac-1d3e-4565-a7f1-e433691586bb {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:42:52 devstack sudo[97448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bc469e96-6a80-4098-b18b-80236a7307fa.68a9d7ac-1d3e-4565-a7f1-e433691586bb Jun 17 05:42:52 devstack sudo[97448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:42:53 devstack sudo[97448]: pam_unix(sudo:session): session closed for user root Jun 17 05:42:53 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-54978b86-0631-400d-8d4f-ab16147095a8 tempest-GroupSnapshotsTest-649875217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bc469e96-6a80-4098-b18b-80236a7307fa.68a9d7ac-1d3e-4565-a7f1-e433691586bb" returned: 0 in 0.657s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:42:53 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-54978b86-0631-400d-8d4f-ab16147095a8 tempest-GroupSnapshotsTest-649875217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bc469e96-6a80-4098-b18b-80236a7307fa.info {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:42:53 devstack sudo[97451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bc469e96-6a80-4098-b18b-80236a7307fa.info Jun 17 05:42:53 devstack sudo[97451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:42:53 devstack sudo[97451]: pam_unix(sudo:session): session closed for user root Jun 17 05:42:53 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-54978b86-0631-400d-8d4f-ab16147095a8 tempest-GroupSnapshotsTest-649875217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bc469e96-6a80-4098-b18b-80236a7307fa.info" returned: 0 in 0.701s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:42:53 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [None req-54978b86-0631-400d-8d4f-ab16147095a8 tempest-GroupSnapshotsTest-649875217 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bc469e96-6a80-4098-b18b-80236a7307fa.info is being set with open permissions: ugo+rw: NotImplementedError Jun 17 05:42:53 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-54978b86-0631-400d-8d4f-ab16147095a8 tempest-GroupSnapshotsTest-649875217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bc469e96-6a80-4098-b18b-80236a7307fa.info {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:42:53 devstack sudo[97454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bc469e96-6a80-4098-b18b-80236a7307fa.info Jun 17 05:42:53 devstack sudo[97454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:42:54 devstack sudo[97454]: pam_unix(sudo:session): session closed for user root Jun 17 05:42:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-54978b86-0631-400d-8d4f-ab16147095a8 tempest-GroupSnapshotsTest-649875217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bc469e96-6a80-4098-b18b-80236a7307fa.info" returned: 0 in 0.804s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:42:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-54978b86-0631-400d-8d4f-ab16147095a8 tempest-GroupSnapshotsTest-649875217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.585s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:42:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-3c92d03b-d051-444c-81ac-1dbcd1be4510 req-da9baa54-3c49-4a54-8685-eb609e47b9d8 tempest-AttachVolumeShelveTestJSON-18917466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:42:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-3c92d03b-d051-444c-81ac-1dbcd1be4510 req-da9baa54-3c49-4a54-8685-eb609e47b9d8 tempest-AttachVolumeShelveTestJSON-18917466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:42:54 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b6dfcb-2de8-4876-b1d2-dff5f2934196]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:42:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-3c92d03b-d051-444c-81ac-1dbcd1be4510 req-da9baa54-3c49-4a54-8685-eb609e47b9d8 tempest-AttachVolumeShelveTestJSON-18917466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4bc4ff05-fc19-4d1e-bab3-dba182bab2c1 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:42:54 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-54978b86-0631-400d-8d4f-ab16147095a8 tempest-GroupSnapshotsTest-649875217 None] group_snapshot 1d3fa85e-e975-4d46-9945-8f84e61b9a22: created successfully Jun 17 05:42:54 devstack sudo[97465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4bc4ff05-fc19-4d1e-bab3-dba182bab2c1 Jun 17 05:42:54 devstack sudo[97465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:42:55 devstack sudo[97465]: pam_unix(sudo:session): session closed for user root Jun 17 05:42:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-3c92d03b-d051-444c-81ac-1dbcd1be4510 req-da9baa54-3c49-4a54-8685-eb609e47b9d8 tempest-AttachVolumeShelveTestJSON-18917466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4bc4ff05-fc19-4d1e-bab3-dba182bab2c1" returned: 0 in 0.801s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:42:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-3c92d03b-d051-444c-81ac-1dbcd1be4510 req-da9baa54-3c49-4a54-8685-eb609e47b9d8 tempest-AttachVolumeShelveTestJSON-18917466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.831s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:42:55 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [req-3c92d03b-d051-444c-81ac-1dbcd1be4510 req-da9baa54-3c49-4a54-8685-eb609e47b9d8 tempest-AttachVolumeShelveTestJSON-18917466 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f', 'name': 'volume-4bc4ff05-fc19-4d1e-bab3-dba182bab2c1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1d187682-0e20-4dd1-99c2-4c4a3fc01b24', 'enforce_multipath': True} {{(pid=92083) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 17 05:42:55 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee686f7e-d938-4979-b19c-04e399ceec62 tempest-VolumesTransfersV357Test-1886907615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:42:55 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ee686f7e-d938-4979-b19c-04e399ceec62 tempest-VolumesTransfersV357Test-1886907615 None] Flow 'volume_create_manager' (ca1aeadf-dda0-4092-b4b0-571229589f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:42:55 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ee686f7e-d938-4979-b19c-04e399ceec62 tempest-VolumesTransfersV357Test-1886907615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f73efa95-77c4-41fc-bc95-2f7b1abdd326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:42:55 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ee686f7e-d938-4979-b19c-04e399ceec62 tempest-VolumesTransfersV357Test-1886907615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f73efa95-77c4-41fc-bc95-2f7b1abdd326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:42:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1237848476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6e45feb-1041-44eb-8de0-fca201d8c983,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b40a2f5c2c04568bcc5dbd172d7156c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:42:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:42:56Z,use_quota=True,user_id='af74e6369ab349b58a4e6e40b36b29e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:42:55 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ee686f7e-d938-4979-b19c-04e399ceec62 tempest-VolumesTransfersV357Test-1886907615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fa73525-0119-4478-9896-d459973edc5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:42:55 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ee686f7e-d938-4979-b19c-04e399ceec62 tempest-VolumesTransfersV357Test-1886907615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fa73525-0119-4478-9896-d459973edc5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:42:55 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ee686f7e-d938-4979-b19c-04e399ceec62 tempest-VolumesTransfersV357Test-1886907615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17efdbd6-b076-44ee-8fbd-d8f4b50a18cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:42:55 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ee686f7e-d938-4979-b19c-04e399ceec62 tempest-VolumesTransfersV357Test-1886907615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17efdbd6-b076-44ee-8fbd-d8f4b50a18cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6e45feb-1041-44eb-8de0-fca201d8c983', 'volume_name': 'volume-c6e45feb-1041-44eb-8de0-fca201d8c983', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:42:55 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ee686f7e-d938-4979-b19c-04e399ceec62 tempest-VolumesTransfersV357Test-1886907615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04d69813-0b4e-4697-bfe2-d5c04e2889c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:42:55 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ee686f7e-d938-4979-b19c-04e399ceec62 tempest-VolumesTransfersV357Test-1886907615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04d69813-0b4e-4697-bfe2-d5c04e2889c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:42:55 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ee686f7e-d938-4979-b19c-04e399ceec62 tempest-VolumesTransfersV357Test-1886907615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2854f70-7e8e-4065-801c-5780b33fa818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:42:55 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-ee686f7e-d938-4979-b19c-04e399ceec62 tempest-VolumesTransfersV357Test-1886907615 None] Volume c6e45feb-1041-44eb-8de0-fca201d8c983: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6e45feb-1041-44eb-8de0-fca201d8c983', 'volume_size': 1} Jun 17 05:42:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ee686f7e-d938-4979-b19c-04e399ceec62 tempest-VolumesTransfersV357Test-1886907615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:42:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ee686f7e-d938-4979-b19c-04e399ceec62 tempest-VolumesTransfersV357Test-1886907615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:42:55 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ee686f7e-d938-4979-b19c-04e399ceec62 tempest-VolumesTransfersV357Test-1886907615 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:42:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1237848476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6e45feb-1041-44eb-8de0-fca201d8c983,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b40a2f5c2c04568bcc5dbd172d7156c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:42:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:42:56Z,use_quota=True,user_id='af74e6369ab349b58a4e6e40b36b29e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:42:55 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-ee686f7e-d938-4979-b19c-04e399ceec62 tempest-VolumesTransfersV357Test-1886907615 None] Creating volume c6e45feb-1041-44eb-8de0-fca201d8c983 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:42:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ee686f7e-d938-4979-b19c-04e399ceec62 tempest-VolumesTransfersV357Test-1886907615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:42:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ee686f7e-d938-4979-b19c-04e399ceec62 tempest-VolumesTransfersV357Test-1886907615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:42:55 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ee686f7e-d938-4979-b19c-04e399ceec62 tempest-VolumesTransfersV357Test-1886907615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:42:55 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ee686f7e-d938-4979-b19c-04e399ceec62 tempest-VolumesTransfersV357Test-1886907615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:42:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ee686f7e-d938-4979-b19c-04e399ceec62 tempest-VolumesTransfersV357Test-1886907615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:42:55 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ee686f7e-d938-4979-b19c-04e399ceec62 tempest-VolumesTransfersV357Test-1886907615 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:42:55 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-ee686f7e-d938-4979-b19c-04e399ceec62 tempest-VolumesTransfersV357Test-1886907615 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:42:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ee686f7e-d938-4979-b19c-04e399ceec62 tempest-VolumesTransfersV357Test-1886907615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c6e45feb-1041-44eb-8de0-fca201d8c983 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:42:55 devstack cinder-volume[92083]: INFO cinder.volume.manager [req-3c92d03b-d051-444c-81ac-1dbcd1be4510 req-da9baa54-3c49-4a54-8685-eb609e47b9d8 tempest-AttachVolumeShelveTestJSON-18917466 None] attachment_update completed successfully. Jun 17 05:42:55 devstack sudo[97470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c6e45feb-1041-44eb-8de0-fca201d8c983 1073741824 Jun 17 05:42:55 devstack sudo[97470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:42:56 devstack sudo[97470]: pam_unix(sudo:session): session closed for user root Jun 17 05:42:56 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ee686f7e-d938-4979-b19c-04e399ceec62 tempest-VolumesTransfersV357Test-1886907615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c6e45feb-1041-44eb-8de0-fca201d8c983 1073741824" returned: 0 in 0.929s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:42:56 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ee686f7e-d938-4979-b19c-04e399ceec62 tempest-VolumesTransfersV357Test-1886907615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c6e45feb-1041-44eb-8de0-fca201d8c983 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:42:56 devstack sudo[97490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c6e45feb-1041-44eb-8de0-fca201d8c983 Jun 17 05:42:56 devstack sudo[97490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:42:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-14fe66a8-3284-45d2-bfb6-87eb9cbd750c tempest-GroupSnapshotsTest-649875217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:42:57 devstack sudo[97490]: pam_unix(sudo:session): session closed for user root Jun 17 05:42:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ee686f7e-d938-4979-b19c-04e399ceec62 tempest-VolumesTransfersV357Test-1886907615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c6e45feb-1041-44eb-8de0-fca201d8c983" returned: 0 in 0.620s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:42:57 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ee686f7e-d938-4979-b19c-04e399ceec62 tempest-VolumesTransfersV357Test-1886907615 None] <== create_volume: return (1602ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:42:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ee686f7e-d938-4979-b19c-04e399ceec62 tempest-VolumesTransfersV357Test-1886907615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.604s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:42:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-14fe66a8-3284-45d2-bfb6-87eb9cbd750c tempest-GroupSnapshotsTest-649875217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.449s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:42:57 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-14fe66a8-3284-45d2-bfb6-87eb9cbd750c tempest-GroupSnapshotsTest-649875217 None] Acquiring lock "cinder-quobyte-68a9d7ac-1d3e-4565-a7f1-e433691586bb-95be9554-cb62-4e9b-ad51-53a7f6658758" by "_create_volume_from_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:42:57 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ee686f7e-d938-4979-b19c-04e399ceec62 tempest-VolumesTransfersV357Test-1886907615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2854f70-7e8e-4065-801c-5780b33fa818) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6e45feb-1041-44eb-8de0-fca201d8c983', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:42:57 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ee686f7e-d938-4979-b19c-04e399ceec62 tempest-VolumesTransfersV357Test-1886907615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (089f97b4-75ba-4df5-8d14-83cde865f7ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:42:57 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-14fe66a8-3284-45d2-bfb6-87eb9cbd750c tempest-GroupSnapshotsTest-649875217 None] Lock "cinder-quobyte-68a9d7ac-1d3e-4565-a7f1-e433691586bb-95be9554-cb62-4e9b-ad51-53a7f6658758" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:42:57 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-14fe66a8-3284-45d2-bfb6-87eb9cbd750c tempest-GroupSnapshotsTest-649875217 None] Creating volume 95be9554-cb62-4e9b-ad51-53a7f6658758 from snapshot 68a9d7ac-1d3e-4565-a7f1-e433691586bb {{(pid=92083) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 17 05:42:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-14fe66a8-3284-45d2-bfb6-87eb9cbd750c tempest-GroupSnapshotsTest-649875217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:42:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-14fe66a8-3284-45d2-bfb6-87eb9cbd750c tempest-GroupSnapshotsTest-649875217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:42:57 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-14fe66a8-3284-45d2-bfb6-87eb9cbd750c tempest-GroupSnapshotsTest-649875217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:42:57 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-14fe66a8-3284-45d2-bfb6-87eb9cbd750c tempest-GroupSnapshotsTest-649875217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:42:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-14fe66a8-3284-45d2-bfb6-87eb9cbd750c tempest-GroupSnapshotsTest-649875217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:42:57 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-14fe66a8-3284-45d2-bfb6-87eb9cbd750c tempest-GroupSnapshotsTest-649875217 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:42:57 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-14fe66a8-3284-45d2-bfb6-87eb9cbd750c tempest-GroupSnapshotsTest-649875217 None] Acquiring lock "cinder-quobyte-95be9554-cb62-4e9b-ad51-53a7f6658758" by "_copy_volume_from_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:42:57 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-14fe66a8-3284-45d2-bfb6-87eb9cbd750c tempest-GroupSnapshotsTest-649875217 None] Lock "cinder-quobyte-95be9554-cb62-4e9b-ad51-53a7f6658758" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:42:57 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-14fe66a8-3284-45d2-bfb6-87eb9cbd750c tempest-GroupSnapshotsTest-649875217 None] snapshot: 68a9d7ac-1d3e-4565-a7f1-e433691586bb, volume: 95be9554-cb62-4e9b-ad51-53a7f6658758, {{(pid=92083) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 17 05:42:57 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-ee686f7e-d938-4979-b19c-04e399ceec62 tempest-VolumesTransfersV357Test-1886907615 None] Volume volume-c6e45feb-1041-44eb-8de0-fca201d8c983 (c6e45feb-1041-44eb-8de0-fca201d8c983): created successfully Jun 17 05:42:57 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ee686f7e-d938-4979-b19c-04e399ceec62 tempest-VolumesTransfersV357Test-1886907615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (089f97b4-75ba-4df5-8d14-83cde865f7ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:42:57 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ee686f7e-d938-4979-b19c-04e399ceec62 tempest-VolumesTransfersV357Test-1886907615 None] Flow 'volume_create_manager' (ca1aeadf-dda0-4092-b4b0-571229589f18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:42:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-14fe66a8-3284-45d2-bfb6-87eb9cbd750c tempest-GroupSnapshotsTest-649875217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:42:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-14fe66a8-3284-45d2-bfb6-87eb9cbd750c tempest-GroupSnapshotsTest-649875217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:42:57 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-14fe66a8-3284-45d2-bfb6-87eb9cbd750c tempest-GroupSnapshotsTest-649875217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:42:57 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-14fe66a8-3284-45d2-bfb6-87eb9cbd750c tempest-GroupSnapshotsTest-649875217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:42:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-14fe66a8-3284-45d2-bfb6-87eb9cbd750c tempest-GroupSnapshotsTest-649875217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:42:57 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-ee686f7e-d938-4979-b19c-04e399ceec62 tempest-VolumesTransfersV357Test-1886907615 None] Created volume successfully. Jun 17 05:42:57 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9dcee76-2b32-4429-921b-0298fafb44ac]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:42:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-14fe66a8-3284-45d2-bfb6-87eb9cbd750c tempest-GroupSnapshotsTest-649875217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bc469e96-6a80-4098-b18b-80236a7307fa.68a9d7ac-1d3e-4565-a7f1-e433691586bb {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:42:57 devstack sudo[97493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bc469e96-6a80-4098-b18b-80236a7307fa.68a9d7ac-1d3e-4565-a7f1-e433691586bb Jun 17 05:42:57 devstack sudo[97493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:42:58 devstack sudo[97493]: pam_unix(sudo:session): session closed for user root Jun 17 05:42:58 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-14fe66a8-3284-45d2-bfb6-87eb9cbd750c tempest-GroupSnapshotsTest-649875217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bc469e96-6a80-4098-b18b-80236a7307fa.68a9d7ac-1d3e-4565-a7f1-e433691586bb" returned: 0 in 0.714s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:42:58 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-14fe66a8-3284-45d2-bfb6-87eb9cbd750c tempest-GroupSnapshotsTest-649875217 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc469e96-6a80-4098-b18b-80236a7307fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92083) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 05:42:58 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-14fe66a8-3284-45d2-bfb6-87eb9cbd750c tempest-GroupSnapshotsTest-649875217 None] will copy from snapshot at /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bc469e96-6a80-4098-b18b-80236a7307fa {{(pid=92083) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 17 05:42:58 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-14fe66a8-3284-45d2-bfb6-87eb9cbd750c tempest-GroupSnapshotsTest-649875217 None] Creating direct copy from snapshot {{(pid=92083) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 17 05:42:58 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf58052-a3ce-436a-a574-b60bd04ffb29]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:42:58 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-14fe66a8-3284-45d2-bfb6-87eb9cbd750c tempest-GroupSnapshotsTest-649875217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bc469e96-6a80-4098-b18b-80236a7307fa {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:42:58 devstack sudo[97498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bc469e96-6a80-4098-b18b-80236a7307fa Jun 17 05:42:58 devstack sudo[97498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:42:58 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-1438806a-b29d-4dc0-8fe7-19d988fc44f9 tempest-VolumesTransfersV357Test-191116147 None] Transfer volume completed successfully. Jun 17 05:42:59 devstack sudo[97498]: pam_unix(sudo:session): session closed for user root Jun 17 05:42:59 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-14fe66a8-3284-45d2-bfb6-87eb9cbd750c tempest-GroupSnapshotsTest-649875217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bc469e96-6a80-4098-b18b-80236a7307fa" returned: 0 in 0.736s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:42:59 devstack cinder-volume[92083]: DEBUG cinder.utils [None req-14fe66a8-3284-45d2-bfb6-87eb9cbd750c tempest-GroupSnapshotsTest-649875217 None] Path /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-95be9554-cb62-4e9b-ad51-53a7f6658758 not found in is_blk_device check {{(pid=92083) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 17 05:42:59 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-14fe66a8-3284-45d2-bfb6-87eb9cbd750c tempest-GroupSnapshotsTest-649875217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bc469e96-6a80-4098-b18b-80236a7307fa /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-95be9554-cb62-4e9b-ad51-53a7f6658758 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:42:59 devstack sudo[97505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bc469e96-6a80-4098-b18b-80236a7307fa /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-95be9554-cb62-4e9b-ad51-53a7f6658758 Jun 17 05:42:59 devstack sudo[97505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:42:59 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-638bf9d0-230a-446c-aba6-215c379478fd tempest-VolumesTransfersV357Test-592696015 None] Acquiring lock "cinder-c6e45feb-1041-44eb-8de0-fca201d8c983-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:42:59 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-638bf9d0-230a-446c-aba6-215c379478fd tempest-VolumesTransfersV357Test-592696015 None] Lock "cinder-c6e45feb-1041-44eb-8de0-fca201d8c983-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:42:59 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-638bf9d0-230a-446c-aba6-215c379478fd tempest-VolumesTransfersV357Test-592696015 None] Acquiring lock "cinder-quobyte-c6e45feb-1041-44eb-8de0-fca201d8c983" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:42:59 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-638bf9d0-230a-446c-aba6-215c379478fd tempest-VolumesTransfersV357Test-592696015 None] Lock "cinder-quobyte-c6e45feb-1041-44eb-8de0-fca201d8c983" acquired by "delete_volume" :: waited 0.019s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:42:59 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc39e85-b4c5-4821-9854-40075ebe6ac4]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:42:59 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-638bf9d0-230a-446c-aba6-215c379478fd tempest-VolumesTransfersV357Test-592696015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c6e45feb-1041-44eb-8de0-fca201d8c983 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:42:59 devstack sudo[97507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c6e45feb-1041-44eb-8de0-fca201d8c983 Jun 17 05:42:59 devstack sudo[97507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:00 devstack sudo[97507]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:00 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-638bf9d0-230a-446c-aba6-215c379478fd tempest-VolumesTransfersV357Test-592696015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c6e45feb-1041-44eb-8de0-fca201d8c983" returned: 0 in 1.157s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:00 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-638bf9d0-230a-446c-aba6-215c379478fd tempest-VolumesTransfersV357Test-592696015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c6e45feb-1041-44eb-8de0-fca201d8c983 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:00 devstack sudo[97537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c6e45feb-1041-44eb-8de0-fca201d8c983 Jun 17 05:43:00 devstack sudo[97537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:02 devstack sudo[97537]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:02 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-638bf9d0-230a-446c-aba6-215c379478fd tempest-VolumesTransfersV357Test-592696015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c6e45feb-1041-44eb-8de0-fca201d8c983" returned: 0 in 1.738s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:02 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-638bf9d0-230a-446c-aba6-215c379478fd tempest-VolumesTransfersV357Test-592696015 None] Lock "cinder-quobyte-c6e45feb-1041-44eb-8de0-fca201d8c983" released by "delete_volume" :: held 2.956s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:43:02 devstack cinder-volume[92083]: DEBUG dbcounter [-] [92083] Writing DB stats cinder:SELECT=83,cinder:UPDATE=106,cinder:INSERT=23,cinder:DELETE=4 {{(pid=92083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:43:02 devstack cinder-volume[92083]: DEBUG dbcounter [-] [92083] Writing DB stats cinder:SELECT=82,cinder:UPDATE=91,cinder:INSERT=21,cinder:DELETE=14 {{(pid=92083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:43:02 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-638bf9d0-230a-446c-aba6-215c379478fd tempest-VolumesTransfersV357Test-592696015 None] Created reservations ['2e6dc60b-b98e-49b7-bdd0-8dd3088deaf8', '85d67ed3-7c4c-4c10-a2b6-c78e33c0304a', '3fab9269-019f-4f16-9158-a7b8ff719d5d', 'a1be0acc-6551-4ae4-94ee-f4f4b5cbe004'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:43:03 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-638bf9d0-230a-446c-aba6-215c379478fd tempest-VolumesTransfersV357Test-592696015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:43:03 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-638bf9d0-230a-446c-aba6-215c379478fd tempest-VolumesTransfersV357Test-592696015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:43:03 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-638bf9d0-230a-446c-aba6-215c379478fd tempest-VolumesTransfersV357Test-592696015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:43:03 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-638bf9d0-230a-446c-aba6-215c379478fd tempest-VolumesTransfersV357Test-592696015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:43:03 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-638bf9d0-230a-446c-aba6-215c379478fd tempest-VolumesTransfersV357Test-592696015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:43:03 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-638bf9d0-230a-446c-aba6-215c379478fd tempest-VolumesTransfersV357Test-592696015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:03 devstack sudo[97542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:43:03 devstack sudo[97542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:04 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3341acd-8198-4d2c-973d-fcf3cbcb6515 tempest-VolumesTransfersV357Test-1886907615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:43:04 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a3341acd-8198-4d2c-973d-fcf3cbcb6515 tempest-VolumesTransfersV357Test-1886907615 None] Flow 'volume_create_manager' (93d9001f-7046-4a5c-864d-67dd34e150a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:43:04 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a3341acd-8198-4d2c-973d-fcf3cbcb6515 tempest-VolumesTransfersV357Test-1886907615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e1f8ff1-7c2b-4f91-8927-6aa747c638fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:43:04 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a3341acd-8198-4d2c-973d-fcf3cbcb6515 tempest-VolumesTransfersV357Test-1886907615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e1f8ff1-7c2b-4f91-8927-6aa747c638fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:43:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-583604065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=524c6cdd-27cc-4d0a-a2a0-2d0f0b2f5175,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b40a2f5c2c04568bcc5dbd172d7156c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:43:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:43:04Z,use_quota=True,user_id='af74e6369ab349b58a4e6e40b36b29e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:43:04 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a3341acd-8198-4d2c-973d-fcf3cbcb6515 tempest-VolumesTransfersV357Test-1886907615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba09a9c2-3e41-4eaf-a503-314dfa670a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:43:04 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a3341acd-8198-4d2c-973d-fcf3cbcb6515 tempest-VolumesTransfersV357Test-1886907615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba09a9c2-3e41-4eaf-a503-314dfa670a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:43:04 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a3341acd-8198-4d2c-973d-fcf3cbcb6515 tempest-VolumesTransfersV357Test-1886907615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3055f009-06af-4a3b-934e-fd4ad980e5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:43:04 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a3341acd-8198-4d2c-973d-fcf3cbcb6515 tempest-VolumesTransfersV357Test-1886907615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3055f009-06af-4a3b-934e-fd4ad980e5f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '524c6cdd-27cc-4d0a-a2a0-2d0f0b2f5175', 'volume_name': 'volume-524c6cdd-27cc-4d0a-a2a0-2d0f0b2f5175', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:43:05 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a3341acd-8198-4d2c-973d-fcf3cbcb6515 tempest-VolumesTransfersV357Test-1886907615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25d67b85-82ef-4953-b049-b0ad9d00398c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:43:05 devstack sudo[97542]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:05 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a3341acd-8198-4d2c-973d-fcf3cbcb6515 tempest-VolumesTransfersV357Test-1886907615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25d67b85-82ef-4953-b049-b0ad9d00398c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:43:05 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a3341acd-8198-4d2c-973d-fcf3cbcb6515 tempest-VolumesTransfersV357Test-1886907615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41fcbba2-9a97-42ca-8e52-7cb825d58d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:43:05 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-a3341acd-8198-4d2c-973d-fcf3cbcb6515 tempest-VolumesTransfersV357Test-1886907615 None] Volume 524c6cdd-27cc-4d0a-a2a0-2d0f0b2f5175: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-524c6cdd-27cc-4d0a-a2a0-2d0f0b2f5175', 'volume_size': 1} Jun 17 05:43:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-a3341acd-8198-4d2c-973d-fcf3cbcb6515 tempest-VolumesTransfersV357Test-1886907615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:43:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-638bf9d0-230a-446c-aba6-215c379478fd tempest-VolumesTransfersV357Test-592696015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 2.045s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:05 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-638bf9d0-230a-446c-aba6-215c379478fd tempest-VolumesTransfersV357Test-592696015 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:43:05 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-638bf9d0-230a-446c-aba6-215c379478fd tempest-VolumesTransfersV357Test-592696015 None] Deleted volume successfully. Jun 17 05:43:05 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-638bf9d0-230a-446c-aba6-215c379478fd tempest-VolumesTransfersV357Test-592696015 None] Lock "cinder-c6e45feb-1041-44eb-8de0-fca201d8c983-delete_volume" released by "delete_volume" :: held 5.682s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:43:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-14fe66a8-3284-45d2-bfb6-87eb9cbd750c tempest-GroupSnapshotsTest-649875217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bc469e96-6a80-4098-b18b-80236a7307fa /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-95be9554-cb62-4e9b-ad51-53a7f6658758" returned: 0 in 6.942s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:06 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c62736-8c31-4de7-b1cd-27ab405e86ec]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:43:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-14fe66a8-3284-45d2-bfb6-87eb9cbd750c tempest-GroupSnapshotsTest-649875217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bc469e96-6a80-4098-b18b-80236a7307fa {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:06 devstack sudo[97546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bc469e96-6a80-4098-b18b-80236a7307fa Jun 17 05:43:06 devstack sudo[97546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:06 devstack sudo[97546]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-14fe66a8-3284-45d2-bfb6-87eb9cbd750c tempest-GroupSnapshotsTest-649875217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bc469e96-6a80-4098-b18b-80236a7307fa" returned: 0 in 0.841s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:06 devstack cinder-volume[92083]: DEBUG cinder.image.image_utils [None req-14fe66a8-3284-45d2-bfb6-87eb9cbd750c tempest-GroupSnapshotsTest-649875217 None] Image conversion details: src /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bc469e96-6a80-4098-b18b-80236a7307fa, size 1024.00 MB, duration 6.94 sec, destination /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-95be9554-cb62-4e9b-ad51-53a7f6658758 {{(pid=92083) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 17 05:43:06 devstack cinder-volume[92083]: INFO cinder.image.image_utils [None req-14fe66a8-3284-45d2-bfb6-87eb9cbd750c tempest-GroupSnapshotsTest-649875217 None] Converted 1024.00 MB image at 147.48 MB/s Jun 17 05:43:06 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [None req-14fe66a8-3284-45d2-bfb6-87eb9cbd750c tempest-GroupSnapshotsTest-649875217 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-95be9554-cb62-4e9b-ad51-53a7f6658758 is being set with open permissions: ugo+rw: NotImplementedError Jun 17 05:43:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-14fe66a8-3284-45d2-bfb6-87eb9cbd750c tempest-GroupSnapshotsTest-649875217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-95be9554-cb62-4e9b-ad51-53a7f6658758 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:06 devstack sudo[97551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-95be9554-cb62-4e9b-ad51-53a7f6658758 Jun 17 05:43:06 devstack sudo[97551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:07 devstack sudo[97551]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-14fe66a8-3284-45d2-bfb6-87eb9cbd750c tempest-GroupSnapshotsTest-649875217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-95be9554-cb62-4e9b-ad51-53a7f6658758" returned: 0 in 0.624s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:07 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-14fe66a8-3284-45d2-bfb6-87eb9cbd750c tempest-GroupSnapshotsTest-649875217 None] Lock "cinder-quobyte-95be9554-cb62-4e9b-ad51-53a7f6658758" released by "_copy_volume_from_snapshot" :: held 9.978s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:43:07 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-14fe66a8-3284-45d2-bfb6-87eb9cbd750c tempest-GroupSnapshotsTest-649875217 None] Lock "cinder-quobyte-68a9d7ac-1d3e-4565-a7f1-e433691586bb-95be9554-cb62-4e9b-ad51-53a7f6658758" released by "_create_volume_from_snapshot" :: held 10.010s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:43:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-14fe66a8-3284-45d2-bfb6-87eb9cbd750c tempest-GroupSnapshotsTest-649875217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.042s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:43:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-a3341acd-8198-4d2c-973d-fcf3cbcb6515 tempest-VolumesTransfersV357Test-1886907615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.513s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:43:07 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-a3341acd-8198-4d2c-973d-fcf3cbcb6515 tempest-VolumesTransfersV357Test-1886907615 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:43:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-583604065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=524c6cdd-27cc-4d0a-a2a0-2d0f0b2f5175,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b40a2f5c2c04568bcc5dbd172d7156c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:43:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:43:04Z,use_quota=True,user_id='af74e6369ab349b58a4e6e40b36b29e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:43:07 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-a3341acd-8198-4d2c-973d-fcf3cbcb6515 tempest-VolumesTransfersV357Test-1886907615 None] Creating volume 524c6cdd-27cc-4d0a-a2a0-2d0f0b2f5175 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:43:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-a3341acd-8198-4d2c-973d-fcf3cbcb6515 tempest-VolumesTransfersV357Test-1886907615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:43:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-a3341acd-8198-4d2c-973d-fcf3cbcb6515 tempest-VolumesTransfersV357Test-1886907615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:43:07 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-a3341acd-8198-4d2c-973d-fcf3cbcb6515 tempest-VolumesTransfersV357Test-1886907615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:43:07 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-a3341acd-8198-4d2c-973d-fcf3cbcb6515 tempest-VolumesTransfersV357Test-1886907615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:43:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-a3341acd-8198-4d2c-973d-fcf3cbcb6515 tempest-VolumesTransfersV357Test-1886907615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:43:07 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-a3341acd-8198-4d2c-973d-fcf3cbcb6515 tempest-VolumesTransfersV357Test-1886907615 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:43:07 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-a3341acd-8198-4d2c-973d-fcf3cbcb6515 tempest-VolumesTransfersV357Test-1886907615 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:43:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a3341acd-8198-4d2c-973d-fcf3cbcb6515 tempest-VolumesTransfersV357Test-1886907615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-524c6cdd-27cc-4d0a-a2a0-2d0f0b2f5175 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:07 devstack sudo[97556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-524c6cdd-27cc-4d0a-a2a0-2d0f0b2f5175 1073741824 Jun 17 05:43:07 devstack sudo[97556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:07 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-14fe66a8-3284-45d2-bfb6-87eb9cbd750c tempest-GroupSnapshotsTest-649875217 None] Create group from source-snapshot-1d3fa85e-e975-4d46-9945-8f84e61b9a22 completed successfully. Jun 17 05:43:08 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-64e8d593-a2ca-4a8f-a9a9-d20917705739 tempest-AttachVolumeTestJSON-1295992640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:43:08 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-64e8d593-a2ca-4a8f-a9a9-d20917705739 tempest-AttachVolumeTestJSON-1295992640 None] Flow 'volume_create_manager' (291bcf33-0288-42be-acaf-b5351da6166b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:43:08 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-64e8d593-a2ca-4a8f-a9a9-d20917705739 tempest-AttachVolumeTestJSON-1295992640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5e3ea7c-569e-404b-a2c9-a2094c51ed69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:43:08 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-64e8d593-a2ca-4a8f-a9a9-d20917705739 tempest-AttachVolumeTestJSON-1295992640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5e3ea7c-569e-404b-a2c9-a2094c51ed69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1810249770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00290233-0edf-4388-8d59-770e813ee758,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f53e2b9be8464f7b8fb5ddd8da730e6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:43:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:43:08Z,use_quota=True,user_id='f4a2faa939b24437a5879ff1646f687e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:43:08 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-64e8d593-a2ca-4a8f-a9a9-d20917705739 tempest-AttachVolumeTestJSON-1295992640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ade01a9b-cfb3-469a-a6de-c5a6b46d7c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:43:08 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-64e8d593-a2ca-4a8f-a9a9-d20917705739 tempest-AttachVolumeTestJSON-1295992640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ade01a9b-cfb3-469a-a6de-c5a6b46d7c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:43:08 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-64e8d593-a2ca-4a8f-a9a9-d20917705739 tempest-AttachVolumeTestJSON-1295992640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2adcc31-72b6-404a-852d-6563e03a5236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:43:08 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-64e8d593-a2ca-4a8f-a9a9-d20917705739 tempest-AttachVolumeTestJSON-1295992640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2adcc31-72b6-404a-852d-6563e03a5236) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00290233-0edf-4388-8d59-770e813ee758', 'volume_name': 'volume-00290233-0edf-4388-8d59-770e813ee758', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:43:08 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-64e8d593-a2ca-4a8f-a9a9-d20917705739 tempest-AttachVolumeTestJSON-1295992640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a2410a8-c5a0-4f17-b6f3-87adfd0aab94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:43:08 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-64e8d593-a2ca-4a8f-a9a9-d20917705739 tempest-AttachVolumeTestJSON-1295992640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a2410a8-c5a0-4f17-b6f3-87adfd0aab94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:43:08 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-64e8d593-a2ca-4a8f-a9a9-d20917705739 tempest-AttachVolumeTestJSON-1295992640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d45f6f08-7441-47b6-843e-99cf5470b8f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:43:08 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-64e8d593-a2ca-4a8f-a9a9-d20917705739 tempest-AttachVolumeTestJSON-1295992640 None] Volume 00290233-0edf-4388-8d59-770e813ee758: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00290233-0edf-4388-8d59-770e813ee758', 'volume_size': 1} Jun 17 05:43:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-64e8d593-a2ca-4a8f-a9a9-d20917705739 tempest-AttachVolumeTestJSON-1295992640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:43:08 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-9ffab8bd-f78a-4897-949d-ee8227edceac tempest-GroupSnapshotsTest-649875217 None] Acquiring lock "cinder-quobyte-95be9554-cb62-4e9b-ad51-53a7f6658758" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:43:08 devstack sudo[97556]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a3341acd-8198-4d2c-973d-fcf3cbcb6515 tempest-VolumesTransfersV357Test-1886907615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-524c6cdd-27cc-4d0a-a2a0-2d0f0b2f5175 1073741824" returned: 0 in 1.014s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:08 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-9ffab8bd-f78a-4897-949d-ee8227edceac tempest-GroupSnapshotsTest-649875217 None] Lock "cinder-quobyte-95be9554-cb62-4e9b-ad51-53a7f6658758" acquired by "delete_volume" :: waited 0.019s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:43:08 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[20417367-9280-46fb-9807-4d89e54b9126]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:43:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-9ffab8bd-f78a-4897-949d-ee8227edceac tempest-GroupSnapshotsTest-649875217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-95be9554-cb62-4e9b-ad51-53a7f6658758 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a3341acd-8198-4d2c-973d-fcf3cbcb6515 tempest-VolumesTransfersV357Test-1886907615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-524c6cdd-27cc-4d0a-a2a0-2d0f0b2f5175 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:08 devstack sudo[97568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-524c6cdd-27cc-4d0a-a2a0-2d0f0b2f5175 Jun 17 05:43:08 devstack sudo[97568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:08 devstack sudo[97565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-95be9554-cb62-4e9b-ad51-53a7f6658758 Jun 17 05:43:08 devstack sudo[97565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:09 devstack sudo[97568]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a3341acd-8198-4d2c-973d-fcf3cbcb6515 tempest-VolumesTransfersV357Test-1886907615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-524c6cdd-27cc-4d0a-a2a0-2d0f0b2f5175" returned: 0 in 0.638s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:09 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-a3341acd-8198-4d2c-973d-fcf3cbcb6515 tempest-VolumesTransfersV357Test-1886907615 None] <== create_volume: return (1747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:43:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-a3341acd-8198-4d2c-973d-fcf3cbcb6515 tempest-VolumesTransfersV357Test-1886907615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.751s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:43:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-64e8d593-a2ca-4a8f-a9a9-d20917705739 tempest-AttachVolumeTestJSON-1295992640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.990s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:43:09 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-64e8d593-a2ca-4a8f-a9a9-d20917705739 tempest-AttachVolumeTestJSON-1295992640 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1810249770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00290233-0edf-4388-8d59-770e813ee758,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f53e2b9be8464f7b8fb5ddd8da730e6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:43:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:43:08Z,use_quota=True,user_id='f4a2faa939b24437a5879ff1646f687e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:43:09 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-64e8d593-a2ca-4a8f-a9a9-d20917705739 tempest-AttachVolumeTestJSON-1295992640 None] Creating volume 00290233-0edf-4388-8d59-770e813ee758 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:43:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-64e8d593-a2ca-4a8f-a9a9-d20917705739 tempest-AttachVolumeTestJSON-1295992640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:43:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-64e8d593-a2ca-4a8f-a9a9-d20917705739 tempest-AttachVolumeTestJSON-1295992640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:43:09 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-64e8d593-a2ca-4a8f-a9a9-d20917705739 tempest-AttachVolumeTestJSON-1295992640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:43:09 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-64e8d593-a2ca-4a8f-a9a9-d20917705739 tempest-AttachVolumeTestJSON-1295992640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:43:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-64e8d593-a2ca-4a8f-a9a9-d20917705739 tempest-AttachVolumeTestJSON-1295992640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:43:09 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-64e8d593-a2ca-4a8f-a9a9-d20917705739 tempest-AttachVolumeTestJSON-1295992640 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:43:09 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-64e8d593-a2ca-4a8f-a9a9-d20917705739 tempest-AttachVolumeTestJSON-1295992640 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:43:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-64e8d593-a2ca-4a8f-a9a9-d20917705739 tempest-AttachVolumeTestJSON-1295992640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00290233-0edf-4388-8d59-770e813ee758 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:09 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a3341acd-8198-4d2c-973d-fcf3cbcb6515 tempest-VolumesTransfersV357Test-1886907615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41fcbba2-9a97-42ca-8e52-7cb825d58d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-524c6cdd-27cc-4d0a-a2a0-2d0f0b2f5175', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:43:09 devstack sudo[97591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00290233-0edf-4388-8d59-770e813ee758 1073741824 Jun 17 05:43:09 devstack sudo[97591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:09 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a3341acd-8198-4d2c-973d-fcf3cbcb6515 tempest-VolumesTransfersV357Test-1886907615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6998ae19-7262-4c14-b6ab-b6a323fba7ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:43:09 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-a3341acd-8198-4d2c-973d-fcf3cbcb6515 tempest-VolumesTransfersV357Test-1886907615 None] Volume volume-524c6cdd-27cc-4d0a-a2a0-2d0f0b2f5175 (524c6cdd-27cc-4d0a-a2a0-2d0f0b2f5175): created successfully Jun 17 05:43:09 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a3341acd-8198-4d2c-973d-fcf3cbcb6515 tempest-VolumesTransfersV357Test-1886907615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6998ae19-7262-4c14-b6ab-b6a323fba7ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:43:09 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a3341acd-8198-4d2c-973d-fcf3cbcb6515 tempest-VolumesTransfersV357Test-1886907615 None] Flow 'volume_create_manager' (93d9001f-7046-4a5c-864d-67dd34e150a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:43:09 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-a3341acd-8198-4d2c-973d-fcf3cbcb6515 tempest-VolumesTransfersV357Test-1886907615 None] Created volume successfully. Jun 17 05:43:09 devstack sudo[97565]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-9ffab8bd-f78a-4897-949d-ee8227edceac tempest-GroupSnapshotsTest-649875217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-95be9554-cb62-4e9b-ad51-53a7f6658758" returned: 0 in 0.856s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-9ffab8bd-f78a-4897-949d-ee8227edceac tempest-GroupSnapshotsTest-649875217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-95be9554-cb62-4e9b-ad51-53a7f6658758 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:09 devstack sudo[97598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-95be9554-cb62-4e9b-ad51-53a7f6658758 Jun 17 05:43:09 devstack sudo[97598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:10 devstack sudo[97598]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-9ffab8bd-f78a-4897-949d-ee8227edceac tempest-GroupSnapshotsTest-649875217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-95be9554-cb62-4e9b-ad51-53a7f6658758" returned: 0 in 0.646s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:10 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-9ffab8bd-f78a-4897-949d-ee8227edceac tempest-GroupSnapshotsTest-649875217 None] Lock "cinder-quobyte-95be9554-cb62-4e9b-ad51-53a7f6658758" released by "delete_volume" :: held 1.565s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:43:10 devstack sudo[97591]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-64e8d593-a2ca-4a8f-a9a9-d20917705739 tempest-AttachVolumeTestJSON-1295992640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00290233-0edf-4388-8d59-770e813ee758 1073741824" returned: 0 in 0.923s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:10 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-9ffab8bd-f78a-4897-949d-ee8227edceac tempest-GroupSnapshotsTest-649875217 None] Created reservations ['22793bb4-5114-4b9f-a54f-d3a5d5c803a9'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:43:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-64e8d593-a2ca-4a8f-a9a9-d20917705739 tempest-AttachVolumeTestJSON-1295992640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00290233-0edf-4388-8d59-770e813ee758 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:10 devstack cinder-volume[92083]: WARNING cinder.quota [None req-9ffab8bd-f78a-4897-949d-ee8227edceac tempest-GroupSnapshotsTest-649875217 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1960193304 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1960193304, it is now deprecated. Please use the default quota class for default quota. Jun 17 05:43:10 devstack cinder-volume[92083]: WARNING cinder.quota [None req-9ffab8bd-f78a-4897-949d-ee8227edceac tempest-GroupSnapshotsTest-649875217 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1960193304 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1960193304, it is now deprecated. Please use the default quota class for default quota. Jun 17 05:43:10 devstack sudo[97612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00290233-0edf-4388-8d59-770e813ee758 Jun 17 05:43:10 devstack sudo[97612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:10 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-9ffab8bd-f78a-4897-949d-ee8227edceac tempest-GroupSnapshotsTest-649875217 None] Created reservations ['e44e2044-7018-4990-bc0c-3c8b411f707d', 'd9007940-b8ac-4af3-aa15-e7c9333494a8', 'd9c3f048-e593-4fa2-b8c9-de5623c5d2f5', 'a2589265-0073-4074-84bc-73084a4ca034'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:43:10 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-641a1baa-4534-40e0-b8f0-16366a7dda44 tempest-VolumesTransfersV357Test-592696015 None] Acquiring lock "cinder-524c6cdd-27cc-4d0a-a2a0-2d0f0b2f5175-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:43:10 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-641a1baa-4534-40e0-b8f0-16366a7dda44 tempest-VolumesTransfersV357Test-592696015 None] Lock "cinder-524c6cdd-27cc-4d0a-a2a0-2d0f0b2f5175-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:43:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-9ffab8bd-f78a-4897-949d-ee8227edceac tempest-GroupSnapshotsTest-649875217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:43:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-9ffab8bd-f78a-4897-949d-ee8227edceac tempest-GroupSnapshotsTest-649875217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:43:10 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-9ffab8bd-f78a-4897-949d-ee8227edceac tempest-GroupSnapshotsTest-649875217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:43:10 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-9ffab8bd-f78a-4897-949d-ee8227edceac tempest-GroupSnapshotsTest-649875217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:43:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-9ffab8bd-f78a-4897-949d-ee8227edceac tempest-GroupSnapshotsTest-649875217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:43:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-9ffab8bd-f78a-4897-949d-ee8227edceac tempest-GroupSnapshotsTest-649875217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:10 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-641a1baa-4534-40e0-b8f0-16366a7dda44 tempest-VolumesTransfersV357Test-592696015 None] Acquiring lock "cinder-quobyte-524c6cdd-27cc-4d0a-a2a0-2d0f0b2f5175" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:43:10 devstack sudo[97615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:43:10 devstack sudo[97615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:10 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-641a1baa-4534-40e0-b8f0-16366a7dda44 tempest-VolumesTransfersV357Test-592696015 None] Lock "cinder-quobyte-524c6cdd-27cc-4d0a-a2a0-2d0f0b2f5175" acquired by "delete_volume" :: waited 0.020s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:43:10 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a184d5b-b871-452a-a950-552c059ec987]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:43:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-641a1baa-4534-40e0-b8f0-16366a7dda44 tempest-VolumesTransfersV357Test-592696015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-524c6cdd-27cc-4d0a-a2a0-2d0f0b2f5175 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:10 devstack sudo[97617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-524c6cdd-27cc-4d0a-a2a0-2d0f0b2f5175 Jun 17 05:43:10 devstack sudo[97617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:11 devstack sudo[97612]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:11 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-ae673dbc-0e34-497a-872f-f71ab1030d36 tempest-GroupSnapshotsTest-649875217 None] group_snapshot 1d3fa85e-e975-4d46-9945-8f84e61b9a22: deleting Jun 17 05:43:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-64e8d593-a2ca-4a8f-a9a9-d20917705739 tempest-AttachVolumeTestJSON-1295992640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00290233-0edf-4388-8d59-770e813ee758" returned: 0 in 0.737s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:11 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-64e8d593-a2ca-4a8f-a9a9-d20917705739 tempest-AttachVolumeTestJSON-1295992640 None] <== create_volume: return (1720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:43:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-64e8d593-a2ca-4a8f-a9a9-d20917705739 tempest-AttachVolumeTestJSON-1295992640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.724s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:43:11 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-64e8d593-a2ca-4a8f-a9a9-d20917705739 tempest-AttachVolumeTestJSON-1295992640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d45f6f08-7441-47b6-843e-99cf5470b8f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00290233-0edf-4388-8d59-770e813ee758', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:43:11 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-64e8d593-a2ca-4a8f-a9a9-d20917705739 tempest-AttachVolumeTestJSON-1295992640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80f0de48-2ce3-4fe7-b363-92fe67b0d453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:43:11 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ae673dbc-0e34-497a-872f-f71ab1030d36 tempest-GroupSnapshotsTest-649875217 None] group_snapshot 1d3fa85e-e975-4d46-9945-8f84e61b9a22: deleting {{(pid=92083) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 17 05:43:11 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-64e8d593-a2ca-4a8f-a9a9-d20917705739 tempest-AttachVolumeTestJSON-1295992640 None] Volume volume-00290233-0edf-4388-8d59-770e813ee758 (00290233-0edf-4388-8d59-770e813ee758): created successfully Jun 17 05:43:11 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-64e8d593-a2ca-4a8f-a9a9-d20917705739 tempest-AttachVolumeTestJSON-1295992640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80f0de48-2ce3-4fe7-b363-92fe67b0d453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:43:11 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-64e8d593-a2ca-4a8f-a9a9-d20917705739 tempest-AttachVolumeTestJSON-1295992640 None] Flow 'volume_create_manager' (291bcf33-0288-42be-acaf-b5351da6166b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:43:11 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-ae673dbc-0e34-497a-872f-f71ab1030d36 tempest-GroupSnapshotsTest-649875217 None] Acquiring lock "cinder-quobyte-bc469e96-6a80-4098-b18b-80236a7307fa" by "delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:43:11 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-ae673dbc-0e34-497a-872f-f71ab1030d36 tempest-GroupSnapshotsTest-649875217 None] Lock "cinder-quobyte-bc469e96-6a80-4098-b18b-80236a7307fa" acquired by "delete_snapshot" :: waited 0.028s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:43:11 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-ae673dbc-0e34-497a-872f-f71ab1030d36 tempest-GroupSnapshotsTest-649875217 None] Acquiring lock "cinder-quobyte-68a9d7ac-1d3e-4565-a7f1-e433691586bb" by "_delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:43:11 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-64e8d593-a2ca-4a8f-a9a9-d20917705739 tempest-AttachVolumeTestJSON-1295992640 None] Created volume successfully. Jun 17 05:43:11 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-ae673dbc-0e34-497a-872f-f71ab1030d36 tempest-GroupSnapshotsTest-649875217 None] Lock "cinder-quobyte-68a9d7ac-1d3e-4565-a7f1-e433691586bb" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:43:11 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-ae673dbc-0e34-497a-872f-f71ab1030d36 tempest-GroupSnapshotsTest-649875217 None] Deleting offline snapshot 68a9d7ac-1d3e-4565-a7f1-e433691586bb of volume bc469e96-6a80-4098-b18b-80236a7307fa {{(pid=92083) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 17 05:43:11 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-ae673dbc-0e34-497a-872f-f71ab1030d36 tempest-GroupSnapshotsTest-649875217 None] snapshot_file for this snap is: volume-bc469e96-6a80-4098-b18b-80236a7307fa.68a9d7ac-1d3e-4565-a7f1-e433691586bb {{(pid=92083) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 17 05:43:11 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b3c9e1-fa15-4cb7-8cd3-a20f92135d7a]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:43:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ae673dbc-0e34-497a-872f-f71ab1030d36 tempest-GroupSnapshotsTest-649875217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bc469e96-6a80-4098-b18b-80236a7307fa.68a9d7ac-1d3e-4565-a7f1-e433691586bb {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:11 devstack sudo[97615]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-9ffab8bd-f78a-4897-949d-ee8227edceac tempest-GroupSnapshotsTest-649875217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.825s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:11 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-9ffab8bd-f78a-4897-949d-ee8227edceac tempest-GroupSnapshotsTest-649875217 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:43:11 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-9ffab8bd-f78a-4897-949d-ee8227edceac tempest-GroupSnapshotsTest-649875217 None] Delete group completed successfully. Jun 17 05:43:11 devstack sudo[97625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bc469e96-6a80-4098-b18b-80236a7307fa.68a9d7ac-1d3e-4565-a7f1-e433691586bb Jun 17 05:43:11 devstack sudo[97625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:11 devstack sudo[97617]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-641a1baa-4534-40e0-b8f0-16366a7dda44 tempest-VolumesTransfersV357Test-592696015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-524c6cdd-27cc-4d0a-a2a0-2d0f0b2f5175" returned: 0 in 0.920s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-641a1baa-4534-40e0-b8f0-16366a7dda44 tempest-VolumesTransfersV357Test-592696015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-524c6cdd-27cc-4d0a-a2a0-2d0f0b2f5175 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:11 devstack sudo[97627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-524c6cdd-27cc-4d0a-a2a0-2d0f0b2f5175 Jun 17 05:43:11 devstack sudo[97627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:12 devstack sudo[97625]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ae673dbc-0e34-497a-872f-f71ab1030d36 tempest-GroupSnapshotsTest-649875217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bc469e96-6a80-4098-b18b-80236a7307fa.68a9d7ac-1d3e-4565-a7f1-e433691586bb" returned: 0 in 0.845s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:12 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-ae673dbc-0e34-497a-872f-f71ab1030d36 tempest-GroupSnapshotsTest-649875217 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc469e96-6a80-4098-b18b-80236a7307fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92083) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 05:43:12 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[518d6c02-b874-4337-9066-6149f7a79043]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:43:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ae673dbc-0e34-497a-872f-f71ab1030d36 tempest-GroupSnapshotsTest-649875217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bc469e96-6a80-4098-b18b-80236a7307fa {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:12 devstack sudo[97627]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-641a1baa-4534-40e0-b8f0-16366a7dda44 tempest-VolumesTransfersV357Test-592696015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-524c6cdd-27cc-4d0a-a2a0-2d0f0b2f5175" returned: 0 in 0.746s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:12 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-641a1baa-4534-40e0-b8f0-16366a7dda44 tempest-VolumesTransfersV357Test-592696015 None] Lock "cinder-quobyte-524c6cdd-27cc-4d0a-a2a0-2d0f0b2f5175" released by "delete_volume" :: held 1.729s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:43:12 devstack sudo[97633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bc469e96-6a80-4098-b18b-80236a7307fa Jun 17 05:43:12 devstack sudo[97633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:12 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-641a1baa-4534-40e0-b8f0-16366a7dda44 tempest-VolumesTransfersV357Test-592696015 None] Created reservations ['0de0953e-9955-4df5-befb-a9629afc7b2b', 'b4c0dc99-81a4-4f1e-954c-f96f0d604dc5', 'ca42c788-4bd0-4092-85ad-12f761aa07e3', '6c3cbfee-5d8a-4085-97de-2c919ed5f8b3'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:43:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-641a1baa-4534-40e0-b8f0-16366a7dda44 tempest-VolumesTransfersV357Test-592696015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:43:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-641a1baa-4534-40e0-b8f0-16366a7dda44 tempest-VolumesTransfersV357Test-592696015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:43:12 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-641a1baa-4534-40e0-b8f0-16366a7dda44 tempest-VolumesTransfersV357Test-592696015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:43:12 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-641a1baa-4534-40e0-b8f0-16366a7dda44 tempest-VolumesTransfersV357Test-592696015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:43:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-641a1baa-4534-40e0-b8f0-16366a7dda44 tempest-VolumesTransfersV357Test-592696015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:43:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-641a1baa-4534-40e0-b8f0-16366a7dda44 tempest-VolumesTransfersV357Test-592696015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:12 devstack sudo[97635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:43:12 devstack sudo[97635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:13 devstack sudo[97633]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:13 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ae673dbc-0e34-497a-872f-f71ab1030d36 tempest-GroupSnapshotsTest-649875217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bc469e96-6a80-4098-b18b-80236a7307fa" returned: 0 in 0.872s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:13 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ae673dbc-0e34-497a-872f-f71ab1030d36 tempest-GroupSnapshotsTest-649875217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bc469e96-6a80-4098-b18b-80236a7307fa.68a9d7ac-1d3e-4565-a7f1-e433691586bb {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:13 devstack sudo[97635]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:13 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-641a1baa-4534-40e0-b8f0-16366a7dda44 tempest-VolumesTransfersV357Test-592696015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.673s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:13 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-641a1baa-4534-40e0-b8f0-16366a7dda44 tempest-VolumesTransfersV357Test-592696015 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:43:13 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-641a1baa-4534-40e0-b8f0-16366a7dda44 tempest-VolumesTransfersV357Test-592696015 None] Deleted volume successfully. Jun 17 05:43:13 devstack sudo[97709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bc469e96-6a80-4098-b18b-80236a7307fa.68a9d7ac-1d3e-4565-a7f1-e433691586bb Jun 17 05:43:13 devstack sudo[97709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:13 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-641a1baa-4534-40e0-b8f0-16366a7dda44 tempest-VolumesTransfersV357Test-592696015 None] Lock "cinder-524c6cdd-27cc-4d0a-a2a0-2d0f0b2f5175-delete_volume" released by "delete_volume" :: held 2.667s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:43:13 devstack sudo[97709]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:13 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ae673dbc-0e34-497a-872f-f71ab1030d36 tempest-GroupSnapshotsTest-649875217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bc469e96-6a80-4098-b18b-80236a7307fa.68a9d7ac-1d3e-4565-a7f1-e433691586bb" returned: 0 in 0.737s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:13 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ae673dbc-0e34-497a-872f-f71ab1030d36 tempest-GroupSnapshotsTest-649875217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bc469e96-6a80-4098-b18b-80236a7307fa.68a9d7ac-1d3e-4565-a7f1-e433691586bb {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:13 devstack sudo[97714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bc469e96-6a80-4098-b18b-80236a7307fa.68a9d7ac-1d3e-4565-a7f1-e433691586bb Jun 17 05:43:13 devstack sudo[97714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:14 devstack sudo[97714]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ae673dbc-0e34-497a-872f-f71ab1030d36 tempest-GroupSnapshotsTest-649875217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bc469e96-6a80-4098-b18b-80236a7307fa.68a9d7ac-1d3e-4565-a7f1-e433691586bb" returned: 0 in 0.745s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:14 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-ae673dbc-0e34-497a-872f-f71ab1030d36 tempest-GroupSnapshotsTest-649875217 None] Lock "cinder-quobyte-68a9d7ac-1d3e-4565-a7f1-e433691586bb" released by "_delete_snapshot" :: held 3.333s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:43:14 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-ae673dbc-0e34-497a-872f-f71ab1030d36 tempest-GroupSnapshotsTest-649875217 None] Lock "cinder-quobyte-bc469e96-6a80-4098-b18b-80236a7307fa" released by "delete_snapshot" :: held 3.379s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:43:14 devstack cinder-volume[92083]: WARNING cinder.quota [None req-ae673dbc-0e34-497a-872f-f71ab1030d36 tempest-GroupSnapshotsTest-649875217 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1960193304 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1960193304, it is now deprecated. Please use the default quota class for default quota. Jun 17 05:43:14 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-ae673dbc-0e34-497a-872f-f71ab1030d36 tempest-GroupSnapshotsTest-649875217 None] Created reservations ['b0b62d4e-940b-4309-807b-10f9723fa295', '0875a26d-dbba-4683-9b5e-8a9d92dc8905', 'f40f56a5-5845-423e-9c82-5eb0646d94c3', '321d2b90-b6e7-450d-8cfa-45175feb1248'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:43:14 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-ae673dbc-0e34-497a-872f-f71ab1030d36 tempest-GroupSnapshotsTest-649875217 None] group_snapshot 1d3fa85e-e975-4d46-9945-8f84e61b9a22: deleted successfully Jun 17 05:43:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-c45cf344-0db2-4e4f-a04e-6236f3feb340 req-554b971a-8a88-4a5d-a496-0575824edd0b tempest-AttachVolumeTestJSON-1295992640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:43:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-c45cf344-0db2-4e4f-a04e-6236f3feb340 req-554b971a-8a88-4a5d-a496-0575824edd0b tempest-AttachVolumeTestJSON-1295992640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:43:15 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7ec5a9-6a35-4e25-a5da-f1af9bb5234e]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:43:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-c45cf344-0db2-4e4f-a04e-6236f3feb340 req-554b971a-8a88-4a5d-a496-0575824edd0b tempest-AttachVolumeTestJSON-1295992640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00290233-0edf-4388-8d59-770e813ee758 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:15 devstack sudo[97734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00290233-0edf-4388-8d59-770e813ee758 Jun 17 05:43:15 devstack sudo[97734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:15 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-f0ea6eec-4dc7-4bf9-bfa6-27db1f99c39a tempest-GroupSnapshotsTest-649875217 None] Acquiring lock "cinder-quobyte-bc469e96-6a80-4098-b18b-80236a7307fa" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:43:15 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-f0ea6eec-4dc7-4bf9-bfa6-27db1f99c39a tempest-GroupSnapshotsTest-649875217 None] Lock "cinder-quobyte-bc469e96-6a80-4098-b18b-80236a7307fa" acquired by "delete_volume" :: waited 0.037s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:43:15 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b23e97-c912-407e-abb7-9eb4dc293835]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:43:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f0ea6eec-4dc7-4bf9-bfa6-27db1f99c39a tempest-GroupSnapshotsTest-649875217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bc469e96-6a80-4098-b18b-80236a7307fa {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:15 devstack sudo[97734]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-c45cf344-0db2-4e4f-a04e-6236f3feb340 req-554b971a-8a88-4a5d-a496-0575824edd0b tempest-AttachVolumeTestJSON-1295992640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00290233-0edf-4388-8d59-770e813ee758" returned: 0 in 0.915s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-c45cf344-0db2-4e4f-a04e-6236f3feb340 req-554b971a-8a88-4a5d-a496-0575824edd0b tempest-AttachVolumeTestJSON-1295992640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.937s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:43:16 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [req-c45cf344-0db2-4e4f-a04e-6236f3feb340 req-554b971a-8a88-4a5d-a496-0575824edd0b tempest-AttachVolumeTestJSON-1295992640 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f', 'name': 'volume-00290233-0edf-4388-8d59-770e813ee758', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '96432392-06c3-4e59-8058-02140b0fa5c8', 'enforce_multipath': True} {{(pid=92083) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 17 05:43:16 devstack sudo[97745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bc469e96-6a80-4098-b18b-80236a7307fa Jun 17 05:43:16 devstack sudo[97745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:16 devstack cinder-volume[92083]: INFO cinder.volume.manager [req-c45cf344-0db2-4e4f-a04e-6236f3feb340 req-554b971a-8a88-4a5d-a496-0575824edd0b tempest-AttachVolumeTestJSON-1295992640 None] attachment_update completed successfully. Jun 17 05:43:17 devstack sudo[97745]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f0ea6eec-4dc7-4bf9-bfa6-27db1f99c39a tempest-GroupSnapshotsTest-649875217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bc469e96-6a80-4098-b18b-80236a7307fa" returned: 0 in 1.206s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f0ea6eec-4dc7-4bf9-bfa6-27db1f99c39a tempest-GroupSnapshotsTest-649875217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bc469e96-6a80-4098-b18b-80236a7307fa {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:17 devstack sudo[98118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bc469e96-6a80-4098-b18b-80236a7307fa Jun 17 05:43:17 devstack sudo[98118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:17 devstack sudo[98118]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f0ea6eec-4dc7-4bf9-bfa6-27db1f99c39a tempest-GroupSnapshotsTest-649875217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bc469e96-6a80-4098-b18b-80236a7307fa" returned: 0 in 0.891s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:17 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-f0ea6eec-4dc7-4bf9-bfa6-27db1f99c39a tempest-GroupSnapshotsTest-649875217 None] Lock "cinder-quobyte-bc469e96-6a80-4098-b18b-80236a7307fa" released by "delete_volume" :: held 2.214s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:43:18 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-f0ea6eec-4dc7-4bf9-bfa6-27db1f99c39a tempest-GroupSnapshotsTest-649875217 None] Created reservations ['2b7b2b5b-45ad-4154-80de-c30570d75ad5'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:43:18 devstack cinder-volume[92083]: WARNING cinder.db.sqlalchemy.api [None req-f0ea6eec-4dc7-4bf9-bfa6-27db1f99c39a tempest-GroupSnapshotsTest-649875217 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1960193304'] Jun 17 05:43:18 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-f0ea6eec-4dc7-4bf9-bfa6-27db1f99c39a tempest-GroupSnapshotsTest-649875217 None] Created reservations ['07f542f0-321d-4d2b-9503-ebc809e7acdb', '3ec0dc9b-a27a-4280-9620-f642ce8e4ebe', 'c52b5f5b-930f-41b9-9926-c0403c924c7e', '82b5cd9c-10de-4fbe-b42e-b03f9e91b452'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:43:18 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-f0ea6eec-4dc7-4bf9-bfa6-27db1f99c39a tempest-GroupSnapshotsTest-649875217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:43:18 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-f0ea6eec-4dc7-4bf9-bfa6-27db1f99c39a tempest-GroupSnapshotsTest-649875217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:43:18 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-f0ea6eec-4dc7-4bf9-bfa6-27db1f99c39a tempest-GroupSnapshotsTest-649875217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:43:18 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-f0ea6eec-4dc7-4bf9-bfa6-27db1f99c39a tempest-GroupSnapshotsTest-649875217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:43:18 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-f0ea6eec-4dc7-4bf9-bfa6-27db1f99c39a tempest-GroupSnapshotsTest-649875217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:43:18 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f0ea6eec-4dc7-4bf9-bfa6-27db1f99c39a tempest-GroupSnapshotsTest-649875217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:18 devstack sudo[98127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:43:18 devstack sudo[98127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:19 devstack sudo[98127]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:19 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f0ea6eec-4dc7-4bf9-bfa6-27db1f99c39a tempest-GroupSnapshotsTest-649875217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.794s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:19 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-f0ea6eec-4dc7-4bf9-bfa6-27db1f99c39a tempest-GroupSnapshotsTest-649875217 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:43:19 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-f0ea6eec-4dc7-4bf9-bfa6-27db1f99c39a tempest-GroupSnapshotsTest-649875217 None] Delete group completed successfully. Jun 17 05:43:19 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-d7e2a114-e6bb-49da-9b02-2ed55099e5f0 tempest-GroupSnapshotsTest-649875217 None] Group tempest-GroupSnapshotsTest-Group-767446599: creating Jun 17 05:43:19 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-d7e2a114-e6bb-49da-9b02-2ed55099e5f0 tempest-GroupSnapshotsTest-649875217 None] Group tempest-GroupSnapshotsTest-Group-767446599: created successfully Jun 17 05:43:19 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-d7e2a114-e6bb-49da-9b02-2ed55099e5f0 tempest-GroupSnapshotsTest-649875217 None] Create group completed successfully. Jun 17 05:43:20 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae616405-3ea3-4bdd-a884-5753fa8855ef tempest-VolumesCloneNegativeTest-1791842652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:43:20 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ae616405-3ea3-4bdd-a884-5753fa8855ef tempest-VolumesCloneNegativeTest-1791842652 None] Flow 'volume_create_manager' (2bf10bf7-976c-47f7-af3e-f3aba7e7f7be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:43:20 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ae616405-3ea3-4bdd-a884-5753fa8855ef tempest-VolumesCloneNegativeTest-1791842652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae2b9e7f-3cc8-4f1d-b82b-e8ca99e80b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:43:20 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ae616405-3ea3-4bdd-a884-5753fa8855ef tempest-VolumesCloneNegativeTest-1791842652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae2b9e7f-3cc8-4f1d-b82b-e8ca99e80b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:43:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1044227580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=590e4da9-a801-4520-ab35-adbc4ada42e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78f740f42de84794be8168cd77508c98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:43:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:43:20Z,use_quota=True,user_id='d16b64629cf74ea6a4cdfc23e962ed93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:43:20 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ae616405-3ea3-4bdd-a884-5753fa8855ef tempest-VolumesCloneNegativeTest-1791842652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8dec94c-7ed9-4643-a7c7-13d655f554a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:43:20 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ae616405-3ea3-4bdd-a884-5753fa8855ef tempest-VolumesCloneNegativeTest-1791842652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8dec94c-7ed9-4643-a7c7-13d655f554a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:43:20 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ae616405-3ea3-4bdd-a884-5753fa8855ef tempest-VolumesCloneNegativeTest-1791842652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a939152f-18c9-413e-9897-413604a00ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:43:20 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ae616405-3ea3-4bdd-a884-5753fa8855ef tempest-VolumesCloneNegativeTest-1791842652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a939152f-18c9-413e-9897-413604a00ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '590e4da9-a801-4520-ab35-adbc4ada42e3', 'volume_name': 'volume-590e4da9-a801-4520-ab35-adbc4ada42e3', 'volume_size': 2}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:43:20 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ae616405-3ea3-4bdd-a884-5753fa8855ef tempest-VolumesCloneNegativeTest-1791842652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00dbca8a-2b9f-4029-abc9-c05b209a56da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:43:20 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ae616405-3ea3-4bdd-a884-5753fa8855ef tempest-VolumesCloneNegativeTest-1791842652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00dbca8a-2b9f-4029-abc9-c05b209a56da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:43:20 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ae616405-3ea3-4bdd-a884-5753fa8855ef tempest-VolumesCloneNegativeTest-1791842652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08279986-d524-4351-83dd-6e34e31f1d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:43:20 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-ae616405-3ea3-4bdd-a884-5753fa8855ef tempest-VolumesCloneNegativeTest-1791842652 None] Volume 590e4da9-a801-4520-ab35-adbc4ada42e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-590e4da9-a801-4520-ab35-adbc4ada42e3', 'volume_size': 2} Jun 17 05:43:20 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ae616405-3ea3-4bdd-a884-5753fa8855ef tempest-VolumesCloneNegativeTest-1791842652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:43:20 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ae616405-3ea3-4bdd-a884-5753fa8855ef tempest-VolumesCloneNegativeTest-1791842652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:43:20 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ae616405-3ea3-4bdd-a884-5753fa8855ef tempest-VolumesCloneNegativeTest-1791842652 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:43:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1044227580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=590e4da9-a801-4520-ab35-adbc4ada42e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78f740f42de84794be8168cd77508c98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:43:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:43:20Z,use_quota=True,user_id='d16b64629cf74ea6a4cdfc23e962ed93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:43:20 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-ae616405-3ea3-4bdd-a884-5753fa8855ef tempest-VolumesCloneNegativeTest-1791842652 None] Creating volume 590e4da9-a801-4520-ab35-adbc4ada42e3 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:43:20 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ae616405-3ea3-4bdd-a884-5753fa8855ef tempest-VolumesCloneNegativeTest-1791842652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:43:20 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ae616405-3ea3-4bdd-a884-5753fa8855ef tempest-VolumesCloneNegativeTest-1791842652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:43:20 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ae616405-3ea3-4bdd-a884-5753fa8855ef tempest-VolumesCloneNegativeTest-1791842652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:43:20 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ae616405-3ea3-4bdd-a884-5753fa8855ef tempest-VolumesCloneNegativeTest-1791842652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:43:20 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ae616405-3ea3-4bdd-a884-5753fa8855ef tempest-VolumesCloneNegativeTest-1791842652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:43:20 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ae616405-3ea3-4bdd-a884-5753fa8855ef tempest-VolumesCloneNegativeTest-1791842652 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:43:20 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-ae616405-3ea3-4bdd-a884-5753fa8855ef tempest-VolumesCloneNegativeTest-1791842652 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:43:20 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ae616405-3ea3-4bdd-a884-5753fa8855ef tempest-VolumesCloneNegativeTest-1791842652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-590e4da9-a801-4520-ab35-adbc4ada42e3 2147483648 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:20 devstack sudo[98132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-590e4da9-a801-4520-ab35-adbc4ada42e3 2147483648 Jun 17 05:43:20 devstack sudo[98132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:20 devstack sudo[98132]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:20 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ae616405-3ea3-4bdd-a884-5753fa8855ef tempest-VolumesCloneNegativeTest-1791842652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-590e4da9-a801-4520-ab35-adbc4ada42e3 2147483648" returned: 0 in 0.893s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:21 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ae616405-3ea3-4bdd-a884-5753fa8855ef tempest-VolumesCloneNegativeTest-1791842652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-590e4da9-a801-4520-ab35-adbc4ada42e3 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:21 devstack sudo[98138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-590e4da9-a801-4520-ab35-adbc4ada42e3 Jun 17 05:43:21 devstack sudo[98138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:21 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5add9cd-ec7f-4e8a-8d28-adc2ca16aa03 tempest-AttachVolumeTestJSON-1295992640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:43:21 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c5add9cd-ec7f-4e8a-8d28-adc2ca16aa03 tempest-AttachVolumeTestJSON-1295992640 None] Flow 'volume_create_manager' (bb9e938b-41d1-4035-b465-32ab7b3fa135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:43:21 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c5add9cd-ec7f-4e8a-8d28-adc2ca16aa03 tempest-AttachVolumeTestJSON-1295992640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c5431ba-2ece-461c-8674-515e2ffd4c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:43:21 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c5add9cd-ec7f-4e8a-8d28-adc2ca16aa03 tempest-AttachVolumeTestJSON-1295992640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c5431ba-2ece-461c-8674-515e2ffd4c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:43:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-425602794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15a4f55a-c42f-4c17-9ce7-a037c7a3faac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f53e2b9be8464f7b8fb5ddd8da730e6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:43:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:43:21Z,use_quota=True,user_id='f4a2faa939b24437a5879ff1646f687e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:43:21 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c5add9cd-ec7f-4e8a-8d28-adc2ca16aa03 tempest-AttachVolumeTestJSON-1295992640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5db499f4-8516-4347-ba09-3d301175355a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:43:21 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c5add9cd-ec7f-4e8a-8d28-adc2ca16aa03 tempest-AttachVolumeTestJSON-1295992640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5db499f4-8516-4347-ba09-3d301175355a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:43:21 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c5add9cd-ec7f-4e8a-8d28-adc2ca16aa03 tempest-AttachVolumeTestJSON-1295992640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aef4dd45-63b8-452f-be7a-ed839f097ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:43:21 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c5add9cd-ec7f-4e8a-8d28-adc2ca16aa03 tempest-AttachVolumeTestJSON-1295992640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aef4dd45-63b8-452f-be7a-ed839f097ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15a4f55a-c42f-4c17-9ce7-a037c7a3faac', 'volume_name': 'volume-15a4f55a-c42f-4c17-9ce7-a037c7a3faac', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:43:21 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c5add9cd-ec7f-4e8a-8d28-adc2ca16aa03 tempest-AttachVolumeTestJSON-1295992640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96ea9fb3-85b3-481e-a188-fee893151654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:43:21 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c5add9cd-ec7f-4e8a-8d28-adc2ca16aa03 tempest-AttachVolumeTestJSON-1295992640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96ea9fb3-85b3-481e-a188-fee893151654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:43:21 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c5add9cd-ec7f-4e8a-8d28-adc2ca16aa03 tempest-AttachVolumeTestJSON-1295992640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1c8a6f3-ad9b-4373-9e4b-1679dc19ba31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:43:21 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-c5add9cd-ec7f-4e8a-8d28-adc2ca16aa03 tempest-AttachVolumeTestJSON-1295992640 None] Volume 15a4f55a-c42f-4c17-9ce7-a037c7a3faac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15a4f55a-c42f-4c17-9ce7-a037c7a3faac', 'volume_size': 1} Jun 17 05:43:21 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-c5add9cd-ec7f-4e8a-8d28-adc2ca16aa03 tempest-AttachVolumeTestJSON-1295992640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:43:21 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ff00533-2662-4968-a27f-9754d8e5b59d tempest-GroupSnapshotsTest-649875217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:43:21 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4ff00533-2662-4968-a27f-9754d8e5b59d tempest-GroupSnapshotsTest-649875217 None] Flow 'volume_create_manager' (0088bd25-6104-4ad3-b89e-dadfcb39e81a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:43:21 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4ff00533-2662-4968-a27f-9754d8e5b59d tempest-GroupSnapshotsTest-649875217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc45a9c9-2878-48bf-b5bd-6e7b761fb02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:43:21 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4ff00533-2662-4968-a27f-9754d8e5b59d tempest-GroupSnapshotsTest-649875217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc45a9c9-2878-48bf-b5bd-6e7b761fb02a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:43:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-715426320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ef23f2d4-d015-4b71-a5fb-d2fd08c6f6dd,host='devstack@QuobyteHD#QuobyteHD',id=779051a0-8c71-438a-876c-0063f6feaa63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be4b791c6d8248eea35b95220d502055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:43:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:43:21Z,use_quota=True,user_id='42d27ebd58fd4929b3814c4c838ced2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(298768fe-053c-46b3-898f-23c40888e079),volume_type_id=298768fe-053c-46b3-898f-23c40888e079)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:43:21 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4ff00533-2662-4968-a27f-9754d8e5b59d tempest-GroupSnapshotsTest-649875217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55d5059c-93a0-4151-a5d7-501cf5f36ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:43:21 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4ff00533-2662-4968-a27f-9754d8e5b59d tempest-GroupSnapshotsTest-649875217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55d5059c-93a0-4151-a5d7-501cf5f36ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:43:21 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4ff00533-2662-4968-a27f-9754d8e5b59d tempest-GroupSnapshotsTest-649875217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b57405f-df50-4945-a656-7c66c48e3f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:43:21 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4ff00533-2662-4968-a27f-9754d8e5b59d tempest-GroupSnapshotsTest-649875217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b57405f-df50-4945-a656-7c66c48e3f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '779051a0-8c71-438a-876c-0063f6feaa63', 'volume_name': 'volume-779051a0-8c71-438a-876c-0063f6feaa63', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:43:21 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4ff00533-2662-4968-a27f-9754d8e5b59d tempest-GroupSnapshotsTest-649875217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95749192-5050-4193-b842-d855eba679be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:43:21 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4ff00533-2662-4968-a27f-9754d8e5b59d tempest-GroupSnapshotsTest-649875217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95749192-5050-4193-b842-d855eba679be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:43:21 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4ff00533-2662-4968-a27f-9754d8e5b59d tempest-GroupSnapshotsTest-649875217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00b6b7e4-cb56-445f-a232-681fc0a4d5d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:43:21 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-4ff00533-2662-4968-a27f-9754d8e5b59d tempest-GroupSnapshotsTest-649875217 None] Volume 779051a0-8c71-438a-876c-0063f6feaa63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-779051a0-8c71-438a-876c-0063f6feaa63', 'volume_size': 1} Jun 17 05:43:21 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-4ff00533-2662-4968-a27f-9754d8e5b59d tempest-GroupSnapshotsTest-649875217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:43:21 devstack sudo[98138]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:21 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ae616405-3ea3-4bdd-a884-5753fa8855ef tempest-VolumesCloneNegativeTest-1791842652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-590e4da9-a801-4520-ab35-adbc4ada42e3" returned: 0 in 0.733s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:21 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ae616405-3ea3-4bdd-a884-5753fa8855ef tempest-VolumesCloneNegativeTest-1791842652 None] <== create_volume: return (1700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:43:21 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ae616405-3ea3-4bdd-a884-5753fa8855ef tempest-VolumesCloneNegativeTest-1791842652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.703s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:43:21 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-c5add9cd-ec7f-4e8a-8d28-adc2ca16aa03 tempest-AttachVolumeTestJSON-1295992640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.508s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:43:21 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-c5add9cd-ec7f-4e8a-8d28-adc2ca16aa03 tempest-AttachVolumeTestJSON-1295992640 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:43:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-425602794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15a4f55a-c42f-4c17-9ce7-a037c7a3faac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f53e2b9be8464f7b8fb5ddd8da730e6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:43:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:43:21Z,use_quota=True,user_id='f4a2faa939b24437a5879ff1646f687e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:43:21 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-c5add9cd-ec7f-4e8a-8d28-adc2ca16aa03 tempest-AttachVolumeTestJSON-1295992640 None] Creating volume 15a4f55a-c42f-4c17-9ce7-a037c7a3faac {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:43:21 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-c5add9cd-ec7f-4e8a-8d28-adc2ca16aa03 tempest-AttachVolumeTestJSON-1295992640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:43:21 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-c5add9cd-ec7f-4e8a-8d28-adc2ca16aa03 tempest-AttachVolumeTestJSON-1295992640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:43:21 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-c5add9cd-ec7f-4e8a-8d28-adc2ca16aa03 tempest-AttachVolumeTestJSON-1295992640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:43:21 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-c5add9cd-ec7f-4e8a-8d28-adc2ca16aa03 tempest-AttachVolumeTestJSON-1295992640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:43:21 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-c5add9cd-ec7f-4e8a-8d28-adc2ca16aa03 tempest-AttachVolumeTestJSON-1295992640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:43:21 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-c5add9cd-ec7f-4e8a-8d28-adc2ca16aa03 tempest-AttachVolumeTestJSON-1295992640 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:43:21 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-c5add9cd-ec7f-4e8a-8d28-adc2ca16aa03 tempest-AttachVolumeTestJSON-1295992640 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:43:21 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c5add9cd-ec7f-4e8a-8d28-adc2ca16aa03 tempest-AttachVolumeTestJSON-1295992640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-15a4f55a-c42f-4c17-9ce7-a037c7a3faac 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:21 devstack sudo[98141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-15a4f55a-c42f-4c17-9ce7-a037c7a3faac 1073741824 Jun 17 05:43:21 devstack sudo[98141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:21 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ae616405-3ea3-4bdd-a884-5753fa8855ef tempest-VolumesCloneNegativeTest-1791842652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08279986-d524-4351-83dd-6e34e31f1d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-590e4da9-a801-4520-ab35-adbc4ada42e3', 'volume_size': 2}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:43:21 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ae616405-3ea3-4bdd-a884-5753fa8855ef tempest-VolumesCloneNegativeTest-1791842652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eb24601-e077-4aa6-9376-435076144433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:43:21 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-ae616405-3ea3-4bdd-a884-5753fa8855ef tempest-VolumesCloneNegativeTest-1791842652 None] Volume volume-590e4da9-a801-4520-ab35-adbc4ada42e3 (590e4da9-a801-4520-ab35-adbc4ada42e3): created successfully Jun 17 05:43:21 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ae616405-3ea3-4bdd-a884-5753fa8855ef tempest-VolumesCloneNegativeTest-1791842652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eb24601-e077-4aa6-9376-435076144433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:43:21 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ae616405-3ea3-4bdd-a884-5753fa8855ef tempest-VolumesCloneNegativeTest-1791842652 None] Flow 'volume_create_manager' (2bf10bf7-976c-47f7-af3e-f3aba7e7f7be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:43:21 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-ae616405-3ea3-4bdd-a884-5753fa8855ef tempest-VolumesCloneNegativeTest-1791842652 None] Created volume successfully. Jun 17 05:43:22 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-a06ef565-3014-48e1-9b2d-dc4f992706d1 tempest-VolumesCloneNegativeTest-1791842652 None] Acquiring lock "cinder-590e4da9-a801-4520-ab35-adbc4ada42e3-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:43:22 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-a06ef565-3014-48e1-9b2d-dc4f992706d1 tempest-VolumesCloneNegativeTest-1791842652 None] Lock "cinder-590e4da9-a801-4520-ab35-adbc4ada42e3-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:43:22 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-a06ef565-3014-48e1-9b2d-dc4f992706d1 tempest-VolumesCloneNegativeTest-1791842652 None] Acquiring lock "cinder-quobyte-590e4da9-a801-4520-ab35-adbc4ada42e3" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:43:22 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-a06ef565-3014-48e1-9b2d-dc4f992706d1 tempest-VolumesCloneNegativeTest-1791842652 None] Lock "cinder-quobyte-590e4da9-a801-4520-ab35-adbc4ada42e3" acquired by "delete_volume" :: waited 0.041s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:43:22 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[de60d79a-44d4-44ca-9a26-15453f491195]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:43:22 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a06ef565-3014-48e1-9b2d-dc4f992706d1 tempest-VolumesCloneNegativeTest-1791842652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-590e4da9-a801-4520-ab35-adbc4ada42e3 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:22 devstack sudo[98141]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:22 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c5add9cd-ec7f-4e8a-8d28-adc2ca16aa03 tempest-AttachVolumeTestJSON-1295992640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-15a4f55a-c42f-4c17-9ce7-a037c7a3faac 1073741824" returned: 0 in 0.870s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:22 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c5add9cd-ec7f-4e8a-8d28-adc2ca16aa03 tempest-AttachVolumeTestJSON-1295992640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-15a4f55a-c42f-4c17-9ce7-a037c7a3faac {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:22 devstack sudo[98147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-590e4da9-a801-4520-ab35-adbc4ada42e3 Jun 17 05:43:22 devstack sudo[98147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:22 devstack sudo[98148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-15a4f55a-c42f-4c17-9ce7-a037c7a3faac Jun 17 05:43:22 devstack sudo[98148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:23 devstack sudo[98148]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:23 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c5add9cd-ec7f-4e8a-8d28-adc2ca16aa03 tempest-AttachVolumeTestJSON-1295992640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-15a4f55a-c42f-4c17-9ce7-a037c7a3faac" returned: 0 in 0.593s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:23 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-c5add9cd-ec7f-4e8a-8d28-adc2ca16aa03 tempest-AttachVolumeTestJSON-1295992640 None] <== create_volume: return (1512ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:43:23 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-c5add9cd-ec7f-4e8a-8d28-adc2ca16aa03 tempest-AttachVolumeTestJSON-1295992640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.515s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:43:23 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-4ff00533-2662-4968-a27f-9754d8e5b59d tempest-GroupSnapshotsTest-649875217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.774s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:43:23 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-4ff00533-2662-4968-a27f-9754d8e5b59d tempest-GroupSnapshotsTest-649875217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ef23f2d4-d015-4b71-a5fb-d2fd08c6f6dd,created_at=2026-06-17T03:43:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-715426320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ef23f2d4-d015-4b71-a5fb-d2fd08c6f6dd,host='devstack@QuobyteHD#QuobyteHD',id=779051a0-8c71-438a-876c-0063f6feaa63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be4b791c6d8248eea35b95220d502055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:43:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:43:21Z,use_quota=True,user_id='42d27ebd58fd4929b3814c4c838ced2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(298768fe-053c-46b3-898f-23c40888e079),volume_type_id=298768fe-053c-46b3-898f-23c40888e079)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:43:23 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-4ff00533-2662-4968-a27f-9754d8e5b59d tempest-GroupSnapshotsTest-649875217 None] Creating volume 779051a0-8c71-438a-876c-0063f6feaa63 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:43:23 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-4ff00533-2662-4968-a27f-9754d8e5b59d tempest-GroupSnapshotsTest-649875217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:43:23 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-4ff00533-2662-4968-a27f-9754d8e5b59d tempest-GroupSnapshotsTest-649875217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:43:23 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-4ff00533-2662-4968-a27f-9754d8e5b59d tempest-GroupSnapshotsTest-649875217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:43:23 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-4ff00533-2662-4968-a27f-9754d8e5b59d tempest-GroupSnapshotsTest-649875217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:43:23 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-4ff00533-2662-4968-a27f-9754d8e5b59d tempest-GroupSnapshotsTest-649875217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:43:23 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-4ff00533-2662-4968-a27f-9754d8e5b59d tempest-GroupSnapshotsTest-649875217 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:43:23 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-4ff00533-2662-4968-a27f-9754d8e5b59d tempest-GroupSnapshotsTest-649875217 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:43:23 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4ff00533-2662-4968-a27f-9754d8e5b59d tempest-GroupSnapshotsTest-649875217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-779051a0-8c71-438a-876c-0063f6feaa63 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:23 devstack sudo[98147]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:23 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a06ef565-3014-48e1-9b2d-dc4f992706d1 tempest-VolumesCloneNegativeTest-1791842652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-590e4da9-a801-4520-ab35-adbc4ada42e3" returned: 0 in 0.752s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:23 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a06ef565-3014-48e1-9b2d-dc4f992706d1 tempest-VolumesCloneNegativeTest-1791842652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-590e4da9-a801-4520-ab35-adbc4ada42e3 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:23 devstack sudo[98156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-779051a0-8c71-438a-876c-0063f6feaa63 1073741824 Jun 17 05:43:23 devstack sudo[98156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:23 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c5add9cd-ec7f-4e8a-8d28-adc2ca16aa03 tempest-AttachVolumeTestJSON-1295992640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1c8a6f3-ad9b-4373-9e4b-1679dc19ba31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15a4f55a-c42f-4c17-9ce7-a037c7a3faac', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:43:23 devstack sudo[98168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-590e4da9-a801-4520-ab35-adbc4ada42e3 Jun 17 05:43:23 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c5add9cd-ec7f-4e8a-8d28-adc2ca16aa03 tempest-AttachVolumeTestJSON-1295992640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae7efb57-79d0-4f8f-b3ee-21291bccda42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:43:23 devstack sudo[98168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:23 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-c5add9cd-ec7f-4e8a-8d28-adc2ca16aa03 tempest-AttachVolumeTestJSON-1295992640 None] Volume volume-15a4f55a-c42f-4c17-9ce7-a037c7a3faac (15a4f55a-c42f-4c17-9ce7-a037c7a3faac): created successfully Jun 17 05:43:23 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c5add9cd-ec7f-4e8a-8d28-adc2ca16aa03 tempest-AttachVolumeTestJSON-1295992640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae7efb57-79d0-4f8f-b3ee-21291bccda42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:43:23 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c5add9cd-ec7f-4e8a-8d28-adc2ca16aa03 tempest-AttachVolumeTestJSON-1295992640 None] Flow 'volume_create_manager' (bb9e938b-41d1-4035-b465-32ab7b3fa135) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:43:23 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-c5add9cd-ec7f-4e8a-8d28-adc2ca16aa03 tempest-AttachVolumeTestJSON-1295992640 None] Created volume successfully. Jun 17 05:43:24 devstack sudo[98168]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a06ef565-3014-48e1-9b2d-dc4f992706d1 tempest-VolumesCloneNegativeTest-1791842652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-590e4da9-a801-4520-ab35-adbc4ada42e3" returned: 0 in 0.842s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:24 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-a06ef565-3014-48e1-9b2d-dc4f992706d1 tempest-VolumesCloneNegativeTest-1791842652 None] Lock "cinder-quobyte-590e4da9-a801-4520-ab35-adbc4ada42e3" released by "delete_volume" :: held 1.645s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:43:24 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-a06ef565-3014-48e1-9b2d-dc4f992706d1 tempest-VolumesCloneNegativeTest-1791842652 None] Created reservations ['4d4159d5-fd07-4d8d-bfc1-ca802deac510', '9716c5f0-a602-45b3-b62c-058fc699be1a', 'fcf619eb-f987-4d28-9cdb-e6f3f7d98218', '98b08a03-c6e9-484e-a235-a99646c2f84f'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:43:24 devstack sudo[98156]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4ff00533-2662-4968-a27f-9754d8e5b59d tempest-GroupSnapshotsTest-649875217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-779051a0-8c71-438a-876c-0063f6feaa63 1073741824" returned: 0 in 0.968s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-a06ef565-3014-48e1-9b2d-dc4f992706d1 tempest-VolumesCloneNegativeTest-1791842652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:43:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-a06ef565-3014-48e1-9b2d-dc4f992706d1 tempest-VolumesCloneNegativeTest-1791842652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:43:24 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-a06ef565-3014-48e1-9b2d-dc4f992706d1 tempest-VolumesCloneNegativeTest-1791842652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:43:24 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-a06ef565-3014-48e1-9b2d-dc4f992706d1 tempest-VolumesCloneNegativeTest-1791842652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:43:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-a06ef565-3014-48e1-9b2d-dc4f992706d1 tempest-VolumesCloneNegativeTest-1791842652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:43:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a06ef565-3014-48e1-9b2d-dc4f992706d1 tempest-VolumesCloneNegativeTest-1791842652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4ff00533-2662-4968-a27f-9754d8e5b59d tempest-GroupSnapshotsTest-649875217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-779051a0-8c71-438a-876c-0063f6feaa63 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:24 devstack sudo[98201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:43:24 devstack sudo[98201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:24 devstack sudo[98202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-779051a0-8c71-438a-876c-0063f6feaa63 Jun 17 05:43:24 devstack sudo[98202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:25 devstack sudo[98202]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4ff00533-2662-4968-a27f-9754d8e5b59d tempest-GroupSnapshotsTest-649875217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-779051a0-8c71-438a-876c-0063f6feaa63" returned: 0 in 0.756s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:25 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-4ff00533-2662-4968-a27f-9754d8e5b59d tempest-GroupSnapshotsTest-649875217 None] <== create_volume: return (1786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:43:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-4ff00533-2662-4968-a27f-9754d8e5b59d tempest-GroupSnapshotsTest-649875217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.789s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:43:25 devstack sudo[98201]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a06ef565-3014-48e1-9b2d-dc4f992706d1 tempest-VolumesCloneNegativeTest-1791842652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.791s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:25 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-a06ef565-3014-48e1-9b2d-dc4f992706d1 tempest-VolumesCloneNegativeTest-1791842652 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:43:25 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4ff00533-2662-4968-a27f-9754d8e5b59d tempest-GroupSnapshotsTest-649875217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00b6b7e4-cb56-445f-a232-681fc0a4d5d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-779051a0-8c71-438a-876c-0063f6feaa63', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:43:25 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4ff00533-2662-4968-a27f-9754d8e5b59d tempest-GroupSnapshotsTest-649875217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (315bad1a-b8c6-48f7-a3c5-b1fd1e2acf13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:43:25 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-a06ef565-3014-48e1-9b2d-dc4f992706d1 tempest-VolumesCloneNegativeTest-1791842652 None] Deleted volume successfully. Jun 17 05:43:25 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-4ff00533-2662-4968-a27f-9754d8e5b59d tempest-GroupSnapshotsTest-649875217 None] Volume volume-779051a0-8c71-438a-876c-0063f6feaa63 (779051a0-8c71-438a-876c-0063f6feaa63): created successfully Jun 17 05:43:25 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4ff00533-2662-4968-a27f-9754d8e5b59d tempest-GroupSnapshotsTest-649875217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (315bad1a-b8c6-48f7-a3c5-b1fd1e2acf13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:43:25 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4ff00533-2662-4968-a27f-9754d8e5b59d tempest-GroupSnapshotsTest-649875217 None] Flow 'volume_create_manager' (0088bd25-6104-4ad3-b89e-dadfcb39e81a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:43:25 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-a06ef565-3014-48e1-9b2d-dc4f992706d1 tempest-VolumesCloneNegativeTest-1791842652 None] Lock "cinder-590e4da9-a801-4520-ab35-adbc4ada42e3-delete_volume" released by "delete_volume" :: held 2.748s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:43:25 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-4ff00533-2662-4968-a27f-9754d8e5b59d tempest-GroupSnapshotsTest-649875217 None] Created volume successfully. Jun 17 05:43:26 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bf6afd9-6b39-482c-b080-8c40f8a5d474 tempest-GroupSnapshotsTest-649875217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:43:26 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-3bf6afd9-6b39-482c-b080-8c40f8a5d474 tempest-GroupSnapshotsTest-649875217 None] Flow 'volume_create_manager' (ea02f371-f47f-4100-90e3-eb20495a4c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:43:26 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-3bf6afd9-6b39-482c-b080-8c40f8a5d474 tempest-GroupSnapshotsTest-649875217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (709c846f-aaaf-4c6c-ba64-ea2592815f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:43:26 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-3bf6afd9-6b39-482c-b080-8c40f8a5d474 tempest-GroupSnapshotsTest-649875217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (709c846f-aaaf-4c6c-ba64-ea2592815f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:43:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-181010898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ef23f2d4-d015-4b71-a5fb-d2fd08c6f6dd,host='devstack@QuobyteHD#QuobyteHD',id=ade49af7-bcc7-450a-ba66-8f76865d8211,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be4b791c6d8248eea35b95220d502055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:43:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:43:26Z,use_quota=True,user_id='42d27ebd58fd4929b3814c4c838ced2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(298768fe-053c-46b3-898f-23c40888e079),volume_type_id=298768fe-053c-46b3-898f-23c40888e079)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:43:26 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-3bf6afd9-6b39-482c-b080-8c40f8a5d474 tempest-GroupSnapshotsTest-649875217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22a47d3e-66b5-46a0-8705-b2809acd30cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:43:26 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-3bf6afd9-6b39-482c-b080-8c40f8a5d474 tempest-GroupSnapshotsTest-649875217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22a47d3e-66b5-46a0-8705-b2809acd30cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:43:26 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-3bf6afd9-6b39-482c-b080-8c40f8a5d474 tempest-GroupSnapshotsTest-649875217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2af9b13-a675-4585-84f2-cd2869f13770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:43:26 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-3bf6afd9-6b39-482c-b080-8c40f8a5d474 tempest-GroupSnapshotsTest-649875217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2af9b13-a675-4585-84f2-cd2869f13770) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ade49af7-bcc7-450a-ba66-8f76865d8211', 'volume_name': 'volume-ade49af7-bcc7-450a-ba66-8f76865d8211', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:43:26 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-3bf6afd9-6b39-482c-b080-8c40f8a5d474 tempest-GroupSnapshotsTest-649875217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3023f7fb-9a82-45e8-a580-d4eabd30082e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:43:26 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-3bf6afd9-6b39-482c-b080-8c40f8a5d474 tempest-GroupSnapshotsTest-649875217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3023f7fb-9a82-45e8-a580-d4eabd30082e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:43:26 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-3bf6afd9-6b39-482c-b080-8c40f8a5d474 tempest-GroupSnapshotsTest-649875217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (313613e9-9f7c-46fe-a785-b88f29564b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:43:26 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-3bf6afd9-6b39-482c-b080-8c40f8a5d474 tempest-GroupSnapshotsTest-649875217 None] Volume ade49af7-bcc7-450a-ba66-8f76865d8211: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ade49af7-bcc7-450a-ba66-8f76865d8211', 'volume_size': 1} Jun 17 05:43:26 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-3bf6afd9-6b39-482c-b080-8c40f8a5d474 tempest-GroupSnapshotsTest-649875217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:43:26 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-3bf6afd9-6b39-482c-b080-8c40f8a5d474 tempest-GroupSnapshotsTest-649875217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:43:26 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-3bf6afd9-6b39-482c-b080-8c40f8a5d474 tempest-GroupSnapshotsTest-649875217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ef23f2d4-d015-4b71-a5fb-d2fd08c6f6dd,created_at=2026-06-17T03:43:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-181010898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ef23f2d4-d015-4b71-a5fb-d2fd08c6f6dd,host='devstack@QuobyteHD#QuobyteHD',id=ade49af7-bcc7-450a-ba66-8f76865d8211,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be4b791c6d8248eea35b95220d502055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:43:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:43:26Z,use_quota=True,user_id='42d27ebd58fd4929b3814c4c838ced2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(298768fe-053c-46b3-898f-23c40888e079),volume_type_id=298768fe-053c-46b3-898f-23c40888e079)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:43:26 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-3bf6afd9-6b39-482c-b080-8c40f8a5d474 tempest-GroupSnapshotsTest-649875217 None] Creating volume ade49af7-bcc7-450a-ba66-8f76865d8211 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:43:26 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-3bf6afd9-6b39-482c-b080-8c40f8a5d474 tempest-GroupSnapshotsTest-649875217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:43:26 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-3bf6afd9-6b39-482c-b080-8c40f8a5d474 tempest-GroupSnapshotsTest-649875217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:43:26 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-3bf6afd9-6b39-482c-b080-8c40f8a5d474 tempest-GroupSnapshotsTest-649875217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:43:26 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-3bf6afd9-6b39-482c-b080-8c40f8a5d474 tempest-GroupSnapshotsTest-649875217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:43:26 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-3bf6afd9-6b39-482c-b080-8c40f8a5d474 tempest-GroupSnapshotsTest-649875217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:43:26 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-3bf6afd9-6b39-482c-b080-8c40f8a5d474 tempest-GroupSnapshotsTest-649875217 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:43:26 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-3bf6afd9-6b39-482c-b080-8c40f8a5d474 tempest-GroupSnapshotsTest-649875217 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:43:26 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-3bf6afd9-6b39-482c-b080-8c40f8a5d474 tempest-GroupSnapshotsTest-649875217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ade49af7-bcc7-450a-ba66-8f76865d8211 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:26 devstack sudo[98208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ade49af7-bcc7-450a-ba66-8f76865d8211 1073741824 Jun 17 05:43:26 devstack sudo[98208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:27 devstack sudo[98208]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-3bf6afd9-6b39-482c-b080-8c40f8a5d474 tempest-GroupSnapshotsTest-649875217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ade49af7-bcc7-450a-ba66-8f76865d8211 1073741824" returned: 0 in 0.953s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-3bf6afd9-6b39-482c-b080-8c40f8a5d474 tempest-GroupSnapshotsTest-649875217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ade49af7-bcc7-450a-ba66-8f76865d8211 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:27 devstack cinder-volume[92083]: DEBUG oslo_service.periodic_task [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92083) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 05:43:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:43:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:43:27 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:43:27 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:43:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:43:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:27 devstack sudo[98221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:43:27 devstack sudo[98221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:27 devstack sudo[98219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ade49af7-bcc7-450a-ba66-8f76865d8211 Jun 17 05:43:27 devstack sudo[98219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-74b817df-fee7-456c-bf29-0684450fbd65 req-5ff3be0f-b313-4be5-9c05-b14a60ca5326 tempest-AttachVolumeTestJSON-1295992640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:43:28 devstack sudo[98221]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.769s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:28 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:43:28 devstack cinder-volume[92083]: DEBUG oslo_service.periodic_task [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running periodic task VolumeManager._thread_info {{(pid=92083) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 05:43:28 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] thread count: 8 {{(pid=92083) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 17 05:43:28 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] thread info: [<_MainThread(MainThread, started 133483869905024)>, , , , , , , ] {{(pid=92083) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 17 05:43:28 devstack sudo[98219]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-3bf6afd9-6b39-482c-b080-8c40f8a5d474 tempest-GroupSnapshotsTest-649875217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ade49af7-bcc7-450a-ba66-8f76865d8211" returned: 0 in 0.944s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:28 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-3bf6afd9-6b39-482c-b080-8c40f8a5d474 tempest-GroupSnapshotsTest-649875217 None] <== create_volume: return (1956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:43:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-3bf6afd9-6b39-482c-b080-8c40f8a5d474 tempest-GroupSnapshotsTest-649875217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.959s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:43:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-74b817df-fee7-456c-bf29-0684450fbd65 req-5ff3be0f-b313-4be5-9c05-b14a60ca5326 tempest-AttachVolumeTestJSON-1295992640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.678s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:43:28 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-3bf6afd9-6b39-482c-b080-8c40f8a5d474 tempest-GroupSnapshotsTest-649875217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (313613e9-9f7c-46fe-a785-b88f29564b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ade49af7-bcc7-450a-ba66-8f76865d8211', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:43:28 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-3bf6afd9-6b39-482c-b080-8c40f8a5d474 tempest-GroupSnapshotsTest-649875217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22f703e4-f81e-49dd-b74e-2a1ee4186dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:43:28 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a610355-0cd9-4104-b517-aea66bbb6ba3]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:43:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-74b817df-fee7-456c-bf29-0684450fbd65 req-5ff3be0f-b313-4be5-9c05-b14a60ca5326 tempest-AttachVolumeTestJSON-1295992640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-15a4f55a-c42f-4c17-9ce7-a037c7a3faac {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:28 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-3bf6afd9-6b39-482c-b080-8c40f8a5d474 tempest-GroupSnapshotsTest-649875217 None] Volume volume-ade49af7-bcc7-450a-ba66-8f76865d8211 (ade49af7-bcc7-450a-ba66-8f76865d8211): created successfully Jun 17 05:43:28 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-3bf6afd9-6b39-482c-b080-8c40f8a5d474 tempest-GroupSnapshotsTest-649875217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22f703e4-f81e-49dd-b74e-2a1ee4186dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:43:28 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-3bf6afd9-6b39-482c-b080-8c40f8a5d474 tempest-GroupSnapshotsTest-649875217 None] Flow 'volume_create_manager' (ea02f371-f47f-4100-90e3-eb20495a4c45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:43:28 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-3bf6afd9-6b39-482c-b080-8c40f8a5d474 tempest-GroupSnapshotsTest-649875217 None] Created volume successfully. Jun 17 05:43:28 devstack sudo[98229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-15a4f55a-c42f-4c17-9ce7-a037c7a3faac Jun 17 05:43:28 devstack sudo[98229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:29 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-d3755b2b-a4d0-481b-9dad-8b5b748327be tempest-GroupSnapshotsTest-649875217 None] Update group completed successfully. Jun 17 05:43:29 devstack sudo[98229]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:29 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-74b817df-fee7-456c-bf29-0684450fbd65 req-5ff3be0f-b313-4be5-9c05-b14a60ca5326 tempest-AttachVolumeTestJSON-1295992640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-15a4f55a-c42f-4c17-9ce7-a037c7a3faac" returned: 0 in 0.955s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:29 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-74b817df-fee7-456c-bf29-0684450fbd65 req-5ff3be0f-b313-4be5-9c05-b14a60ca5326 tempest-AttachVolumeTestJSON-1295992640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.989s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:43:29 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [req-74b817df-fee7-456c-bf29-0684450fbd65 req-5ff3be0f-b313-4be5-9c05-b14a60ca5326 tempest-AttachVolumeTestJSON-1295992640 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f', 'name': 'volume-15a4f55a-c42f-4c17-9ce7-a037c7a3faac', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6047d598-bb30-4833-abf0-5604915bc7a3', 'enforce_multipath': True} {{(pid=92083) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 17 05:43:29 devstack cinder-volume[92083]: INFO cinder.volume.manager [req-74b817df-fee7-456c-bf29-0684450fbd65 req-5ff3be0f-b313-4be5-9c05-b14a60ca5326 tempest-AttachVolumeTestJSON-1295992640 None] attachment_update completed successfully. Jun 17 05:43:30 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-f7eb5d3a-3d85-4abf-ae94-08f6b98bb954 tempest-GroupSnapshotsTest-649875217 None] Update group completed successfully. Jun 17 05:43:30 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e3c4ba8-d690-4ead-8e8a-a052baef6aab tempest-VolumesListTestJSON-164431907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:43:30 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-3e3c4ba8-d690-4ead-8e8a-a052baef6aab tempest-VolumesListTestJSON-164431907 None] Flow 'volume_create_manager' (540102cf-988d-4027-ab69-584e158fb220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:43:30 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-3e3c4ba8-d690-4ead-8e8a-a052baef6aab tempest-VolumesListTestJSON-164431907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22168519-af93-4cd3-9af3-75ba6055063c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:43:30 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-3e3c4ba8-d690-4ead-8e8a-a052baef6aab tempest-VolumesListTestJSON-164431907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22168519-af93-4cd3-9af3-75ba6055063c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:43:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1888439789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e4f5e01-b540-46eb-82e3-15ef83935550,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d5938efa289046d38753542ceb58b875',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:43:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:43:31Z,use_quota=True,user_id='e4f0fc5802e9485c90372c4aaf831796',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:43:30 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-3e3c4ba8-d690-4ead-8e8a-a052baef6aab tempest-VolumesListTestJSON-164431907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90da064c-3a8c-47d5-8a3f-3dcb46521589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:43:30 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-3e3c4ba8-d690-4ead-8e8a-a052baef6aab tempest-VolumesListTestJSON-164431907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90da064c-3a8c-47d5-8a3f-3dcb46521589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:43:30 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-3e3c4ba8-d690-4ead-8e8a-a052baef6aab tempest-VolumesListTestJSON-164431907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (881ca099-5e75-402e-9c1d-b4c1e36117e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:43:30 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-3e3c4ba8-d690-4ead-8e8a-a052baef6aab tempest-VolumesListTestJSON-164431907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (881ca099-5e75-402e-9c1d-b4c1e36117e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e4f5e01-b540-46eb-82e3-15ef83935550', 'volume_name': 'volume-4e4f5e01-b540-46eb-82e3-15ef83935550', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:43:30 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-3e3c4ba8-d690-4ead-8e8a-a052baef6aab tempest-VolumesListTestJSON-164431907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80d22139-3fbe-4ae7-a30c-17b0670fdb10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:43:30 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-3e3c4ba8-d690-4ead-8e8a-a052baef6aab tempest-VolumesListTestJSON-164431907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80d22139-3fbe-4ae7-a30c-17b0670fdb10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:43:30 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-3e3c4ba8-d690-4ead-8e8a-a052baef6aab tempest-VolumesListTestJSON-164431907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9ba7992-4701-40c1-9adf-01f945b1ea41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:43:30 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-3e3c4ba8-d690-4ead-8e8a-a052baef6aab tempest-VolumesListTestJSON-164431907 None] Volume 4e4f5e01-b540-46eb-82e3-15ef83935550: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e4f5e01-b540-46eb-82e3-15ef83935550', 'volume_size': 1} Jun 17 05:43:30 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-3e3c4ba8-d690-4ead-8e8a-a052baef6aab tempest-VolumesListTestJSON-164431907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:43:30 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-3e3c4ba8-d690-4ead-8e8a-a052baef6aab tempest-VolumesListTestJSON-164431907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:43:30 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-3e3c4ba8-d690-4ead-8e8a-a052baef6aab tempest-VolumesListTestJSON-164431907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:43:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1888439789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e4f5e01-b540-46eb-82e3-15ef83935550,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d5938efa289046d38753542ceb58b875',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:43:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:43:31Z,use_quota=True,user_id='e4f0fc5802e9485c90372c4aaf831796',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:43:30 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-3e3c4ba8-d690-4ead-8e8a-a052baef6aab tempest-VolumesListTestJSON-164431907 None] Creating volume 4e4f5e01-b540-46eb-82e3-15ef83935550 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:43:30 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-3e3c4ba8-d690-4ead-8e8a-a052baef6aab tempest-VolumesListTestJSON-164431907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:43:30 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-3e3c4ba8-d690-4ead-8e8a-a052baef6aab tempest-VolumesListTestJSON-164431907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:43:30 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-3e3c4ba8-d690-4ead-8e8a-a052baef6aab tempest-VolumesListTestJSON-164431907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:43:30 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-3e3c4ba8-d690-4ead-8e8a-a052baef6aab tempest-VolumesListTestJSON-164431907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:43:30 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-3e3c4ba8-d690-4ead-8e8a-a052baef6aab tempest-VolumesListTestJSON-164431907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:43:30 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-3e3c4ba8-d690-4ead-8e8a-a052baef6aab tempest-VolumesListTestJSON-164431907 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:43:30 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-3e3c4ba8-d690-4ead-8e8a-a052baef6aab tempest-VolumesListTestJSON-164431907 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:43:30 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-3e3c4ba8-d690-4ead-8e8a-a052baef6aab tempest-VolumesListTestJSON-164431907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4e4f5e01-b540-46eb-82e3-15ef83935550 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:30 devstack sudo[98246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4e4f5e01-b540-46eb-82e3-15ef83935550 1073741824 Jun 17 05:43:30 devstack sudo[98246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:31 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-a194329d-5e9a-4f16-ae67-b572f9f42c81 tempest-GroupSnapshotsTest-649875217 None] Update group completed successfully. Jun 17 05:43:31 devstack sudo[98246]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:31 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-3e3c4ba8-d690-4ead-8e8a-a052baef6aab tempest-VolumesListTestJSON-164431907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4e4f5e01-b540-46eb-82e3-15ef83935550 1073741824" returned: 0 in 0.757s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:31 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-3e3c4ba8-d690-4ead-8e8a-a052baef6aab tempest-VolumesListTestJSON-164431907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4e4f5e01-b540-46eb-82e3-15ef83935550 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:31 devstack sudo[98253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4e4f5e01-b540-46eb-82e3-15ef83935550 Jun 17 05:43:31 devstack sudo[98253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:32 devstack sudo[98253]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:32 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-3e3c4ba8-d690-4ead-8e8a-a052baef6aab tempest-VolumesListTestJSON-164431907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4e4f5e01-b540-46eb-82e3-15ef83935550" returned: 0 in 0.572s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:32 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-3e3c4ba8-d690-4ead-8e8a-a052baef6aab tempest-VolumesListTestJSON-164431907 None] <== create_volume: return (1363ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:43:32 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-3e3c4ba8-d690-4ead-8e8a-a052baef6aab tempest-VolumesListTestJSON-164431907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.366s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:43:32 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-3e3c4ba8-d690-4ead-8e8a-a052baef6aab tempest-VolumesListTestJSON-164431907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9ba7992-4701-40c1-9adf-01f945b1ea41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e4f5e01-b540-46eb-82e3-15ef83935550', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:43:32 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-3e3c4ba8-d690-4ead-8e8a-a052baef6aab tempest-VolumesListTestJSON-164431907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f266066-b5c3-476c-a9aa-1619a63b57c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:43:32 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-3e3c4ba8-d690-4ead-8e8a-a052baef6aab tempest-VolumesListTestJSON-164431907 None] Volume volume-4e4f5e01-b540-46eb-82e3-15ef83935550 (4e4f5e01-b540-46eb-82e3-15ef83935550): created successfully Jun 17 05:43:32 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-3e3c4ba8-d690-4ead-8e8a-a052baef6aab tempest-VolumesListTestJSON-164431907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f266066-b5c3-476c-a9aa-1619a63b57c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:43:32 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-3e3c4ba8-d690-4ead-8e8a-a052baef6aab tempest-VolumesListTestJSON-164431907 None] Flow 'volume_create_manager' (540102cf-988d-4027-ab69-584e158fb220) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:43:32 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-3e3c4ba8-d690-4ead-8e8a-a052baef6aab tempest-VolumesListTestJSON-164431907 None] Created volume successfully. Jun 17 05:43:32 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-039608ef-5e70-4f4e-b4c6-86079dc1e6e1 tempest-GroupSnapshotsTest-649875217 None] Update group completed successfully. Jun 17 05:43:33 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d1129c6-4a2f-46ea-a81a-70a649072c1e tempest-VolumesListTestJSON-164431907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:43:33 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4d1129c6-4a2f-46ea-a81a-70a649072c1e tempest-VolumesListTestJSON-164431907 None] Flow 'volume_create_manager' (3136d29b-d652-4ac0-bef2-059d238431e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:43:33 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4d1129c6-4a2f-46ea-a81a-70a649072c1e tempest-VolumesListTestJSON-164431907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d47309e0-84ff-4e9b-8a38-51493a62d4bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:43:33 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4d1129c6-4a2f-46ea-a81a-70a649072c1e tempest-VolumesListTestJSON-164431907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d47309e0-84ff-4e9b-8a38-51493a62d4bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:43:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-409992003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=731eeff9-8b5e-4b90-993c-e42ea71ff2cb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d5938efa289046d38753542ceb58b875',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:43:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:43:33Z,use_quota=True,user_id='e4f0fc5802e9485c90372c4aaf831796',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:43:33 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4d1129c6-4a2f-46ea-a81a-70a649072c1e tempest-VolumesListTestJSON-164431907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de43d028-b2f8-42c1-96ae-6b90cb745a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:43:33 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4d1129c6-4a2f-46ea-a81a-70a649072c1e tempest-VolumesListTestJSON-164431907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de43d028-b2f8-42c1-96ae-6b90cb745a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:43:33 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4d1129c6-4a2f-46ea-a81a-70a649072c1e tempest-VolumesListTestJSON-164431907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0cb2486-e99a-4b55-bec8-984a4f156ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:43:33 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4d1129c6-4a2f-46ea-a81a-70a649072c1e tempest-VolumesListTestJSON-164431907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0cb2486-e99a-4b55-bec8-984a4f156ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '731eeff9-8b5e-4b90-993c-e42ea71ff2cb', 'volume_name': 'volume-731eeff9-8b5e-4b90-993c-e42ea71ff2cb', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:43:33 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4d1129c6-4a2f-46ea-a81a-70a649072c1e tempest-VolumesListTestJSON-164431907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1cb6226-77e8-4f53-8821-0a85ed216ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:43:33 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4d1129c6-4a2f-46ea-a81a-70a649072c1e tempest-VolumesListTestJSON-164431907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1cb6226-77e8-4f53-8821-0a85ed216ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:43:33 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4d1129c6-4a2f-46ea-a81a-70a649072c1e tempest-VolumesListTestJSON-164431907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85d0d479-47a2-45a9-bd2f-3d0e32edc7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:43:33 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-4d1129c6-4a2f-46ea-a81a-70a649072c1e tempest-VolumesListTestJSON-164431907 None] Volume 731eeff9-8b5e-4b90-993c-e42ea71ff2cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-731eeff9-8b5e-4b90-993c-e42ea71ff2cb', 'volume_size': 1} Jun 17 05:43:33 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-4d1129c6-4a2f-46ea-a81a-70a649072c1e tempest-VolumesListTestJSON-164431907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:43:33 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-4d1129c6-4a2f-46ea-a81a-70a649072c1e tempest-VolumesListTestJSON-164431907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:43:33 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-4d1129c6-4a2f-46ea-a81a-70a649072c1e tempest-VolumesListTestJSON-164431907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:43:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-409992003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=731eeff9-8b5e-4b90-993c-e42ea71ff2cb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d5938efa289046d38753542ceb58b875',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:43:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:43:33Z,use_quota=True,user_id='e4f0fc5802e9485c90372c4aaf831796',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:43:33 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-4d1129c6-4a2f-46ea-a81a-70a649072c1e tempest-VolumesListTestJSON-164431907 None] Creating volume 731eeff9-8b5e-4b90-993c-e42ea71ff2cb {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:43:33 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-4d1129c6-4a2f-46ea-a81a-70a649072c1e tempest-VolumesListTestJSON-164431907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:43:33 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-4d1129c6-4a2f-46ea-a81a-70a649072c1e tempest-VolumesListTestJSON-164431907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:43:33 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-4d1129c6-4a2f-46ea-a81a-70a649072c1e tempest-VolumesListTestJSON-164431907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:43:33 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-4d1129c6-4a2f-46ea-a81a-70a649072c1e tempest-VolumesListTestJSON-164431907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:43:33 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-4d1129c6-4a2f-46ea-a81a-70a649072c1e tempest-VolumesListTestJSON-164431907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:43:33 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-4d1129c6-4a2f-46ea-a81a-70a649072c1e tempest-VolumesListTestJSON-164431907 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:43:33 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-4d1129c6-4a2f-46ea-a81a-70a649072c1e tempest-VolumesListTestJSON-164431907 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:43:33 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4d1129c6-4a2f-46ea-a81a-70a649072c1e tempest-VolumesListTestJSON-164431907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-731eeff9-8b5e-4b90-993c-e42ea71ff2cb 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:33 devstack sudo[98280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-731eeff9-8b5e-4b90-993c-e42ea71ff2cb 1073741824 Jun 17 05:43:33 devstack sudo[98280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:33 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-7b279b41-93ff-42d7-a1f7-dcc46a0f151e tempest-GroupSnapshotsTest-649875217 None] GroupSnapshot f3216112-7bf7-4fda-956d-afa485bec383: creating. Jun 17 05:43:33 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-7b279b41-93ff-42d7-a1f7-dcc46a0f151e tempest-GroupSnapshotsTest-649875217 None] Group snapshot f3216112-7bf7-4fda-956d-afa485bec383: creating. {{(pid=92083) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 17 05:43:33 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-7b279b41-93ff-42d7-a1f7-dcc46a0f151e tempest-GroupSnapshotsTest-649875217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:43:34 devstack sudo[98280]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:34 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4d1129c6-4a2f-46ea-a81a-70a649072c1e tempest-VolumesListTestJSON-164431907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-731eeff9-8b5e-4b90-993c-e42ea71ff2cb 1073741824" returned: 0 in 0.816s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:34 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4d1129c6-4a2f-46ea-a81a-70a649072c1e tempest-VolumesListTestJSON-164431907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-731eeff9-8b5e-4b90-993c-e42ea71ff2cb {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:34 devstack sudo[98288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-731eeff9-8b5e-4b90-993c-e42ea71ff2cb Jun 17 05:43:34 devstack sudo[98288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:34 devstack sudo[98288]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:34 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4d1129c6-4a2f-46ea-a81a-70a649072c1e tempest-VolumesListTestJSON-164431907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-731eeff9-8b5e-4b90-993c-e42ea71ff2cb" returned: 0 in 0.622s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:34 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-4d1129c6-4a2f-46ea-a81a-70a649072c1e tempest-VolumesListTestJSON-164431907 None] <== create_volume: return (1475ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:43:34 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-4d1129c6-4a2f-46ea-a81a-70a649072c1e tempest-VolumesListTestJSON-164431907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.478s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:43:34 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-7b279b41-93ff-42d7-a1f7-dcc46a0f151e tempest-GroupSnapshotsTest-649875217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.948s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:43:34 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4d1129c6-4a2f-46ea-a81a-70a649072c1e tempest-VolumesListTestJSON-164431907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85d0d479-47a2-45a9-bd2f-3d0e32edc7cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-731eeff9-8b5e-4b90-993c-e42ea71ff2cb', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:43:34 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4d1129c6-4a2f-46ea-a81a-70a649072c1e tempest-VolumesListTestJSON-164431907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (332d8d7d-6b8d-42e3-85db-de650beecad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:43:34 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-7b279b41-93ff-42d7-a1f7-dcc46a0f151e tempest-GroupSnapshotsTest-649875217 None] Creating offline snapshot 28d2cd82-1e75-4c83-958c-60ef9cfd64a7 of volume 779051a0-8c71-438a-876c-0063f6feaa63 {{(pid=92083) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 17 05:43:34 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-4d1129c6-4a2f-46ea-a81a-70a649072c1e tempest-VolumesListTestJSON-164431907 None] Volume volume-731eeff9-8b5e-4b90-993c-e42ea71ff2cb (731eeff9-8b5e-4b90-993c-e42ea71ff2cb): created successfully Jun 17 05:43:34 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4d1129c6-4a2f-46ea-a81a-70a649072c1e tempest-VolumesListTestJSON-164431907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (332d8d7d-6b8d-42e3-85db-de650beecad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:43:34 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4d1129c6-4a2f-46ea-a81a-70a649072c1e tempest-VolumesListTestJSON-164431907 None] Flow 'volume_create_manager' (3136d29b-d652-4ac0-bef2-059d238431e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:43:34 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b34704-9ea4-4a4a-97ce-75e2e02f3bdc]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:43:34 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-7b279b41-93ff-42d7-a1f7-dcc46a0f151e tempest-GroupSnapshotsTest-649875217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-779051a0-8c71-438a-876c-0063f6feaa63 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:34 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-4d1129c6-4a2f-46ea-a81a-70a649072c1e tempest-VolumesListTestJSON-164431907 None] Created volume successfully. Jun 17 05:43:35 devstack sudo[98291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-779051a0-8c71-438a-876c-0063f6feaa63 Jun 17 05:43:35 devstack sudo[98291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:35 devstack sudo[98291]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:35 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-7b279b41-93ff-42d7-a1f7-dcc46a0f151e tempest-GroupSnapshotsTest-649875217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-779051a0-8c71-438a-876c-0063f6feaa63" returned: 0 in 0.721s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:35 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-7b279b41-93ff-42d7-a1f7-dcc46a0f151e tempest-GroupSnapshotsTest-649875217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-779051a0-8c71-438a-876c-0063f6feaa63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-779051a0-8c71-438a-876c-0063f6feaa63.28d2cd82-1e75-4c83-958c-60ef9cfd64a7 1G {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:35 devstack sudo[98297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-779051a0-8c71-438a-876c-0063f6feaa63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-779051a0-8c71-438a-876c-0063f6feaa63.28d2cd82-1e75-4c83-958c-60ef9cfd64a7 1G Jun 17 05:43:35 devstack sudo[98297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:35 devstack cinder-volume[92083]: INFO cinder.volume.manager [req-4fcf5712-c70a-444d-b897-a5ad3377a40f req-c49ba2d9-55a3-4931-8211-71af92889f58 tempest-AttachVolumeTestJSON-1295992640 None] Terminate volume connection completed successfully. Jun 17 05:43:35 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [req-4fcf5712-c70a-444d-b897-a5ad3377a40f req-c49ba2d9-55a3-4931-8211-71af92889f58 tempest-AttachVolumeTestJSON-1295992640 None] Deleting attachment 96432392-06c3-4e59-8058-02140b0fa5c8. {{(pid=92083) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 17 05:43:35 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-829a3afc-3e1b-485b-bd57-9ee5a485f807 tempest-VolumesListTestJSON-164431907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:43:35 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-829a3afc-3e1b-485b-bd57-9ee5a485f807 tempest-VolumesListTestJSON-164431907 None] Flow 'volume_create_manager' (92612ba5-a03f-4667-8815-21244c89cb88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:43:35 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-829a3afc-3e1b-485b-bd57-9ee5a485f807 tempest-VolumesListTestJSON-164431907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed6c447c-59c4-4137-bc0b-0c514df9f6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:43:36 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-829a3afc-3e1b-485b-bd57-9ee5a485f807 tempest-VolumesListTestJSON-164431907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed6c447c-59c4-4137-bc0b-0c514df9f6ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:43:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-602756284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fc272c7-3c7b-4571-83d0-1ccdf46bc2c9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d5938efa289046d38753542ceb58b875',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:43:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:43:36Z,use_quota=True,user_id='e4f0fc5802e9485c90372c4aaf831796',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:43:36 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-829a3afc-3e1b-485b-bd57-9ee5a485f807 tempest-VolumesListTestJSON-164431907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0498ea6-14e4-4d43-80c6-3e27ca100b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:43:36 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-829a3afc-3e1b-485b-bd57-9ee5a485f807 tempest-VolumesListTestJSON-164431907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0498ea6-14e4-4d43-80c6-3e27ca100b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:43:36 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-829a3afc-3e1b-485b-bd57-9ee5a485f807 tempest-VolumesListTestJSON-164431907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da9aab88-ebe8-4abf-ba88-547d4752c723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:43:36 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-829a3afc-3e1b-485b-bd57-9ee5a485f807 tempest-VolumesListTestJSON-164431907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da9aab88-ebe8-4abf-ba88-547d4752c723) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fc272c7-3c7b-4571-83d0-1ccdf46bc2c9', 'volume_name': 'volume-3fc272c7-3c7b-4571-83d0-1ccdf46bc2c9', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:43:36 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-829a3afc-3e1b-485b-bd57-9ee5a485f807 tempest-VolumesListTestJSON-164431907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (190e7d2f-cdaf-4072-a906-898e29c2a49a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:43:36 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-829a3afc-3e1b-485b-bd57-9ee5a485f807 tempest-VolumesListTestJSON-164431907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (190e7d2f-cdaf-4072-a906-898e29c2a49a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:43:36 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-829a3afc-3e1b-485b-bd57-9ee5a485f807 tempest-VolumesListTestJSON-164431907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34bad99f-1431-4c3c-b3b3-6eda85c2ac5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:43:36 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-829a3afc-3e1b-485b-bd57-9ee5a485f807 tempest-VolumesListTestJSON-164431907 None] Volume 3fc272c7-3c7b-4571-83d0-1ccdf46bc2c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fc272c7-3c7b-4571-83d0-1ccdf46bc2c9', 'volume_size': 1} Jun 17 05:43:36 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-829a3afc-3e1b-485b-bd57-9ee5a485f807 tempest-VolumesListTestJSON-164431907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:43:36 devstack sudo[98297]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:36 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-7b279b41-93ff-42d7-a1f7-dcc46a0f151e tempest-GroupSnapshotsTest-649875217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-779051a0-8c71-438a-876c-0063f6feaa63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-779051a0-8c71-438a-876c-0063f6feaa63.28d2cd82-1e75-4c83-958c-60ef9cfd64a7 1G" returned: 0 in 0.764s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:36 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-7b279b41-93ff-42d7-a1f7-dcc46a0f151e tempest-GroupSnapshotsTest-649875217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-779051a0-8c71-438a-876c-0063f6feaa63 -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-779051a0-8c71-438a-876c-0063f6feaa63.28d2cd82-1e75-4c83-958c-60ef9cfd64a7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:36 devstack sudo[98304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-779051a0-8c71-438a-876c-0063f6feaa63 -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-779051a0-8c71-438a-876c-0063f6feaa63.28d2cd82-1e75-4c83-958c-60ef9cfd64a7 Jun 17 05:43:36 devstack sudo[98304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:37 devstack sudo[98304]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:37 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-7b279b41-93ff-42d7-a1f7-dcc46a0f151e tempest-GroupSnapshotsTest-649875217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-779051a0-8c71-438a-876c-0063f6feaa63 -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-779051a0-8c71-438a-876c-0063f6feaa63.28d2cd82-1e75-4c83-958c-60ef9cfd64a7" returned: 0 in 0.748s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:37 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [None req-7b279b41-93ff-42d7-a1f7-dcc46a0f151e tempest-GroupSnapshotsTest-649875217 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-779051a0-8c71-438a-876c-0063f6feaa63.28d2cd82-1e75-4c83-958c-60ef9cfd64a7 is being set with open permissions: ugo+rw: NotImplementedError Jun 17 05:43:37 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-7b279b41-93ff-42d7-a1f7-dcc46a0f151e tempest-GroupSnapshotsTest-649875217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-779051a0-8c71-438a-876c-0063f6feaa63.28d2cd82-1e75-4c83-958c-60ef9cfd64a7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:37 devstack sudo[98310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-779051a0-8c71-438a-876c-0063f6feaa63.28d2cd82-1e75-4c83-958c-60ef9cfd64a7 Jun 17 05:43:37 devstack sudo[98310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:37 devstack sudo[98310]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:37 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-7b279b41-93ff-42d7-a1f7-dcc46a0f151e tempest-GroupSnapshotsTest-649875217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-779051a0-8c71-438a-876c-0063f6feaa63.28d2cd82-1e75-4c83-958c-60ef9cfd64a7" returned: 0 in 0.608s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:37 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-7b279b41-93ff-42d7-a1f7-dcc46a0f151e tempest-GroupSnapshotsTest-649875217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-779051a0-8c71-438a-876c-0063f6feaa63.info {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:37 devstack sudo[98313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-779051a0-8c71-438a-876c-0063f6feaa63.info Jun 17 05:43:37 devstack sudo[98313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:38 devstack cinder-volume[92083]: INFO cinder.volume.manager [req-f7c8a3bd-8b04-484f-a3ab-41c699e9f67d req-3f367e2d-b013-46c7-88b5-592676ae8fbe tempest-AttachVolumeTestJSON-1295992640 None] Terminate volume connection completed successfully. Jun 17 05:43:38 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [req-f7c8a3bd-8b04-484f-a3ab-41c699e9f67d req-3f367e2d-b013-46c7-88b5-592676ae8fbe tempest-AttachVolumeTestJSON-1295992640 None] Deleting attachment 6047d598-bb30-4833-abf0-5604915bc7a3. {{(pid=92083) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 17 05:43:38 devstack sudo[98313]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:38 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-7b279b41-93ff-42d7-a1f7-dcc46a0f151e tempest-GroupSnapshotsTest-649875217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-779051a0-8c71-438a-876c-0063f6feaa63.info" returned: 0 in 0.678s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:38 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [None req-7b279b41-93ff-42d7-a1f7-dcc46a0f151e tempest-GroupSnapshotsTest-649875217 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-779051a0-8c71-438a-876c-0063f6feaa63.info is being set with open permissions: ugo+rw: NotImplementedError Jun 17 05:43:38 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-7b279b41-93ff-42d7-a1f7-dcc46a0f151e tempest-GroupSnapshotsTest-649875217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-779051a0-8c71-438a-876c-0063f6feaa63.info {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:38 devstack sudo[98320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-779051a0-8c71-438a-876c-0063f6feaa63.info Jun 17 05:43:38 devstack sudo[98320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:39 devstack sudo[98320]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-7b279b41-93ff-42d7-a1f7-dcc46a0f151e tempest-GroupSnapshotsTest-649875217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-779051a0-8c71-438a-876c-0063f6feaa63.info" returned: 0 in 0.627s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-7b279b41-93ff-42d7-a1f7-dcc46a0f151e tempest-GroupSnapshotsTest-649875217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.266s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:43:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-7b279b41-93ff-42d7-a1f7-dcc46a0f151e tempest-GroupSnapshotsTest-649875217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:43:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-7b279b41-93ff-42d7-a1f7-dcc46a0f151e tempest-GroupSnapshotsTest-649875217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:43:39 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-7b279b41-93ff-42d7-a1f7-dcc46a0f151e tempest-GroupSnapshotsTest-649875217 None] Creating offline snapshot c6119329-72d1-4d6e-9cdd-026355695821 of volume ade49af7-bcc7-450a-ba66-8f76865d8211 {{(pid=92083) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 17 05:43:39 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[1185da73-2fa1-468b-b21b-5169e2ad573e]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:43:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-7b279b41-93ff-42d7-a1f7-dcc46a0f151e tempest-GroupSnapshotsTest-649875217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ade49af7-bcc7-450a-ba66-8f76865d8211 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:39 devstack sudo[98324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ade49af7-bcc7-450a-ba66-8f76865d8211 Jun 17 05:43:39 devstack sudo[98324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:39 devstack sudo[98324]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-7b279b41-93ff-42d7-a1f7-dcc46a0f151e tempest-GroupSnapshotsTest-649875217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ade49af7-bcc7-450a-ba66-8f76865d8211" returned: 0 in 0.706s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-7b279b41-93ff-42d7-a1f7-dcc46a0f151e tempest-GroupSnapshotsTest-649875217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ade49af7-bcc7-450a-ba66-8f76865d8211,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ade49af7-bcc7-450a-ba66-8f76865d8211.c6119329-72d1-4d6e-9cdd-026355695821 1G {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:39 devstack sudo[98330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ade49af7-bcc7-450a-ba66-8f76865d8211,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ade49af7-bcc7-450a-ba66-8f76865d8211.c6119329-72d1-4d6e-9cdd-026355695821 1G Jun 17 05:43:39 devstack sudo[98330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:40 devstack cinder-volume[92083]: INFO cinder.volume.manager [req-b5b0b9cd-3d6a-4e61-a495-4b4f80cc7766 req-4981a980-c1c8-4d51-9caf-6b6370cb3d3e tempest-AttachVolumeShelveTestJSON-18917466 None] Terminate volume connection completed successfully. Jun 17 05:43:40 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [req-b5b0b9cd-3d6a-4e61-a495-4b4f80cc7766 req-4981a980-c1c8-4d51-9caf-6b6370cb3d3e tempest-AttachVolumeShelveTestJSON-18917466 None] Deleting attachment 1d187682-0e20-4dd1-99c2-4c4a3fc01b24. {{(pid=92083) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 17 05:43:40 devstack sudo[98330]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:40 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-7b279b41-93ff-42d7-a1f7-dcc46a0f151e tempest-GroupSnapshotsTest-649875217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ade49af7-bcc7-450a-ba66-8f76865d8211,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ade49af7-bcc7-450a-ba66-8f76865d8211.c6119329-72d1-4d6e-9cdd-026355695821 1G" returned: 0 in 0.892s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:40 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-7b279b41-93ff-42d7-a1f7-dcc46a0f151e tempest-GroupSnapshotsTest-649875217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ade49af7-bcc7-450a-ba66-8f76865d8211 -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ade49af7-bcc7-450a-ba66-8f76865d8211.c6119329-72d1-4d6e-9cdd-026355695821 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:40 devstack sudo[98339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ade49af7-bcc7-450a-ba66-8f76865d8211 -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ade49af7-bcc7-450a-ba66-8f76865d8211.c6119329-72d1-4d6e-9cdd-026355695821 Jun 17 05:43:40 devstack sudo[98339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:41 devstack sudo[98339]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:41 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-7b279b41-93ff-42d7-a1f7-dcc46a0f151e tempest-GroupSnapshotsTest-649875217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ade49af7-bcc7-450a-ba66-8f76865d8211 -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ade49af7-bcc7-450a-ba66-8f76865d8211.c6119329-72d1-4d6e-9cdd-026355695821" returned: 0 in 0.650s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:41 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [None req-7b279b41-93ff-42d7-a1f7-dcc46a0f151e tempest-GroupSnapshotsTest-649875217 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ade49af7-bcc7-450a-ba66-8f76865d8211.c6119329-72d1-4d6e-9cdd-026355695821 is being set with open permissions: ugo+rw: NotImplementedError Jun 17 05:43:41 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-7b279b41-93ff-42d7-a1f7-dcc46a0f151e tempest-GroupSnapshotsTest-649875217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ade49af7-bcc7-450a-ba66-8f76865d8211.c6119329-72d1-4d6e-9cdd-026355695821 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:41 devstack sudo[98345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ade49af7-bcc7-450a-ba66-8f76865d8211.c6119329-72d1-4d6e-9cdd-026355695821 Jun 17 05:43:41 devstack sudo[98345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:42 devstack sudo[98345]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-7b279b41-93ff-42d7-a1f7-dcc46a0f151e tempest-GroupSnapshotsTest-649875217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ade49af7-bcc7-450a-ba66-8f76865d8211.c6119329-72d1-4d6e-9cdd-026355695821" returned: 0 in 0.712s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-7b279b41-93ff-42d7-a1f7-dcc46a0f151e tempest-GroupSnapshotsTest-649875217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ade49af7-bcc7-450a-ba66-8f76865d8211.info {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:42 devstack sudo[98383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ade49af7-bcc7-450a-ba66-8f76865d8211.info Jun 17 05:43:42 devstack sudo[98383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:42 devstack sudo[98383]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-7b279b41-93ff-42d7-a1f7-dcc46a0f151e tempest-GroupSnapshotsTest-649875217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ade49af7-bcc7-450a-ba66-8f76865d8211.info" returned: 0 in 0.732s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:42 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [None req-7b279b41-93ff-42d7-a1f7-dcc46a0f151e tempest-GroupSnapshotsTest-649875217 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ade49af7-bcc7-450a-ba66-8f76865d8211.info is being set with open permissions: ugo+rw: NotImplementedError Jun 17 05:43:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-7b279b41-93ff-42d7-a1f7-dcc46a0f151e tempest-GroupSnapshotsTest-649875217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ade49af7-bcc7-450a-ba66-8f76865d8211.info {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:42 devstack sudo[98387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ade49af7-bcc7-450a-ba66-8f76865d8211.info Jun 17 05:43:42 devstack sudo[98387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:43 devstack sudo[98387]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:43 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-7b279b41-93ff-42d7-a1f7-dcc46a0f151e tempest-GroupSnapshotsTest-649875217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ade49af7-bcc7-450a-ba66-8f76865d8211.info" returned: 0 in 0.715s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:43 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-7b279b41-93ff-42d7-a1f7-dcc46a0f151e tempest-GroupSnapshotsTest-649875217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.507s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:43:43 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-829a3afc-3e1b-485b-bd57-9ee5a485f807 tempest-VolumesListTestJSON-164431907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.644s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:43:43 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-829a3afc-3e1b-485b-bd57-9ee5a485f807 tempest-VolumesListTestJSON-164431907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:43:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-602756284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fc272c7-3c7b-4571-83d0-1ccdf46bc2c9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d5938efa289046d38753542ceb58b875',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:43:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:43:36Z,use_quota=True,user_id='e4f0fc5802e9485c90372c4aaf831796',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:43:43 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-829a3afc-3e1b-485b-bd57-9ee5a485f807 tempest-VolumesListTestJSON-164431907 None] Creating volume 3fc272c7-3c7b-4571-83d0-1ccdf46bc2c9 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:43:43 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-829a3afc-3e1b-485b-bd57-9ee5a485f807 tempest-VolumesListTestJSON-164431907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:43:43 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-829a3afc-3e1b-485b-bd57-9ee5a485f807 tempest-VolumesListTestJSON-164431907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:43:43 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-829a3afc-3e1b-485b-bd57-9ee5a485f807 tempest-VolumesListTestJSON-164431907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:43:43 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-829a3afc-3e1b-485b-bd57-9ee5a485f807 tempest-VolumesListTestJSON-164431907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:43:43 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-829a3afc-3e1b-485b-bd57-9ee5a485f807 tempest-VolumesListTestJSON-164431907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:43:43 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-829a3afc-3e1b-485b-bd57-9ee5a485f807 tempest-VolumesListTestJSON-164431907 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:43:43 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-829a3afc-3e1b-485b-bd57-9ee5a485f807 tempest-VolumesListTestJSON-164431907 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:43:43 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-829a3afc-3e1b-485b-bd57-9ee5a485f807 tempest-VolumesListTestJSON-164431907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-3fc272c7-3c7b-4571-83d0-1ccdf46bc2c9 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:43 devstack sudo[98426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-3fc272c7-3c7b-4571-83d0-1ccdf46bc2c9 1073741824 Jun 17 05:43:43 devstack sudo[98426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:43 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-7b279b41-93ff-42d7-a1f7-dcc46a0f151e tempest-GroupSnapshotsTest-649875217 None] group_snapshot f3216112-7bf7-4fda-956d-afa485bec383: created successfully Jun 17 05:43:44 devstack sudo[98426]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:44 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-829a3afc-3e1b-485b-bd57-9ee5a485f807 tempest-VolumesListTestJSON-164431907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-3fc272c7-3c7b-4571-83d0-1ccdf46bc2c9 1073741824" returned: 0 in 1.026s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:44 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-e55b52e9-e891-4361-936a-4e5c0e7c8e1a tempest-GroupSnapshotsTest-649875217 None] group_snapshot f3216112-7bf7-4fda-956d-afa485bec383: deleting Jun 17 05:43:44 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e55b52e9-e891-4361-936a-4e5c0e7c8e1a tempest-GroupSnapshotsTest-649875217 None] group_snapshot f3216112-7bf7-4fda-956d-afa485bec383: deleting {{(pid=92083) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 17 05:43:44 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-829a3afc-3e1b-485b-bd57-9ee5a485f807 tempest-VolumesListTestJSON-164431907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-3fc272c7-3c7b-4571-83d0-1ccdf46bc2c9 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:44 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-e55b52e9-e891-4361-936a-4e5c0e7c8e1a tempest-GroupSnapshotsTest-649875217 None] Acquiring lock "cinder-quobyte-779051a0-8c71-438a-876c-0063f6feaa63" by "delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:43:44 devstack sudo[98436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-3fc272c7-3c7b-4571-83d0-1ccdf46bc2c9 Jun 17 05:43:44 devstack sudo[98436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:44 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-e55b52e9-e891-4361-936a-4e5c0e7c8e1a tempest-GroupSnapshotsTest-649875217 None] Lock "cinder-quobyte-779051a0-8c71-438a-876c-0063f6feaa63" acquired by "delete_snapshot" :: waited 0.029s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:43:44 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-e55b52e9-e891-4361-936a-4e5c0e7c8e1a tempest-GroupSnapshotsTest-649875217 None] Acquiring lock "cinder-quobyte-28d2cd82-1e75-4c83-958c-60ef9cfd64a7" by "_delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:43:44 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-e55b52e9-e891-4361-936a-4e5c0e7c8e1a tempest-GroupSnapshotsTest-649875217 None] Lock "cinder-quobyte-28d2cd82-1e75-4c83-958c-60ef9cfd64a7" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:43:44 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-e55b52e9-e891-4361-936a-4e5c0e7c8e1a tempest-GroupSnapshotsTest-649875217 None] Deleting offline snapshot 28d2cd82-1e75-4c83-958c-60ef9cfd64a7 of volume 779051a0-8c71-438a-876c-0063f6feaa63 {{(pid=92083) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 17 05:43:44 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-e55b52e9-e891-4361-936a-4e5c0e7c8e1a tempest-GroupSnapshotsTest-649875217 None] snapshot_file for this snap is: volume-779051a0-8c71-438a-876c-0063f6feaa63.28d2cd82-1e75-4c83-958c-60ef9cfd64a7 {{(pid=92083) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 17 05:43:44 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04c3a14-c722-40cc-a965-f99b6c19c281]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:43:44 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e55b52e9-e891-4361-936a-4e5c0e7c8e1a tempest-GroupSnapshotsTest-649875217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-779051a0-8c71-438a-876c-0063f6feaa63.28d2cd82-1e75-4c83-958c-60ef9cfd64a7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:45 devstack sudo[98438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-779051a0-8c71-438a-876c-0063f6feaa63.28d2cd82-1e75-4c83-958c-60ef9cfd64a7 Jun 17 05:43:45 devstack sudo[98438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:45 devstack sudo[98436]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:45 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-829a3afc-3e1b-485b-bd57-9ee5a485f807 tempest-VolumesListTestJSON-164431907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-3fc272c7-3c7b-4571-83d0-1ccdf46bc2c9" returned: 0 in 0.804s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:45 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-829a3afc-3e1b-485b-bd57-9ee5a485f807 tempest-VolumesListTestJSON-164431907 None] <== create_volume: return (1908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:43:45 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-829a3afc-3e1b-485b-bd57-9ee5a485f807 tempest-VolumesListTestJSON-164431907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.911s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:43:45 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-829a3afc-3e1b-485b-bd57-9ee5a485f807 tempest-VolumesListTestJSON-164431907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34bad99f-1431-4c3c-b3b3-6eda85c2ac5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fc272c7-3c7b-4571-83d0-1ccdf46bc2c9', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:43:45 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-829a3afc-3e1b-485b-bd57-9ee5a485f807 tempest-VolumesListTestJSON-164431907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90add0f9-ae42-4f7c-b56f-23b66f26e4cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:43:45 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-829a3afc-3e1b-485b-bd57-9ee5a485f807 tempest-VolumesListTestJSON-164431907 None] Volume volume-3fc272c7-3c7b-4571-83d0-1ccdf46bc2c9 (3fc272c7-3c7b-4571-83d0-1ccdf46bc2c9): created successfully Jun 17 05:43:45 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-829a3afc-3e1b-485b-bd57-9ee5a485f807 tempest-VolumesListTestJSON-164431907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90add0f9-ae42-4f7c-b56f-23b66f26e4cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:43:45 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-829a3afc-3e1b-485b-bd57-9ee5a485f807 tempest-VolumesListTestJSON-164431907 None] Flow 'volume_create_manager' (92612ba5-a03f-4667-8815-21244c89cb88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:43:45 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-829a3afc-3e1b-485b-bd57-9ee5a485f807 tempest-VolumesListTestJSON-164431907 None] Created volume successfully. Jun 17 05:43:45 devstack sudo[98438]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:45 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e55b52e9-e891-4361-936a-4e5c0e7c8e1a tempest-GroupSnapshotsTest-649875217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-779051a0-8c71-438a-876c-0063f6feaa63.28d2cd82-1e75-4c83-958c-60ef9cfd64a7" returned: 0 in 1.021s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:45 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-e55b52e9-e891-4361-936a-4e5c0e7c8e1a tempest-GroupSnapshotsTest-649875217 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-779051a0-8c71-438a-876c-0063f6feaa63(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92083) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 05:43:46 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e66c3a-2c76-4383-983d-710a4eeba31e]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:43:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e55b52e9-e891-4361-936a-4e5c0e7c8e1a tempest-GroupSnapshotsTest-649875217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-779051a0-8c71-438a-876c-0063f6feaa63 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:46 devstack sudo[98447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-779051a0-8c71-438a-876c-0063f6feaa63 Jun 17 05:43:46 devstack sudo[98447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:46 devstack sudo[98447]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e55b52e9-e891-4361-936a-4e5c0e7c8e1a tempest-GroupSnapshotsTest-649875217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-779051a0-8c71-438a-876c-0063f6feaa63" returned: 0 in 0.769s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e55b52e9-e891-4361-936a-4e5c0e7c8e1a tempest-GroupSnapshotsTest-649875217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-779051a0-8c71-438a-876c-0063f6feaa63.28d2cd82-1e75-4c83-958c-60ef9cfd64a7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:46 devstack sudo[98452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-779051a0-8c71-438a-876c-0063f6feaa63.28d2cd82-1e75-4c83-958c-60ef9cfd64a7 Jun 17 05:43:46 devstack sudo[98452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:47 devstack sudo[98452]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:47 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e55b52e9-e891-4361-936a-4e5c0e7c8e1a tempest-GroupSnapshotsTest-649875217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-779051a0-8c71-438a-876c-0063f6feaa63.28d2cd82-1e75-4c83-958c-60ef9cfd64a7" returned: 0 in 0.765s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:47 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e55b52e9-e891-4361-936a-4e5c0e7c8e1a tempest-GroupSnapshotsTest-649875217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-779051a0-8c71-438a-876c-0063f6feaa63.28d2cd82-1e75-4c83-958c-60ef9cfd64a7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:47 devstack sudo[98458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-779051a0-8c71-438a-876c-0063f6feaa63.28d2cd82-1e75-4c83-958c-60ef9cfd64a7 Jun 17 05:43:47 devstack sudo[98458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:48 devstack sudo[98458]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:48 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e55b52e9-e891-4361-936a-4e5c0e7c8e1a tempest-GroupSnapshotsTest-649875217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-779051a0-8c71-438a-876c-0063f6feaa63.28d2cd82-1e75-4c83-958c-60ef9cfd64a7" returned: 0 in 0.629s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:48 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-e55b52e9-e891-4361-936a-4e5c0e7c8e1a tempest-GroupSnapshotsTest-649875217 None] Lock "cinder-quobyte-28d2cd82-1e75-4c83-958c-60ef9cfd64a7" released by "_delete_snapshot" :: held 3.320s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:43:48 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-e55b52e9-e891-4361-936a-4e5c0e7c8e1a tempest-GroupSnapshotsTest-649875217 None] Lock "cinder-quobyte-779051a0-8c71-438a-876c-0063f6feaa63" released by "delete_snapshot" :: held 3.355s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:43:48 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-e55b52e9-e891-4361-936a-4e5c0e7c8e1a tempest-GroupSnapshotsTest-649875217 None] Acquiring lock "cinder-quobyte-ade49af7-bcc7-450a-ba66-8f76865d8211" by "delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:43:48 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-e55b52e9-e891-4361-936a-4e5c0e7c8e1a tempest-GroupSnapshotsTest-649875217 None] Lock "cinder-quobyte-ade49af7-bcc7-450a-ba66-8f76865d8211" acquired by "delete_snapshot" :: waited 0.015s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:43:48 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-e55b52e9-e891-4361-936a-4e5c0e7c8e1a tempest-GroupSnapshotsTest-649875217 None] Acquiring lock "cinder-quobyte-c6119329-72d1-4d6e-9cdd-026355695821" by "_delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:43:48 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-e55b52e9-e891-4361-936a-4e5c0e7c8e1a tempest-GroupSnapshotsTest-649875217 None] Lock "cinder-quobyte-c6119329-72d1-4d6e-9cdd-026355695821" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:43:48 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-e55b52e9-e891-4361-936a-4e5c0e7c8e1a tempest-GroupSnapshotsTest-649875217 None] Deleting offline snapshot c6119329-72d1-4d6e-9cdd-026355695821 of volume ade49af7-bcc7-450a-ba66-8f76865d8211 {{(pid=92083) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 17 05:43:48 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-e55b52e9-e891-4361-936a-4e5c0e7c8e1a tempest-GroupSnapshotsTest-649875217 None] snapshot_file for this snap is: volume-ade49af7-bcc7-450a-ba66-8f76865d8211.c6119329-72d1-4d6e-9cdd-026355695821 {{(pid=92083) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 17 05:43:48 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-2a95fd12-6c6a-4735-8135-3481118f1611 tempest-VolumesListTestJSON-164431907 None] Acquiring lock "cinder-3fc272c7-3c7b-4571-83d0-1ccdf46bc2c9-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:43:48 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[348b8fcf-a9e9-441c-98e8-2264d6a1dbeb]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:43:48 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e55b52e9-e891-4361-936a-4e5c0e7c8e1a tempest-GroupSnapshotsTest-649875217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ade49af7-bcc7-450a-ba66-8f76865d8211.c6119329-72d1-4d6e-9cdd-026355695821 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:48 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-2a95fd12-6c6a-4735-8135-3481118f1611 tempest-VolumesListTestJSON-164431907 None] Lock "cinder-3fc272c7-3c7b-4571-83d0-1ccdf46bc2c9-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:43:48 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-2a95fd12-6c6a-4735-8135-3481118f1611 tempest-VolumesListTestJSON-164431907 None] Acquiring lock "cinder-quobyte-3fc272c7-3c7b-4571-83d0-1ccdf46bc2c9" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:43:48 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-2a95fd12-6c6a-4735-8135-3481118f1611 tempest-VolumesListTestJSON-164431907 None] Lock "cinder-quobyte-3fc272c7-3c7b-4571-83d0-1ccdf46bc2c9" acquired by "delete_volume" :: waited 0.018s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:43:48 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[8604e3bb-f145-4c68-a80b-514e694b0f3b]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:43:48 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-2a95fd12-6c6a-4735-8135-3481118f1611 tempest-VolumesListTestJSON-164431907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-3fc272c7-3c7b-4571-83d0-1ccdf46bc2c9 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:48 devstack sudo[98461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ade49af7-bcc7-450a-ba66-8f76865d8211.c6119329-72d1-4d6e-9cdd-026355695821 Jun 17 05:43:48 devstack sudo[98461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:48 devstack sudo[98462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-3fc272c7-3c7b-4571-83d0-1ccdf46bc2c9 Jun 17 05:43:48 devstack sudo[98462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:49 devstack sudo[98461]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:49 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e55b52e9-e891-4361-936a-4e5c0e7c8e1a tempest-GroupSnapshotsTest-649875217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ade49af7-bcc7-450a-ba66-8f76865d8211.c6119329-72d1-4d6e-9cdd-026355695821" returned: 0 in 0.737s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:49 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-e55b52e9-e891-4361-936a-4e5c0e7c8e1a tempest-GroupSnapshotsTest-649875217 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ade49af7-bcc7-450a-ba66-8f76865d8211(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92083) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 05:43:49 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe734a50-3481-4806-8ca7-d585f9531dd8]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:43:49 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e55b52e9-e891-4361-936a-4e5c0e7c8e1a tempest-GroupSnapshotsTest-649875217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ade49af7-bcc7-450a-ba66-8f76865d8211 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:49 devstack sudo[98462]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:49 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-2a95fd12-6c6a-4735-8135-3481118f1611 tempest-VolumesListTestJSON-164431907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-3fc272c7-3c7b-4571-83d0-1ccdf46bc2c9" returned: 0 in 0.710s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:49 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-2a95fd12-6c6a-4735-8135-3481118f1611 tempest-VolumesListTestJSON-164431907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-3fc272c7-3c7b-4571-83d0-1ccdf46bc2c9 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:49 devstack sudo[98474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-3fc272c7-3c7b-4571-83d0-1ccdf46bc2c9 Jun 17 05:43:49 devstack sudo[98474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:49 devstack sudo[98473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ade49af7-bcc7-450a-ba66-8f76865d8211 Jun 17 05:43:49 devstack sudo[98473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:49 devstack sudo[98474]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:49 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-2a95fd12-6c6a-4735-8135-3481118f1611 tempest-VolumesListTestJSON-164431907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-3fc272c7-3c7b-4571-83d0-1ccdf46bc2c9" returned: 0 in 0.661s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:49 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-2a95fd12-6c6a-4735-8135-3481118f1611 tempest-VolumesListTestJSON-164431907 None] Lock "cinder-quobyte-3fc272c7-3c7b-4571-83d0-1ccdf46bc2c9" released by "delete_volume" :: held 1.422s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:43:49 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-2a95fd12-6c6a-4735-8135-3481118f1611 tempest-VolumesListTestJSON-164431907 None] Created reservations ['9aa9f963-47b7-4c29-ad5d-a40dd8b4db65', 'bb2565e0-7860-40ca-bcf5-477f33ae74e7', '2d9ba921-ee00-45ad-bdc0-687e97eb96a8', '33269d02-93cc-4063-a4e1-f56821062d84'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:43:49 devstack sudo[98473]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:49 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e55b52e9-e891-4361-936a-4e5c0e7c8e1a tempest-GroupSnapshotsTest-649875217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ade49af7-bcc7-450a-ba66-8f76865d8211" returned: 0 in 0.773s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:49 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e55b52e9-e891-4361-936a-4e5c0e7c8e1a tempest-GroupSnapshotsTest-649875217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ade49af7-bcc7-450a-ba66-8f76865d8211.c6119329-72d1-4d6e-9cdd-026355695821 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:49 devstack sudo[98482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ade49af7-bcc7-450a-ba66-8f76865d8211.c6119329-72d1-4d6e-9cdd-026355695821 Jun 17 05:43:49 devstack sudo[98482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:49 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-2a95fd12-6c6a-4735-8135-3481118f1611 tempest-VolumesListTestJSON-164431907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:43:49 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-2a95fd12-6c6a-4735-8135-3481118f1611 tempest-VolumesListTestJSON-164431907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:43:49 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-2a95fd12-6c6a-4735-8135-3481118f1611 tempest-VolumesListTestJSON-164431907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:43:49 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-2a95fd12-6c6a-4735-8135-3481118f1611 tempest-VolumesListTestJSON-164431907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:43:49 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-2a95fd12-6c6a-4735-8135-3481118f1611 tempest-VolumesListTestJSON-164431907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:43:49 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-2a95fd12-6c6a-4735-8135-3481118f1611 tempest-VolumesListTestJSON-164431907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:49 devstack sudo[98484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:43:49 devstack sudo[98484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:50 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-de169533-798d-485d-8005-5f1c46670de3 tempest-AttachVolumeTestJSON-1295992640 None] Acquiring lock "cinder-15a4f55a-c42f-4c17-9ce7-a037c7a3faac-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:43:50 devstack sudo[98484]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:50 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-de169533-798d-485d-8005-5f1c46670de3 tempest-AttachVolumeTestJSON-1295992640 None] Lock "cinder-15a4f55a-c42f-4c17-9ce7-a037c7a3faac-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:43:50 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-2a95fd12-6c6a-4735-8135-3481118f1611 tempest-VolumesListTestJSON-164431907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.806s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:50 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-2a95fd12-6c6a-4735-8135-3481118f1611 tempest-VolumesListTestJSON-164431907 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:43:50 devstack sudo[98482]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:50 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-f8d2d318-5f0c-460d-9005-9ce5aeec1abc tempest-VolumesListTestJSON-164431907 None] Acquiring lock "cinder-731eeff9-8b5e-4b90-993c-e42ea71ff2cb-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:43:50 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-2a95fd12-6c6a-4735-8135-3481118f1611 tempest-VolumesListTestJSON-164431907 None] Deleted volume successfully. Jun 17 05:43:50 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e55b52e9-e891-4361-936a-4e5c0e7c8e1a tempest-GroupSnapshotsTest-649875217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ade49af7-bcc7-450a-ba66-8f76865d8211.c6119329-72d1-4d6e-9cdd-026355695821" returned: 0 in 0.935s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:50 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e55b52e9-e891-4361-936a-4e5c0e7c8e1a tempest-GroupSnapshotsTest-649875217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ade49af7-bcc7-450a-ba66-8f76865d8211.c6119329-72d1-4d6e-9cdd-026355695821 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:50 devstack sudo[98490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ade49af7-bcc7-450a-ba66-8f76865d8211.c6119329-72d1-4d6e-9cdd-026355695821 Jun 17 05:43:50 devstack sudo[98490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:50 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-2a95fd12-6c6a-4735-8135-3481118f1611 tempest-VolumesListTestJSON-164431907 None] Lock "cinder-3fc272c7-3c7b-4571-83d0-1ccdf46bc2c9-delete_volume" released by "delete_volume" :: held 2.522s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:43:50 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-f8d2d318-5f0c-460d-9005-9ce5aeec1abc tempest-VolumesListTestJSON-164431907 None] Lock "cinder-731eeff9-8b5e-4b90-993c-e42ea71ff2cb-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:43:50 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-de169533-798d-485d-8005-5f1c46670de3 tempest-AttachVolumeTestJSON-1295992640 None] Acquiring lock "cinder-quobyte-15a4f55a-c42f-4c17-9ce7-a037c7a3faac" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:43:50 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-de169533-798d-485d-8005-5f1c46670de3 tempest-AttachVolumeTestJSON-1295992640 None] Lock "cinder-quobyte-15a4f55a-c42f-4c17-9ce7-a037c7a3faac" acquired by "delete_volume" :: waited 0.021s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:43:50 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-f8d2d318-5f0c-460d-9005-9ce5aeec1abc tempest-VolumesListTestJSON-164431907 None] Acquiring lock "cinder-quobyte-731eeff9-8b5e-4b90-993c-e42ea71ff2cb" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:43:50 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4909623-fe99-4347-aa50-408384b0c358]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:43:50 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-de169533-798d-485d-8005-5f1c46670de3 tempest-AttachVolumeTestJSON-1295992640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-15a4f55a-c42f-4c17-9ce7-a037c7a3faac {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:50 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-f8d2d318-5f0c-460d-9005-9ce5aeec1abc tempest-VolumesListTestJSON-164431907 None] Lock "cinder-quobyte-731eeff9-8b5e-4b90-993c-e42ea71ff2cb" acquired by "delete_volume" :: waited 0.036s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:43:50 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d6a1f1-806e-4b9f-b5f0-1f274261fef2]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:43:50 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f8d2d318-5f0c-460d-9005-9ce5aeec1abc tempest-VolumesListTestJSON-164431907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-731eeff9-8b5e-4b90-993c-e42ea71ff2cb {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:51 devstack sudo[98492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-15a4f55a-c42f-4c17-9ce7-a037c7a3faac Jun 17 05:43:51 devstack sudo[98492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:51 devstack sudo[98493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-731eeff9-8b5e-4b90-993c-e42ea71ff2cb Jun 17 05:43:51 devstack sudo[98493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:51 devstack sudo[98490]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:51 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e55b52e9-e891-4361-936a-4e5c0e7c8e1a tempest-GroupSnapshotsTest-649875217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ade49af7-bcc7-450a-ba66-8f76865d8211.c6119329-72d1-4d6e-9cdd-026355695821" returned: 0 in 0.690s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:51 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-e55b52e9-e891-4361-936a-4e5c0e7c8e1a tempest-GroupSnapshotsTest-649875217 None] Lock "cinder-quobyte-c6119329-72d1-4d6e-9cdd-026355695821" released by "_delete_snapshot" :: held 3.262s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:43:51 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-e55b52e9-e891-4361-936a-4e5c0e7c8e1a tempest-GroupSnapshotsTest-649875217 None] Lock "cinder-quobyte-ade49af7-bcc7-450a-ba66-8f76865d8211" released by "delete_snapshot" :: held 3.289s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:43:51 devstack cinder-volume[92083]: WARNING cinder.quota [None req-e55b52e9-e891-4361-936a-4e5c0e7c8e1a tempest-GroupSnapshotsTest-649875217 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1948663815 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1948663815, it is now deprecated. Please use the default quota class for default quota. Jun 17 05:43:51 devstack cinder-volume[92083]: WARNING cinder.quota [None req-e55b52e9-e891-4361-936a-4e5c0e7c8e1a tempest-GroupSnapshotsTest-649875217 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1948663815 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1948663815, it is now deprecated. Please use the default quota class for default quota. Jun 17 05:43:51 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-e55b52e9-e891-4361-936a-4e5c0e7c8e1a tempest-GroupSnapshotsTest-649875217 None] Created reservations ['54d954c0-0ec9-47d0-b034-72825ea21f4f', 'b5d61190-75b2-40de-b18c-7d933c1d1202', '82104f2b-1129-4857-a6e3-38c379c0b668', '15d42c29-bbeb-4d6f-a3a5-8a109e205b83'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:43:51 devstack sudo[98492]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:51 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-de169533-798d-485d-8005-5f1c46670de3 tempest-AttachVolumeTestJSON-1295992640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-15a4f55a-c42f-4c17-9ce7-a037c7a3faac" returned: 0 in 0.859s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:51 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-de169533-798d-485d-8005-5f1c46670de3 tempest-AttachVolumeTestJSON-1295992640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-15a4f55a-c42f-4c17-9ce7-a037c7a3faac {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:51 devstack sudo[98503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-15a4f55a-c42f-4c17-9ce7-a037c7a3faac Jun 17 05:43:51 devstack sudo[98503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:51 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-e55b52e9-e891-4361-936a-4e5c0e7c8e1a tempest-GroupSnapshotsTest-649875217 None] Created reservations ['7e1a29b5-888c-49f0-8611-6336d509d53f', '2563d7e6-94a6-4302-8191-25c6a95b2937', '02b5a706-865b-48e8-9ee8-316c7f2c2fbd', '4bce1408-e4a2-412e-8462-59f718b3645d'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:43:51 devstack sudo[98493]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:51 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f8d2d318-5f0c-460d-9005-9ce5aeec1abc tempest-VolumesListTestJSON-164431907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-731eeff9-8b5e-4b90-993c-e42ea71ff2cb" returned: 0 in 0.878s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:51 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f8d2d318-5f0c-460d-9005-9ce5aeec1abc tempest-VolumesListTestJSON-164431907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-731eeff9-8b5e-4b90-993c-e42ea71ff2cb {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:51 devstack sudo[98505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-731eeff9-8b5e-4b90-993c-e42ea71ff2cb Jun 17 05:43:51 devstack sudo[98505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:51 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-e55b52e9-e891-4361-936a-4e5c0e7c8e1a tempest-GroupSnapshotsTest-649875217 None] group_snapshot f3216112-7bf7-4fda-956d-afa485bec383: deleted successfully Jun 17 05:43:52 devstack sudo[98503]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-de169533-798d-485d-8005-5f1c46670de3 tempest-AttachVolumeTestJSON-1295992640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-15a4f55a-c42f-4c17-9ce7-a037c7a3faac" returned: 0 in 0.753s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:52 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-de169533-798d-485d-8005-5f1c46670de3 tempest-AttachVolumeTestJSON-1295992640 None] Lock "cinder-quobyte-15a4f55a-c42f-4c17-9ce7-a037c7a3faac" released by "delete_volume" :: held 1.685s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:43:52 devstack sudo[98505]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f8d2d318-5f0c-460d-9005-9ce5aeec1abc tempest-VolumesListTestJSON-164431907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-731eeff9-8b5e-4b90-993c-e42ea71ff2cb" returned: 0 in 0.752s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:52 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-f8d2d318-5f0c-460d-9005-9ce5aeec1abc tempest-VolumesListTestJSON-164431907 None] Lock "cinder-quobyte-731eeff9-8b5e-4b90-993c-e42ea71ff2cb" released by "delete_volume" :: held 1.689s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:43:52 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-de169533-798d-485d-8005-5f1c46670de3 tempest-AttachVolumeTestJSON-1295992640 None] Created reservations ['69267300-4f49-48a8-8b1b-82dfb7af9c10', 'c4f98157-c1d7-4b22-a3e5-f8ae4f0f3628', 'c3ff076b-2753-4814-a2df-cdc641d5fa58', '9596a37e-bd4f-49d3-a443-09b35f1e8bd0'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:43:52 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-c9b1ad96-d3b4-410a-896c-6ffc54cc885a tempest-GroupSnapshotsTest-649875217 None] Acquiring lock "cinder-quobyte-779051a0-8c71-438a-876c-0063f6feaa63" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:43:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-de169533-798d-485d-8005-5f1c46670de3 tempest-AttachVolumeTestJSON-1295992640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:43:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-de169533-798d-485d-8005-5f1c46670de3 tempest-AttachVolumeTestJSON-1295992640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:43:52 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-de169533-798d-485d-8005-5f1c46670de3 tempest-AttachVolumeTestJSON-1295992640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:43:52 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-de169533-798d-485d-8005-5f1c46670de3 tempest-AttachVolumeTestJSON-1295992640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:43:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-de169533-798d-485d-8005-5f1c46670de3 tempest-AttachVolumeTestJSON-1295992640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:43:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-de169533-798d-485d-8005-5f1c46670de3 tempest-AttachVolumeTestJSON-1295992640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:52 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-c9b1ad96-d3b4-410a-896c-6ffc54cc885a tempest-GroupSnapshotsTest-649875217 None] Lock "cinder-quobyte-779051a0-8c71-438a-876c-0063f6feaa63" acquired by "delete_volume" :: waited 0.042s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:43:52 devstack sudo[98509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:43:52 devstack sudo[98509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:52 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-f8d2d318-5f0c-460d-9005-9ce5aeec1abc tempest-VolumesListTestJSON-164431907 None] Created reservations ['e2479800-6c4c-4433-8ded-3c011757d0d0', '1d279719-4145-434a-bf6b-1105619a1971', '6490ae0f-322f-42ec-bb77-46f4b08d0793', '40021f54-42c3-4717-8788-113ea047889f'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:43:52 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a54fe9-d12c-4c0f-b5b5-19047a4aed33]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:43:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c9b1ad96-d3b4-410a-896c-6ffc54cc885a tempest-GroupSnapshotsTest-649875217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-779051a0-8c71-438a-876c-0063f6feaa63 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-f8d2d318-5f0c-460d-9005-9ce5aeec1abc tempest-VolumesListTestJSON-164431907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:43:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-f8d2d318-5f0c-460d-9005-9ce5aeec1abc tempest-VolumesListTestJSON-164431907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:43:52 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-f8d2d318-5f0c-460d-9005-9ce5aeec1abc tempest-VolumesListTestJSON-164431907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:43:52 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-f8d2d318-5f0c-460d-9005-9ce5aeec1abc tempest-VolumesListTestJSON-164431907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:43:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-f8d2d318-5f0c-460d-9005-9ce5aeec1abc tempest-VolumesListTestJSON-164431907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:43:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f8d2d318-5f0c-460d-9005-9ce5aeec1abc tempest-VolumesListTestJSON-164431907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:52 devstack sudo[98512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:43:52 devstack sudo[98512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:53 devstack sudo[98511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-779051a0-8c71-438a-876c-0063f6feaa63 Jun 17 05:43:53 devstack sudo[98511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:53 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-017912a8-3d19-4834-8bf7-374236fc162f tempest-AttachVolumeTestJSON-1295992640 None] Acquiring lock "cinder-00290233-0edf-4388-8d59-770e813ee758-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:43:53 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-017912a8-3d19-4834-8bf7-374236fc162f tempest-AttachVolumeTestJSON-1295992640 None] Lock "cinder-00290233-0edf-4388-8d59-770e813ee758-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:43:53 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-017912a8-3d19-4834-8bf7-374236fc162f tempest-AttachVolumeTestJSON-1295992640 None] Acquiring lock "cinder-quobyte-00290233-0edf-4388-8d59-770e813ee758" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:43:53 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-017912a8-3d19-4834-8bf7-374236fc162f tempest-AttachVolumeTestJSON-1295992640 None] Lock "cinder-quobyte-00290233-0edf-4388-8d59-770e813ee758" acquired by "delete_volume" :: waited 0.039s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:43:53 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-30ac9520-d29b-463f-ae61-78a3f19e1165 tempest-VolumesListTestJSON-164431907 None] Acquiring lock "cinder-4e4f5e01-b540-46eb-82e3-15ef83935550-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:43:53 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e60fe1-df4b-4d2f-b737-caf0db1f2a25]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:43:53 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-017912a8-3d19-4834-8bf7-374236fc162f tempest-AttachVolumeTestJSON-1295992640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00290233-0edf-4388-8d59-770e813ee758 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:53 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-30ac9520-d29b-463f-ae61-78a3f19e1165 tempest-VolumesListTestJSON-164431907 None] Lock "cinder-4e4f5e01-b540-46eb-82e3-15ef83935550-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:43:53 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-30ac9520-d29b-463f-ae61-78a3f19e1165 tempest-VolumesListTestJSON-164431907 None] Acquiring lock "cinder-quobyte-4e4f5e01-b540-46eb-82e3-15ef83935550" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:43:53 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-30ac9520-d29b-463f-ae61-78a3f19e1165 tempest-VolumesListTestJSON-164431907 None] Lock "cinder-quobyte-4e4f5e01-b540-46eb-82e3-15ef83935550" acquired by "delete_volume" :: waited 0.039s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:43:53 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e0d763-70b7-4c8d-abfc-dad205e852f6]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:43:53 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-30ac9520-d29b-463f-ae61-78a3f19e1165 tempest-VolumesListTestJSON-164431907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4e4f5e01-b540-46eb-82e3-15ef83935550 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:53 devstack sudo[98515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00290233-0edf-4388-8d59-770e813ee758 Jun 17 05:43:53 devstack sudo[98515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:53 devstack sudo[98517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4e4f5e01-b540-46eb-82e3-15ef83935550 Jun 17 05:43:53 devstack sudo[98517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:53 devstack sudo[98509]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:53 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-de169533-798d-485d-8005-5f1c46670de3 tempest-AttachVolumeTestJSON-1295992640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.926s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:53 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-de169533-798d-485d-8005-5f1c46670de3 tempest-AttachVolumeTestJSON-1295992640 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:43:53 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-de169533-798d-485d-8005-5f1c46670de3 tempest-AttachVolumeTestJSON-1295992640 None] Deleted volume successfully. Jun 17 05:43:53 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-de169533-798d-485d-8005-5f1c46670de3 tempest-AttachVolumeTestJSON-1295992640 None] Lock "cinder-15a4f55a-c42f-4c17-9ce7-a037c7a3faac-delete_volume" released by "delete_volume" :: held 3.013s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:43:53 devstack sudo[98512]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:53 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f8d2d318-5f0c-460d-9005-9ce5aeec1abc tempest-VolumesListTestJSON-164431907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.942s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:53 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-f8d2d318-5f0c-460d-9005-9ce5aeec1abc tempest-VolumesListTestJSON-164431907 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:43:53 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-f8d2d318-5f0c-460d-9005-9ce5aeec1abc tempest-VolumesListTestJSON-164431907 None] Deleted volume successfully. Jun 17 05:43:53 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-f8d2d318-5f0c-460d-9005-9ce5aeec1abc tempest-VolumesListTestJSON-164431907 None] Lock "cinder-731eeff9-8b5e-4b90-993c-e42ea71ff2cb-delete_volume" released by "delete_volume" :: held 3.094s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:43:54 devstack sudo[98511]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c9b1ad96-d3b4-410a-896c-6ffc54cc885a tempest-GroupSnapshotsTest-649875217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-779051a0-8c71-438a-876c-0063f6feaa63" returned: 0 in 1.285s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c9b1ad96-d3b4-410a-896c-6ffc54cc885a tempest-GroupSnapshotsTest-649875217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-779051a0-8c71-438a-876c-0063f6feaa63 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:54 devstack sudo[98524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-779051a0-8c71-438a-876c-0063f6feaa63 Jun 17 05:43:54 devstack sudo[98524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:54 devstack sudo[98517]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-30ac9520-d29b-463f-ae61-78a3f19e1165 tempest-VolumesListTestJSON-164431907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4e4f5e01-b540-46eb-82e3-15ef83935550" returned: 0 in 0.918s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-30ac9520-d29b-463f-ae61-78a3f19e1165 tempest-VolumesListTestJSON-164431907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4e4f5e01-b540-46eb-82e3-15ef83935550 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:54 devstack sudo[98515]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-017912a8-3d19-4834-8bf7-374236fc162f tempest-AttachVolumeTestJSON-1295992640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00290233-0edf-4388-8d59-770e813ee758" returned: 0 in 1.133s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-017912a8-3d19-4834-8bf7-374236fc162f tempest-AttachVolumeTestJSON-1295992640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00290233-0edf-4388-8d59-770e813ee758 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:54 devstack sudo[98532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4e4f5e01-b540-46eb-82e3-15ef83935550 Jun 17 05:43:54 devstack sudo[98532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:54 devstack sudo[98533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00290233-0edf-4388-8d59-770e813ee758 Jun 17 05:43:54 devstack sudo[98533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:54 devstack sudo[98524]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c9b1ad96-d3b4-410a-896c-6ffc54cc885a tempest-GroupSnapshotsTest-649875217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-779051a0-8c71-438a-876c-0063f6feaa63" returned: 0 in 0.733s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:54 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-c9b1ad96-d3b4-410a-896c-6ffc54cc885a tempest-GroupSnapshotsTest-649875217 None] Lock "cinder-quobyte-779051a0-8c71-438a-876c-0063f6feaa63" released by "delete_volume" :: held 2.110s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:43:54 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-c9b1ad96-d3b4-410a-896c-6ffc54cc885a tempest-GroupSnapshotsTest-649875217 None] Acquiring lock "cinder-quobyte-ade49af7-bcc7-450a-ba66-8f76865d8211" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:43:54 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-c9b1ad96-d3b4-410a-896c-6ffc54cc885a tempest-GroupSnapshotsTest-649875217 None] Lock "cinder-quobyte-ade49af7-bcc7-450a-ba66-8f76865d8211" acquired by "delete_volume" :: waited 0.019s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:43:54 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[83369e54-c195-4bb7-aed6-08952da2f919]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:43:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c9b1ad96-d3b4-410a-896c-6ffc54cc885a tempest-GroupSnapshotsTest-649875217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ade49af7-bcc7-450a-ba66-8f76865d8211 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:55 devstack sudo[98539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ade49af7-bcc7-450a-ba66-8f76865d8211 Jun 17 05:43:55 devstack sudo[98539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:55 devstack sudo[98532]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-30ac9520-d29b-463f-ae61-78a3f19e1165 tempest-VolumesListTestJSON-164431907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4e4f5e01-b540-46eb-82e3-15ef83935550" returned: 0 in 0.722s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:55 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-30ac9520-d29b-463f-ae61-78a3f19e1165 tempest-VolumesListTestJSON-164431907 None] Lock "cinder-quobyte-4e4f5e01-b540-46eb-82e3-15ef83935550" released by "delete_volume" :: held 1.723s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:43:55 devstack sudo[98533]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-017912a8-3d19-4834-8bf7-374236fc162f tempest-AttachVolumeTestJSON-1295992640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00290233-0edf-4388-8d59-770e813ee758" returned: 0 in 0.741s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:55 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-017912a8-3d19-4834-8bf7-374236fc162f tempest-AttachVolumeTestJSON-1295992640 None] Lock "cinder-quobyte-00290233-0edf-4388-8d59-770e813ee758" released by "delete_volume" :: held 1.943s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:43:55 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-30ac9520-d29b-463f-ae61-78a3f19e1165 tempest-VolumesListTestJSON-164431907 None] Created reservations ['c67f8550-f67f-4453-a045-cc60df767677', 'f33ff883-fef9-4cc8-8190-d15b18299b58', '4d52f724-20b8-4191-bdff-f59678bf3a84', 'bf1abc23-5ebd-4726-97ff-3dcd256aef62'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:43:55 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-017912a8-3d19-4834-8bf7-374236fc162f tempest-AttachVolumeTestJSON-1295992640 None] Created reservations ['697e462a-ad64-4b44-b1c9-5cd55216b910', '4ddee8aa-140b-43f7-95ad-dc13d304b50d', '9181e505-22cf-40c4-8c81-adb664df90de', '2869e874-913b-48c0-904b-e9acc53ce018'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:43:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-30ac9520-d29b-463f-ae61-78a3f19e1165 tempest-VolumesListTestJSON-164431907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:43:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-30ac9520-d29b-463f-ae61-78a3f19e1165 tempest-VolumesListTestJSON-164431907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:43:55 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-30ac9520-d29b-463f-ae61-78a3f19e1165 tempest-VolumesListTestJSON-164431907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:43:55 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-30ac9520-d29b-463f-ae61-78a3f19e1165 tempest-VolumesListTestJSON-164431907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:43:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-30ac9520-d29b-463f-ae61-78a3f19e1165 tempest-VolumesListTestJSON-164431907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:43:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-30ac9520-d29b-463f-ae61-78a3f19e1165 tempest-VolumesListTestJSON-164431907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:55 devstack sudo[98543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:43:55 devstack sudo[98543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-017912a8-3d19-4834-8bf7-374236fc162f tempest-AttachVolumeTestJSON-1295992640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:43:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-017912a8-3d19-4834-8bf7-374236fc162f tempest-AttachVolumeTestJSON-1295992640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:43:55 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-017912a8-3d19-4834-8bf7-374236fc162f tempest-AttachVolumeTestJSON-1295992640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:43:55 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-017912a8-3d19-4834-8bf7-374236fc162f tempest-AttachVolumeTestJSON-1295992640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:43:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-017912a8-3d19-4834-8bf7-374236fc162f tempest-AttachVolumeTestJSON-1295992640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:43:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-017912a8-3d19-4834-8bf7-374236fc162f tempest-AttachVolumeTestJSON-1295992640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:55 devstack sudo[98545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:43:55 devstack sudo[98545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:55 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-5ad82390-86f1-4061-8c60-d6b218426c8e tempest-AttachVolumeTestJSON-1295992640 None] Acquiring lock "cinder-4bf65822-1990-495b-ba97-a96db3520eb0-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:43:55 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-5ad82390-86f1-4061-8c60-d6b218426c8e tempest-AttachVolumeTestJSON-1295992640 None] Lock "cinder-4bf65822-1990-495b-ba97-a96db3520eb0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:43:55 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-5ad82390-86f1-4061-8c60-d6b218426c8e tempest-AttachVolumeTestJSON-1295992640 None] Acquiring lock "cinder-quobyte-4bf65822-1990-495b-ba97-a96db3520eb0" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:43:55 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-5ad82390-86f1-4061-8c60-d6b218426c8e tempest-AttachVolumeTestJSON-1295992640 None] Lock "cinder-quobyte-4bf65822-1990-495b-ba97-a96db3520eb0" acquired by "delete_volume" :: waited 0.015s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:43:55 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[0152b614-9e47-430b-b3f9-285363166a35]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:43:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-5ad82390-86f1-4061-8c60-d6b218426c8e tempest-AttachVolumeTestJSON-1295992640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4bf65822-1990-495b-ba97-a96db3520eb0 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:55 devstack sudo[98539]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c9b1ad96-d3b4-410a-896c-6ffc54cc885a tempest-GroupSnapshotsTest-649875217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ade49af7-bcc7-450a-ba66-8f76865d8211" returned: 0 in 0.961s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c9b1ad96-d3b4-410a-896c-6ffc54cc885a tempest-GroupSnapshotsTest-649875217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ade49af7-bcc7-450a-ba66-8f76865d8211 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:56 devstack sudo[98552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ade49af7-bcc7-450a-ba66-8f76865d8211 Jun 17 05:43:56 devstack sudo[98552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:56 devstack sudo[98551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4bf65822-1990-495b-ba97-a96db3520eb0 Jun 17 05:43:56 devstack sudo[98551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:56 devstack sudo[98543]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:56 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-30ac9520-d29b-463f-ae61-78a3f19e1165 tempest-VolumesListTestJSON-164431907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.856s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:56 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-30ac9520-d29b-463f-ae61-78a3f19e1165 tempest-VolumesListTestJSON-164431907 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:43:56 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-30ac9520-d29b-463f-ae61-78a3f19e1165 tempest-VolumesListTestJSON-164431907 None] Deleted volume successfully. Jun 17 05:43:56 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-30ac9520-d29b-463f-ae61-78a3f19e1165 tempest-VolumesListTestJSON-164431907 None] Lock "cinder-4e4f5e01-b540-46eb-82e3-15ef83935550-delete_volume" released by "delete_volume" :: held 2.945s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:43:56 devstack sudo[98545]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:56 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-017912a8-3d19-4834-8bf7-374236fc162f tempest-AttachVolumeTestJSON-1295992640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.917s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:56 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-017912a8-3d19-4834-8bf7-374236fc162f tempest-AttachVolumeTestJSON-1295992640 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:43:56 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-017912a8-3d19-4834-8bf7-374236fc162f tempest-AttachVolumeTestJSON-1295992640 None] Deleted volume successfully. Jun 17 05:43:56 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-017912a8-3d19-4834-8bf7-374236fc162f tempest-AttachVolumeTestJSON-1295992640 None] Lock "cinder-00290233-0edf-4388-8d59-770e813ee758-delete_volume" released by "delete_volume" :: held 3.189s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:43:56 devstack sudo[98552]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:56 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c9b1ad96-d3b4-410a-896c-6ffc54cc885a tempest-GroupSnapshotsTest-649875217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ade49af7-bcc7-450a-ba66-8f76865d8211" returned: 0 in 0.812s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:56 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-c9b1ad96-d3b4-410a-896c-6ffc54cc885a tempest-GroupSnapshotsTest-649875217 None] Lock "cinder-quobyte-ade49af7-bcc7-450a-ba66-8f76865d8211" released by "delete_volume" :: held 1.882s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:43:56 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-c9b1ad96-d3b4-410a-896c-6ffc54cc885a tempest-GroupSnapshotsTest-649875217 None] Created reservations ['e4c1a4bb-3cd7-4843-9f97-01ea3abd5e42'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:43:56 devstack cinder-volume[92083]: WARNING cinder.quota [None req-c9b1ad96-d3b4-410a-896c-6ffc54cc885a tempest-GroupSnapshotsTest-649875217 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1948663815 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1948663815, it is now deprecated. Please use the default quota class for default quota. Jun 17 05:43:56 devstack sudo[98551]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:56 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-c9b1ad96-d3b4-410a-896c-6ffc54cc885a tempest-GroupSnapshotsTest-649875217 None] Created reservations ['8aa93c6c-babe-43b3-b56d-68c104f8744b', '82dc0b08-8d8e-4990-b1a5-b8d5aafe0efa', '3f558128-9d8d-46bd-aa73-14dab905aa63', '676ab95e-9fb4-4b35-be01-38f1555ce432'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:43:56 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-5ad82390-86f1-4061-8c60-d6b218426c8e tempest-AttachVolumeTestJSON-1295992640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4bf65822-1990-495b-ba97-a96db3520eb0" returned: 0 in 1.073s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:56 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-5ad82390-86f1-4061-8c60-d6b218426c8e tempest-AttachVolumeTestJSON-1295992640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4bf65822-1990-495b-ba97-a96db3520eb0 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:56 devstack sudo[98561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4bf65822-1990-495b-ba97-a96db3520eb0 Jun 17 05:43:56 devstack sudo[98561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:57 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-c9b1ad96-d3b4-410a-896c-6ffc54cc885a tempest-GroupSnapshotsTest-649875217 None] Created reservations ['4ba7bfa3-ff2e-432a-b74d-a03a457f71b0', '5f6749b5-2b8e-4958-9542-6b2ea48cec50', 'edbc8142-15f8-40d8-9f5c-f5a3565dd14f', 'f561d974-79da-4fff-8d98-31035beeaad1'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:43:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-c9b1ad96-d3b4-410a-896c-6ffc54cc885a tempest-GroupSnapshotsTest-649875217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:43:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-c9b1ad96-d3b4-410a-896c-6ffc54cc885a tempest-GroupSnapshotsTest-649875217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:43:57 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-c9b1ad96-d3b4-410a-896c-6ffc54cc885a tempest-GroupSnapshotsTest-649875217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:43:57 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-c9b1ad96-d3b4-410a-896c-6ffc54cc885a tempest-GroupSnapshotsTest-649875217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:43:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-c9b1ad96-d3b4-410a-896c-6ffc54cc885a tempest-GroupSnapshotsTest-649875217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:43:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c9b1ad96-d3b4-410a-896c-6ffc54cc885a tempest-GroupSnapshotsTest-649875217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:57 devstack sudo[98563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:43:57 devstack sudo[98563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:57 devstack sudo[98561]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-5ad82390-86f1-4061-8c60-d6b218426c8e tempest-AttachVolumeTestJSON-1295992640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4bf65822-1990-495b-ba97-a96db3520eb0" returned: 0 in 0.725s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:57 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-5ad82390-86f1-4061-8c60-d6b218426c8e tempest-AttachVolumeTestJSON-1295992640 None] Lock "cinder-quobyte-4bf65822-1990-495b-ba97-a96db3520eb0" released by "delete_volume" :: held 1.860s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:43:57 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-5ad82390-86f1-4061-8c60-d6b218426c8e tempest-AttachVolumeTestJSON-1295992640 None] Created reservations ['6d86dcbb-e08b-4927-b156-d6ed6a391fb3', '078259a0-c882-45a8-bc2b-40b76720b9de', 'f94d1f2d-45dd-47e8-9274-851c16c1dcd0', '09df05d1-1832-41fa-904a-0981b920bba4'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:43:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-5ad82390-86f1-4061-8c60-d6b218426c8e tempest-AttachVolumeTestJSON-1295992640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:43:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-5ad82390-86f1-4061-8c60-d6b218426c8e tempest-AttachVolumeTestJSON-1295992640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:43:57 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-5ad82390-86f1-4061-8c60-d6b218426c8e tempest-AttachVolumeTestJSON-1295992640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:43:57 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-5ad82390-86f1-4061-8c60-d6b218426c8e tempest-AttachVolumeTestJSON-1295992640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:43:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-5ad82390-86f1-4061-8c60-d6b218426c8e tempest-AttachVolumeTestJSON-1295992640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:43:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-5ad82390-86f1-4061-8c60-d6b218426c8e tempest-AttachVolumeTestJSON-1295992640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:57 devstack sudo[98566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:43:57 devstack sudo[98566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:43:58 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-158930d2-b8a5-410d-9319-380a532e5733 tempest-GroupSnapshotsTest-649875217 None] Group tempest-GroupSnapshotsTest-Group-857017261: creating Jun 17 05:43:58 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-158930d2-b8a5-410d-9319-380a532e5733 tempest-GroupSnapshotsTest-649875217 None] Group tempest-GroupSnapshotsTest-Group-857017261: created successfully Jun 17 05:43:58 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-158930d2-b8a5-410d-9319-380a532e5733 tempest-GroupSnapshotsTest-649875217 None] Create group completed successfully. Jun 17 05:43:58 devstack sudo[98563]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:58 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c9b1ad96-d3b4-410a-896c-6ffc54cc885a tempest-GroupSnapshotsTest-649875217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.928s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:58 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-c9b1ad96-d3b4-410a-896c-6ffc54cc885a tempest-GroupSnapshotsTest-649875217 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:43:58 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-c9b1ad96-d3b4-410a-896c-6ffc54cc885a tempest-GroupSnapshotsTest-649875217 None] Delete group completed successfully. Jun 17 05:43:58 devstack sudo[98566]: pam_unix(sudo:session): session closed for user root Jun 17 05:43:58 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-5ad82390-86f1-4061-8c60-d6b218426c8e tempest-AttachVolumeTestJSON-1295992640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.788s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:43:58 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-5ad82390-86f1-4061-8c60-d6b218426c8e tempest-AttachVolumeTestJSON-1295992640 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:43:58 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-5ad82390-86f1-4061-8c60-d6b218426c8e tempest-AttachVolumeTestJSON-1295992640 None] Deleted volume successfully. Jun 17 05:43:58 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-5ad82390-86f1-4061-8c60-d6b218426c8e tempest-AttachVolumeTestJSON-1295992640 None] Lock "cinder-4bf65822-1990-495b-ba97-a96db3520eb0-delete_volume" released by "delete_volume" :: held 2.939s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:43:59 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-85593d6c-862b-42ed-b73d-e1568ea8e25b tempest-GroupSnapshotsTest-649875217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:43:59 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-85593d6c-862b-42ed-b73d-e1568ea8e25b tempest-GroupSnapshotsTest-649875217 None] Flow 'volume_create_manager' (7d2ea114-f378-419b-8a3c-0978703c4c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:43:59 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-85593d6c-862b-42ed-b73d-e1568ea8e25b tempest-GroupSnapshotsTest-649875217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2930eee2-ec05-4448-bb00-c7493960228a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:43:59 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-85593d6c-862b-42ed-b73d-e1568ea8e25b tempest-GroupSnapshotsTest-649875217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2930eee2-ec05-4448-bb00-c7493960228a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:43:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1323845612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5d2c75d3-5c13-4e16-9741-d524d3e0faaa,host='devstack@QuobyteHD#QuobyteHD',id=d466e508-f4b8-4ba1-9022-7eb39fa70f75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be4b791c6d8248eea35b95220d502055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:44:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:44:00Z,use_quota=True,user_id='42d27ebd58fd4929b3814c4c838ced2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(09762903-8bb8-4410-a156-b5e677268f38),volume_type_id=09762903-8bb8-4410-a156-b5e677268f38)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:43:59 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-85593d6c-862b-42ed-b73d-e1568ea8e25b tempest-GroupSnapshotsTest-649875217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (500bf556-6b58-4860-a4cc-df0eb3395d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:43:59 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-85593d6c-862b-42ed-b73d-e1568ea8e25b tempest-GroupSnapshotsTest-649875217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (500bf556-6b58-4860-a4cc-df0eb3395d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:43:59 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-85593d6c-862b-42ed-b73d-e1568ea8e25b tempest-GroupSnapshotsTest-649875217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (347fda1d-4d99-4ee1-89e1-e09a2ad40a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:43:59 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-85593d6c-862b-42ed-b73d-e1568ea8e25b tempest-GroupSnapshotsTest-649875217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (347fda1d-4d99-4ee1-89e1-e09a2ad40a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd466e508-f4b8-4ba1-9022-7eb39fa70f75', 'volume_name': 'volume-d466e508-f4b8-4ba1-9022-7eb39fa70f75', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:43:59 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-85593d6c-862b-42ed-b73d-e1568ea8e25b tempest-GroupSnapshotsTest-649875217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2e1336f-0006-4b01-b2c3-bf5963d62ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:43:59 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-85593d6c-862b-42ed-b73d-e1568ea8e25b tempest-GroupSnapshotsTest-649875217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2e1336f-0006-4b01-b2c3-bf5963d62ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:43:59 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-85593d6c-862b-42ed-b73d-e1568ea8e25b tempest-GroupSnapshotsTest-649875217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfeff887-63ce-42f1-8095-291f45c3de92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:43:59 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-85593d6c-862b-42ed-b73d-e1568ea8e25b tempest-GroupSnapshotsTest-649875217 None] Volume d466e508-f4b8-4ba1-9022-7eb39fa70f75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d466e508-f4b8-4ba1-9022-7eb39fa70f75', 'volume_size': 1} Jun 17 05:43:59 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-85593d6c-862b-42ed-b73d-e1568ea8e25b tempest-GroupSnapshotsTest-649875217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:43:59 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-85593d6c-862b-42ed-b73d-e1568ea8e25b tempest-GroupSnapshotsTest-649875217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:43:59 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-85593d6c-862b-42ed-b73d-e1568ea8e25b tempest-GroupSnapshotsTest-649875217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5d2c75d3-5c13-4e16-9741-d524d3e0faaa,created_at=2026-06-17T03:43:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1323845612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5d2c75d3-5c13-4e16-9741-d524d3e0faaa,host='devstack@QuobyteHD#QuobyteHD',id=d466e508-f4b8-4ba1-9022-7eb39fa70f75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be4b791c6d8248eea35b95220d502055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:44:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:44:00Z,use_quota=True,user_id='42d27ebd58fd4929b3814c4c838ced2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(09762903-8bb8-4410-a156-b5e677268f38),volume_type_id=09762903-8bb8-4410-a156-b5e677268f38)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:43:59 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-85593d6c-862b-42ed-b73d-e1568ea8e25b tempest-GroupSnapshotsTest-649875217 None] Creating volume d466e508-f4b8-4ba1-9022-7eb39fa70f75 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:43:59 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-85593d6c-862b-42ed-b73d-e1568ea8e25b tempest-GroupSnapshotsTest-649875217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:43:59 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-85593d6c-862b-42ed-b73d-e1568ea8e25b tempest-GroupSnapshotsTest-649875217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:43:59 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-85593d6c-862b-42ed-b73d-e1568ea8e25b tempest-GroupSnapshotsTest-649875217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:43:59 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-85593d6c-862b-42ed-b73d-e1568ea8e25b tempest-GroupSnapshotsTest-649875217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:43:59 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-85593d6c-862b-42ed-b73d-e1568ea8e25b tempest-GroupSnapshotsTest-649875217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:43:59 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-85593d6c-862b-42ed-b73d-e1568ea8e25b tempest-GroupSnapshotsTest-649875217 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:43:59 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-85593d6c-862b-42ed-b73d-e1568ea8e25b tempest-GroupSnapshotsTest-649875217 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:43:59 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-85593d6c-862b-42ed-b73d-e1568ea8e25b tempest-GroupSnapshotsTest-649875217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d466e508-f4b8-4ba1-9022-7eb39fa70f75 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:43:59 devstack sudo[98571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d466e508-f4b8-4ba1-9022-7eb39fa70f75 1073741824 Jun 17 05:43:59 devstack sudo[98571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:44:00 devstack sudo[98571]: pam_unix(sudo:session): session closed for user root Jun 17 05:44:00 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-85593d6c-862b-42ed-b73d-e1568ea8e25b tempest-GroupSnapshotsTest-649875217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d466e508-f4b8-4ba1-9022-7eb39fa70f75 1073741824" returned: 0 in 0.876s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:44:00 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-85593d6c-862b-42ed-b73d-e1568ea8e25b tempest-GroupSnapshotsTest-649875217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d466e508-f4b8-4ba1-9022-7eb39fa70f75 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:44:00 devstack sudo[98578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d466e508-f4b8-4ba1-9022-7eb39fa70f75 Jun 17 05:44:00 devstack sudo[98578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:44:01 devstack sudo[98578]: pam_unix(sudo:session): session closed for user root Jun 17 05:44:01 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-85593d6c-862b-42ed-b73d-e1568ea8e25b tempest-GroupSnapshotsTest-649875217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d466e508-f4b8-4ba1-9022-7eb39fa70f75" returned: 0 in 0.661s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:44:01 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-85593d6c-862b-42ed-b73d-e1568ea8e25b tempest-GroupSnapshotsTest-649875217 None] <== create_volume: return (1588ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:44:01 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-85593d6c-862b-42ed-b73d-e1568ea8e25b tempest-GroupSnapshotsTest-649875217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.590s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:44:01 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-85593d6c-862b-42ed-b73d-e1568ea8e25b tempest-GroupSnapshotsTest-649875217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfeff887-63ce-42f1-8095-291f45c3de92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d466e508-f4b8-4ba1-9022-7eb39fa70f75', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:44:01 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-85593d6c-862b-42ed-b73d-e1568ea8e25b tempest-GroupSnapshotsTest-649875217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (869fce1d-5e70-44e5-b509-4aee94b4d6eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:44:01 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-85593d6c-862b-42ed-b73d-e1568ea8e25b tempest-GroupSnapshotsTest-649875217 None] Volume volume-d466e508-f4b8-4ba1-9022-7eb39fa70f75 (d466e508-f4b8-4ba1-9022-7eb39fa70f75): created successfully Jun 17 05:44:01 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-85593d6c-862b-42ed-b73d-e1568ea8e25b tempest-GroupSnapshotsTest-649875217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (869fce1d-5e70-44e5-b509-4aee94b4d6eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:44:01 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-85593d6c-862b-42ed-b73d-e1568ea8e25b tempest-GroupSnapshotsTest-649875217 None] Flow 'volume_create_manager' (7d2ea114-f378-419b-8a3c-0978703c4c10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:44:01 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-85593d6c-862b-42ed-b73d-e1568ea8e25b tempest-GroupSnapshotsTest-649875217 None] Created volume successfully. Jun 17 05:44:02 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-9d90432e-7865-4528-846f-fdb28b75e3e5 tempest-GroupSnapshotsTest-649875217 None] GroupSnapshot 104fbe37-e516-4161-b38d-939636bd5c90: creating. Jun 17 05:44:02 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-9d90432e-7865-4528-846f-fdb28b75e3e5 tempest-GroupSnapshotsTest-649875217 None] Group snapshot 104fbe37-e516-4161-b38d-939636bd5c90: creating. {{(pid=92083) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 17 05:44:02 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-9d90432e-7865-4528-846f-fdb28b75e3e5 tempest-GroupSnapshotsTest-649875217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:44:02 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-9d90432e-7865-4528-846f-fdb28b75e3e5 tempest-GroupSnapshotsTest-649875217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:44:02 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-9d90432e-7865-4528-846f-fdb28b75e3e5 tempest-GroupSnapshotsTest-649875217 None] Creating offline snapshot 97f2439b-de5b-4964-a936-14d3efb25dc6 of volume d466e508-f4b8-4ba1-9022-7eb39fa70f75 {{(pid=92083) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 17 05:44:02 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c25336-5dc9-461a-a9e3-68632873c753]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:44:02 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-9d90432e-7865-4528-846f-fdb28b75e3e5 tempest-GroupSnapshotsTest-649875217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d466e508-f4b8-4ba1-9022-7eb39fa70f75 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:44:02 devstack sudo[98600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d466e508-f4b8-4ba1-9022-7eb39fa70f75 Jun 17 05:44:02 devstack sudo[98600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:44:03 devstack sudo[98600]: pam_unix(sudo:session): session closed for user root Jun 17 05:44:03 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-9d90432e-7865-4528-846f-fdb28b75e3e5 tempest-GroupSnapshotsTest-649875217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d466e508-f4b8-4ba1-9022-7eb39fa70f75" returned: 0 in 0.748s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:44:03 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-9d90432e-7865-4528-846f-fdb28b75e3e5 tempest-GroupSnapshotsTest-649875217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d466e508-f4b8-4ba1-9022-7eb39fa70f75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d466e508-f4b8-4ba1-9022-7eb39fa70f75.97f2439b-de5b-4964-a936-14d3efb25dc6 1G {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:44:03 devstack sudo[98606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d466e508-f4b8-4ba1-9022-7eb39fa70f75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d466e508-f4b8-4ba1-9022-7eb39fa70f75.97f2439b-de5b-4964-a936-14d3efb25dc6 1G Jun 17 05:44:03 devstack sudo[98606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:44:03 devstack sudo[98606]: pam_unix(sudo:session): session closed for user root Jun 17 05:44:03 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-9d90432e-7865-4528-846f-fdb28b75e3e5 tempest-GroupSnapshotsTest-649875217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d466e508-f4b8-4ba1-9022-7eb39fa70f75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d466e508-f4b8-4ba1-9022-7eb39fa70f75.97f2439b-de5b-4964-a936-14d3efb25dc6 1G" returned: 0 in 0.838s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:44:03 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-9d90432e-7865-4528-846f-fdb28b75e3e5 tempest-GroupSnapshotsTest-649875217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d466e508-f4b8-4ba1-9022-7eb39fa70f75 -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d466e508-f4b8-4ba1-9022-7eb39fa70f75.97f2439b-de5b-4964-a936-14d3efb25dc6 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:44:03 devstack sudo[98614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d466e508-f4b8-4ba1-9022-7eb39fa70f75 -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d466e508-f4b8-4ba1-9022-7eb39fa70f75.97f2439b-de5b-4964-a936-14d3efb25dc6 Jun 17 05:44:03 devstack sudo[98614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:44:04 devstack sudo[98614]: pam_unix(sudo:session): session closed for user root Jun 17 05:44:04 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-9d90432e-7865-4528-846f-fdb28b75e3e5 tempest-GroupSnapshotsTest-649875217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d466e508-f4b8-4ba1-9022-7eb39fa70f75 -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d466e508-f4b8-4ba1-9022-7eb39fa70f75.97f2439b-de5b-4964-a936-14d3efb25dc6" returned: 0 in 0.846s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:44:04 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [None req-9d90432e-7865-4528-846f-fdb28b75e3e5 tempest-GroupSnapshotsTest-649875217 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d466e508-f4b8-4ba1-9022-7eb39fa70f75.97f2439b-de5b-4964-a936-14d3efb25dc6 is being set with open permissions: ugo+rw: NotImplementedError Jun 17 05:44:04 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-9d90432e-7865-4528-846f-fdb28b75e3e5 tempest-GroupSnapshotsTest-649875217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d466e508-f4b8-4ba1-9022-7eb39fa70f75.97f2439b-de5b-4964-a936-14d3efb25dc6 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:44:04 devstack sudo[98621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d466e508-f4b8-4ba1-9022-7eb39fa70f75.97f2439b-de5b-4964-a936-14d3efb25dc6 Jun 17 05:44:04 devstack sudo[98621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:44:05 devstack sudo[98621]: pam_unix(sudo:session): session closed for user root Jun 17 05:44:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-9d90432e-7865-4528-846f-fdb28b75e3e5 tempest-GroupSnapshotsTest-649875217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d466e508-f4b8-4ba1-9022-7eb39fa70f75.97f2439b-de5b-4964-a936-14d3efb25dc6" returned: 0 in 0.765s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:44:05 devstack cinder-volume[92083]: DEBUG dbcounter [-] [92083] Writing DB stats cinder:INSERT=29,cinder:UPDATE=180,cinder:SELECT=160,cinder:DELETE=7 {{(pid=92083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:44:05 devstack cinder-volume[92083]: DEBUG dbcounter [-] [92083] Writing DB stats cinder:SELECT=138,cinder:INSERT=50,cinder:UPDATE=168,cinder:DELETE=12 {{(pid=92083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:44:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-9d90432e-7865-4528-846f-fdb28b75e3e5 tempest-GroupSnapshotsTest-649875217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d466e508-f4b8-4ba1-9022-7eb39fa70f75.info {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:44:05 devstack sudo[98624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d466e508-f4b8-4ba1-9022-7eb39fa70f75.info Jun 17 05:44:05 devstack sudo[98624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:44:06 devstack sudo[98624]: pam_unix(sudo:session): session closed for user root Jun 17 05:44:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-9d90432e-7865-4528-846f-fdb28b75e3e5 tempest-GroupSnapshotsTest-649875217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d466e508-f4b8-4ba1-9022-7eb39fa70f75.info" returned: 0 in 0.707s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:44:06 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [None req-9d90432e-7865-4528-846f-fdb28b75e3e5 tempest-GroupSnapshotsTest-649875217 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d466e508-f4b8-4ba1-9022-7eb39fa70f75.info is being set with open permissions: ugo+rw: NotImplementedError Jun 17 05:44:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-9d90432e-7865-4528-846f-fdb28b75e3e5 tempest-GroupSnapshotsTest-649875217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d466e508-f4b8-4ba1-9022-7eb39fa70f75.info {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:44:06 devstack sudo[98627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d466e508-f4b8-4ba1-9022-7eb39fa70f75.info Jun 17 05:44:06 devstack sudo[98627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:44:07 devstack sudo[98627]: pam_unix(sudo:session): session closed for user root Jun 17 05:44:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-9d90432e-7865-4528-846f-fdb28b75e3e5 tempest-GroupSnapshotsTest-649875217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d466e508-f4b8-4ba1-9022-7eb39fa70f75.info" returned: 0 in 0.872s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:44:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-9d90432e-7865-4528-846f-fdb28b75e3e5 tempest-GroupSnapshotsTest-649875217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.929s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:44:07 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-9d90432e-7865-4528-846f-fdb28b75e3e5 tempest-GroupSnapshotsTest-649875217 None] group_snapshot 104fbe37-e516-4161-b38d-939636bd5c90: created successfully Jun 17 05:44:07 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-bbba0fd6-856e-4f56-a1bd-ac5f59d08edc tempest-GroupSnapshotsTest-649875217 None] group_snapshot 104fbe37-e516-4161-b38d-939636bd5c90: deleting Jun 17 05:44:07 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-bbba0fd6-856e-4f56-a1bd-ac5f59d08edc tempest-GroupSnapshotsTest-649875217 None] group_snapshot 104fbe37-e516-4161-b38d-939636bd5c90: deleting {{(pid=92083) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 17 05:44:07 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-bbba0fd6-856e-4f56-a1bd-ac5f59d08edc tempest-GroupSnapshotsTest-649875217 None] Acquiring lock "cinder-quobyte-d466e508-f4b8-4ba1-9022-7eb39fa70f75" by "delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:44:07 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-bbba0fd6-856e-4f56-a1bd-ac5f59d08edc tempest-GroupSnapshotsTest-649875217 None] Lock "cinder-quobyte-d466e508-f4b8-4ba1-9022-7eb39fa70f75" acquired by "delete_snapshot" :: waited 0.029s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:44:07 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-bbba0fd6-856e-4f56-a1bd-ac5f59d08edc tempest-GroupSnapshotsTest-649875217 None] Acquiring lock "cinder-quobyte-97f2439b-de5b-4964-a936-14d3efb25dc6" by "_delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:44:07 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-bbba0fd6-856e-4f56-a1bd-ac5f59d08edc tempest-GroupSnapshotsTest-649875217 None] Lock "cinder-quobyte-97f2439b-de5b-4964-a936-14d3efb25dc6" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:44:07 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-bbba0fd6-856e-4f56-a1bd-ac5f59d08edc tempest-GroupSnapshotsTest-649875217 None] Deleting offline snapshot 97f2439b-de5b-4964-a936-14d3efb25dc6 of volume d466e508-f4b8-4ba1-9022-7eb39fa70f75 {{(pid=92083) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 17 05:44:07 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-bbba0fd6-856e-4f56-a1bd-ac5f59d08edc tempest-GroupSnapshotsTest-649875217 None] snapshot_file for this snap is: volume-d466e508-f4b8-4ba1-9022-7eb39fa70f75.97f2439b-de5b-4964-a936-14d3efb25dc6 {{(pid=92083) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 17 05:44:07 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4388e4f-7634-4d26-b54d-07ed6a15f8be]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:44:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-bbba0fd6-856e-4f56-a1bd-ac5f59d08edc tempest-GroupSnapshotsTest-649875217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d466e508-f4b8-4ba1-9022-7eb39fa70f75.97f2439b-de5b-4964-a936-14d3efb25dc6 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:44:08 devstack sudo[98630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d466e508-f4b8-4ba1-9022-7eb39fa70f75.97f2439b-de5b-4964-a936-14d3efb25dc6 Jun 17 05:44:08 devstack sudo[98630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:44:08 devstack sudo[98630]: pam_unix(sudo:session): session closed for user root Jun 17 05:44:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-bbba0fd6-856e-4f56-a1bd-ac5f59d08edc tempest-GroupSnapshotsTest-649875217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d466e508-f4b8-4ba1-9022-7eb39fa70f75.97f2439b-de5b-4964-a936-14d3efb25dc6" returned: 0 in 0.876s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:44:08 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-bbba0fd6-856e-4f56-a1bd-ac5f59d08edc tempest-GroupSnapshotsTest-649875217 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d466e508-f4b8-4ba1-9022-7eb39fa70f75(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92083) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 05:44:08 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cec77cb-a3d1-40c4-b0ef-ad2bf47554a4]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:44:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-bbba0fd6-856e-4f56-a1bd-ac5f59d08edc tempest-GroupSnapshotsTest-649875217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d466e508-f4b8-4ba1-9022-7eb39fa70f75 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:44:09 devstack sudo[98640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d466e508-f4b8-4ba1-9022-7eb39fa70f75 Jun 17 05:44:09 devstack sudo[98640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:44:09 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-201e2b16-f87c-456b-9827-8f0746b2f022 tempest-VolumesSnapshotTestJSON-145827129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:44:09 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-201e2b16-f87c-456b-9827-8f0746b2f022 tempest-VolumesSnapshotTestJSON-145827129 None] Flow 'volume_create_manager' (5d3b3200-2c5d-423f-b64c-e606a820a654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:44:09 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-201e2b16-f87c-456b-9827-8f0746b2f022 tempest-VolumesSnapshotTestJSON-145827129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beb7ef78-9640-45ae-ab43-8c388921e64c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:44:09 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-201e2b16-f87c-456b-9827-8f0746b2f022 tempest-VolumesSnapshotTestJSON-145827129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beb7ef78-9640-45ae-ab43-8c388921e64c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:44:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-451117909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32c260c5-65d3-4292-be07-5296ac8138fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a25655f92b243568375cdea8e080fb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:44:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:44:09Z,use_quota=True,user_id='ed17ca0128804d5096d31ee4ed1ff51e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:44:09 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-201e2b16-f87c-456b-9827-8f0746b2f022 tempest-VolumesSnapshotTestJSON-145827129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38fa7b9a-1505-4315-b62e-67d8f635b30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:44:09 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-201e2b16-f87c-456b-9827-8f0746b2f022 tempest-VolumesSnapshotTestJSON-145827129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38fa7b9a-1505-4315-b62e-67d8f635b30d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:44:09 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-201e2b16-f87c-456b-9827-8f0746b2f022 tempest-VolumesSnapshotTestJSON-145827129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ad672e7-4b2d-4f13-8421-56daebf3eece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:44:09 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-201e2b16-f87c-456b-9827-8f0746b2f022 tempest-VolumesSnapshotTestJSON-145827129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ad672e7-4b2d-4f13-8421-56daebf3eece) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32c260c5-65d3-4292-be07-5296ac8138fe', 'volume_name': 'volume-32c260c5-65d3-4292-be07-5296ac8138fe', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:44:09 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-201e2b16-f87c-456b-9827-8f0746b2f022 tempest-VolumesSnapshotTestJSON-145827129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7c378a5-76a0-4b16-92ef-4edd124c093b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:44:09 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-201e2b16-f87c-456b-9827-8f0746b2f022 tempest-VolumesSnapshotTestJSON-145827129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7c378a5-76a0-4b16-92ef-4edd124c093b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:44:09 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-201e2b16-f87c-456b-9827-8f0746b2f022 tempest-VolumesSnapshotTestJSON-145827129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af379224-e62b-4f57-a0b0-22e23efe0428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:44:09 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-201e2b16-f87c-456b-9827-8f0746b2f022 tempest-VolumesSnapshotTestJSON-145827129 None] Volume 32c260c5-65d3-4292-be07-5296ac8138fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32c260c5-65d3-4292-be07-5296ac8138fe', 'volume_size': 1} Jun 17 05:44:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-201e2b16-f87c-456b-9827-8f0746b2f022 tempest-VolumesSnapshotTestJSON-145827129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:44:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-201e2b16-f87c-456b-9827-8f0746b2f022 tempest-VolumesSnapshotTestJSON-145827129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:44:09 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-201e2b16-f87c-456b-9827-8f0746b2f022 tempest-VolumesSnapshotTestJSON-145827129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:44:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-451117909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32c260c5-65d3-4292-be07-5296ac8138fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a25655f92b243568375cdea8e080fb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:44:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:44:09Z,use_quota=True,user_id='ed17ca0128804d5096d31ee4ed1ff51e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:44:09 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-201e2b16-f87c-456b-9827-8f0746b2f022 tempest-VolumesSnapshotTestJSON-145827129 None] Creating volume 32c260c5-65d3-4292-be07-5296ac8138fe {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:44:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-201e2b16-f87c-456b-9827-8f0746b2f022 tempest-VolumesSnapshotTestJSON-145827129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:44:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-201e2b16-f87c-456b-9827-8f0746b2f022 tempest-VolumesSnapshotTestJSON-145827129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:44:09 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-201e2b16-f87c-456b-9827-8f0746b2f022 tempest-VolumesSnapshotTestJSON-145827129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:44:09 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-201e2b16-f87c-456b-9827-8f0746b2f022 tempest-VolumesSnapshotTestJSON-145827129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:44:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-201e2b16-f87c-456b-9827-8f0746b2f022 tempest-VolumesSnapshotTestJSON-145827129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:44:09 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-201e2b16-f87c-456b-9827-8f0746b2f022 tempest-VolumesSnapshotTestJSON-145827129 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:44:09 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-201e2b16-f87c-456b-9827-8f0746b2f022 tempest-VolumesSnapshotTestJSON-145827129 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:44:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-201e2b16-f87c-456b-9827-8f0746b2f022 tempest-VolumesSnapshotTestJSON-145827129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-32c260c5-65d3-4292-be07-5296ac8138fe 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:44:09 devstack sudo[98642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-32c260c5-65d3-4292-be07-5296ac8138fe 1073741824 Jun 17 05:44:09 devstack sudo[98642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:44:09 devstack sudo[98640]: pam_unix(sudo:session): session closed for user root Jun 17 05:44:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-bbba0fd6-856e-4f56-a1bd-ac5f59d08edc tempest-GroupSnapshotsTest-649875217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d466e508-f4b8-4ba1-9022-7eb39fa70f75" returned: 0 in 0.833s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:44:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-bbba0fd6-856e-4f56-a1bd-ac5f59d08edc tempest-GroupSnapshotsTest-649875217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d466e508-f4b8-4ba1-9022-7eb39fa70f75.97f2439b-de5b-4964-a936-14d3efb25dc6 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:44:09 devstack sudo[98647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d466e508-f4b8-4ba1-9022-7eb39fa70f75.97f2439b-de5b-4964-a936-14d3efb25dc6 Jun 17 05:44:09 devstack sudo[98647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:44:10 devstack sudo[98642]: pam_unix(sudo:session): session closed for user root Jun 17 05:44:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-201e2b16-f87c-456b-9827-8f0746b2f022 tempest-VolumesSnapshotTestJSON-145827129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-32c260c5-65d3-4292-be07-5296ac8138fe 1073741824" returned: 0 in 1.352s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:44:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-201e2b16-f87c-456b-9827-8f0746b2f022 tempest-VolumesSnapshotTestJSON-145827129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-32c260c5-65d3-4292-be07-5296ac8138fe {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:44:10 devstack sudo[98711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-32c260c5-65d3-4292-be07-5296ac8138fe Jun 17 05:44:10 devstack sudo[98711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:44:11 devstack sudo[98647]: pam_unix(sudo:session): session closed for user root Jun 17 05:44:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-bbba0fd6-856e-4f56-a1bd-ac5f59d08edc tempest-GroupSnapshotsTest-649875217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d466e508-f4b8-4ba1-9022-7eb39fa70f75.97f2439b-de5b-4964-a936-14d3efb25dc6" returned: 0 in 1.462s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:44:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-bbba0fd6-856e-4f56-a1bd-ac5f59d08edc tempest-GroupSnapshotsTest-649875217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d466e508-f4b8-4ba1-9022-7eb39fa70f75.97f2439b-de5b-4964-a936-14d3efb25dc6 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:44:11 devstack sudo[98717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d466e508-f4b8-4ba1-9022-7eb39fa70f75.97f2439b-de5b-4964-a936-14d3efb25dc6 Jun 17 05:44:11 devstack sudo[98717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:44:11 devstack sudo[98711]: pam_unix(sudo:session): session closed for user root Jun 17 05:44:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-201e2b16-f87c-456b-9827-8f0746b2f022 tempest-VolumesSnapshotTestJSON-145827129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-32c260c5-65d3-4292-be07-5296ac8138fe" returned: 0 in 1.165s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:44:12 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-201e2b16-f87c-456b-9827-8f0746b2f022 tempest-VolumesSnapshotTestJSON-145827129 None] <== create_volume: return (2588ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:44:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-201e2b16-f87c-456b-9827-8f0746b2f022 tempest-VolumesSnapshotTestJSON-145827129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.592s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:44:12 devstack sudo[98717]: pam_unix(sudo:session): session closed for user root Jun 17 05:44:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-bbba0fd6-856e-4f56-a1bd-ac5f59d08edc tempest-GroupSnapshotsTest-649875217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d466e508-f4b8-4ba1-9022-7eb39fa70f75.97f2439b-de5b-4964-a936-14d3efb25dc6" returned: 0 in 0.826s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:44:12 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-201e2b16-f87c-456b-9827-8f0746b2f022 tempest-VolumesSnapshotTestJSON-145827129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af379224-e62b-4f57-a0b0-22e23efe0428) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32c260c5-65d3-4292-be07-5296ac8138fe', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:44:12 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-201e2b16-f87c-456b-9827-8f0746b2f022 tempest-VolumesSnapshotTestJSON-145827129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36e17fd6-e676-4cb5-895f-5c5f6d2e8126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:44:12 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-bbba0fd6-856e-4f56-a1bd-ac5f59d08edc tempest-GroupSnapshotsTest-649875217 None] Lock "cinder-quobyte-97f2439b-de5b-4964-a936-14d3efb25dc6" released by "_delete_snapshot" :: held 4.191s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:44:12 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-201e2b16-f87c-456b-9827-8f0746b2f022 tempest-VolumesSnapshotTestJSON-145827129 None] Volume volume-32c260c5-65d3-4292-be07-5296ac8138fe (32c260c5-65d3-4292-be07-5296ac8138fe): created successfully Jun 17 05:44:12 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-201e2b16-f87c-456b-9827-8f0746b2f022 tempest-VolumesSnapshotTestJSON-145827129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36e17fd6-e676-4cb5-895f-5c5f6d2e8126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:44:12 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-201e2b16-f87c-456b-9827-8f0746b2f022 tempest-VolumesSnapshotTestJSON-145827129 None] Flow 'volume_create_manager' (5d3b3200-2c5d-423f-b64c-e606a820a654) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:44:12 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-bbba0fd6-856e-4f56-a1bd-ac5f59d08edc tempest-GroupSnapshotsTest-649875217 None] Lock "cinder-quobyte-d466e508-f4b8-4ba1-9022-7eb39fa70f75" released by "delete_snapshot" :: held 4.248s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:44:12 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-201e2b16-f87c-456b-9827-8f0746b2f022 tempest-VolumesSnapshotTestJSON-145827129 None] Created volume successfully. Jun 17 05:44:12 devstack cinder-volume[92083]: WARNING cinder.quota [None req-bbba0fd6-856e-4f56-a1bd-ac5f59d08edc tempest-GroupSnapshotsTest-649875217 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1228550854 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1228550854, it is now deprecated. Please use the default quota class for default quota. Jun 17 05:44:12 devstack cinder-volume[92083]: WARNING cinder.quota [None req-bbba0fd6-856e-4f56-a1bd-ac5f59d08edc tempest-GroupSnapshotsTest-649875217 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1228550854 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1228550854, it is now deprecated. Please use the default quota class for default quota. Jun 17 05:44:12 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-bbba0fd6-856e-4f56-a1bd-ac5f59d08edc tempest-GroupSnapshotsTest-649875217 None] Created reservations ['53c7b787-247a-40f2-b2ea-1c15d6a5d8b6', '31645dee-5863-4a17-8673-4ffa6e6562bd', '7972188b-b309-4975-9b57-ee5b99fd38e3', 'dab41878-ba7c-4003-a35d-81b2c8602114'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:44:12 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-bbba0fd6-856e-4f56-a1bd-ac5f59d08edc tempest-GroupSnapshotsTest-649875217 None] group_snapshot 104fbe37-e516-4161-b38d-939636bd5c90: deleted successfully Jun 17 05:44:13 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-8a15a1ec-7283-49b7-b950-757e71f4d4ba tempest-VolumesSnapshotTestJSON-145827129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:44:13 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-8a15a1ec-7283-49b7-b950-757e71f4d4ba tempest-VolumesSnapshotTestJSON-145827129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:44:13 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-8a15a1ec-7283-49b7-b950-757e71f4d4ba tempest-VolumesSnapshotTestJSON-145827129 None] Creating offline snapshot e4d302f4-67d2-40be-b243-99f519c1a1ba of volume 32c260c5-65d3-4292-be07-5296ac8138fe {{(pid=92083) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 17 05:44:13 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9b8945-f908-44b9-be7f-d82fc273f98d]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:44:13 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8a15a1ec-7283-49b7-b950-757e71f4d4ba tempest-VolumesSnapshotTestJSON-145827129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-32c260c5-65d3-4292-be07-5296ac8138fe {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:44:13 devstack sudo[98725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-32c260c5-65d3-4292-be07-5296ac8138fe Jun 17 05:44:13 devstack sudo[98725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:44:13 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-ccdef4b3-1f1c-40d1-b2a4-1635a1fb5935 tempest-GroupSnapshotsTest-649875217 None] Acquiring lock "cinder-quobyte-d466e508-f4b8-4ba1-9022-7eb39fa70f75" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:44:13 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-ccdef4b3-1f1c-40d1-b2a4-1635a1fb5935 tempest-GroupSnapshotsTest-649875217 None] Lock "cinder-quobyte-d466e508-f4b8-4ba1-9022-7eb39fa70f75" acquired by "delete_volume" :: waited 0.040s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:44:13 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99b8b8b-4a79-43a5-981a-436153b84ff9]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:44:13 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ccdef4b3-1f1c-40d1-b2a4-1635a1fb5935 tempest-GroupSnapshotsTest-649875217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d466e508-f4b8-4ba1-9022-7eb39fa70f75 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:44:14 devstack sudo[98727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d466e508-f4b8-4ba1-9022-7eb39fa70f75 Jun 17 05:44:14 devstack sudo[98727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:44:14 devstack sudo[98725]: pam_unix(sudo:session): session closed for user root Jun 17 05:44:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8a15a1ec-7283-49b7-b950-757e71f4d4ba tempest-VolumesSnapshotTestJSON-145827129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-32c260c5-65d3-4292-be07-5296ac8138fe" returned: 0 in 1.242s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:44:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8a15a1ec-7283-49b7-b950-757e71f4d4ba tempest-VolumesSnapshotTestJSON-145827129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-32c260c5-65d3-4292-be07-5296ac8138fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-32c260c5-65d3-4292-be07-5296ac8138fe.e4d302f4-67d2-40be-b243-99f519c1a1ba 1G {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:44:14 devstack sudo[98732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-32c260c5-65d3-4292-be07-5296ac8138fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-32c260c5-65d3-4292-be07-5296ac8138fe.e4d302f4-67d2-40be-b243-99f519c1a1ba 1G Jun 17 05:44:14 devstack sudo[98732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:44:14 devstack sudo[98727]: pam_unix(sudo:session): session closed for user root Jun 17 05:44:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ccdef4b3-1f1c-40d1-b2a4-1635a1fb5935 tempest-GroupSnapshotsTest-649875217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d466e508-f4b8-4ba1-9022-7eb39fa70f75" returned: 0 in 1.184s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:44:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ccdef4b3-1f1c-40d1-b2a4-1635a1fb5935 tempest-GroupSnapshotsTest-649875217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d466e508-f4b8-4ba1-9022-7eb39fa70f75 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:44:15 devstack sudo[98744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d466e508-f4b8-4ba1-9022-7eb39fa70f75 Jun 17 05:44:15 devstack sudo[98744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:44:15 devstack sudo[98732]: pam_unix(sudo:session): session closed for user root Jun 17 05:44:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8a15a1ec-7283-49b7-b950-757e71f4d4ba tempest-VolumesSnapshotTestJSON-145827129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-32c260c5-65d3-4292-be07-5296ac8138fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-32c260c5-65d3-4292-be07-5296ac8138fe.e4d302f4-67d2-40be-b243-99f519c1a1ba 1G" returned: 0 in 1.322s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:44:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8a15a1ec-7283-49b7-b950-757e71f4d4ba tempest-VolumesSnapshotTestJSON-145827129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32c260c5-65d3-4292-be07-5296ac8138fe -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-32c260c5-65d3-4292-be07-5296ac8138fe.e4d302f4-67d2-40be-b243-99f519c1a1ba {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:44:15 devstack sudo[98750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32c260c5-65d3-4292-be07-5296ac8138fe -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-32c260c5-65d3-4292-be07-5296ac8138fe.e4d302f4-67d2-40be-b243-99f519c1a1ba Jun 17 05:44:15 devstack sudo[98750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:44:15 devstack sudo[98744]: pam_unix(sudo:session): session closed for user root Jun 17 05:44:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ccdef4b3-1f1c-40d1-b2a4-1635a1fb5935 tempest-GroupSnapshotsTest-649875217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d466e508-f4b8-4ba1-9022-7eb39fa70f75" returned: 0 in 0.958s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:44:15 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-ccdef4b3-1f1c-40d1-b2a4-1635a1fb5935 tempest-GroupSnapshotsTest-649875217 None] Lock "cinder-quobyte-d466e508-f4b8-4ba1-9022-7eb39fa70f75" released by "delete_volume" :: held 2.264s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:44:16 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-ccdef4b3-1f1c-40d1-b2a4-1635a1fb5935 tempest-GroupSnapshotsTest-649875217 None] Created reservations ['087aac15-c4d6-4570-b89e-de48bed7ab28'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:44:16 devstack cinder-volume[92083]: WARNING cinder.quota [None req-ccdef4b3-1f1c-40d1-b2a4-1635a1fb5935 tempest-GroupSnapshotsTest-649875217 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1228550854 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1228550854, it is now deprecated. Please use the default quota class for default quota. Jun 17 05:44:16 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-ccdef4b3-1f1c-40d1-b2a4-1635a1fb5935 tempest-GroupSnapshotsTest-649875217 None] Created reservations ['848c232b-a4ec-49e2-be2a-6c35fe57c685', '57458bab-a670-45b5-88dc-9e0b1acfc31f', '20ea9b93-ccb0-477e-99d3-4257a436e8db', 'f5aec5a4-91e3-4919-afc8-4643475f8e44'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:44:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ccdef4b3-1f1c-40d1-b2a4-1635a1fb5935 tempest-GroupSnapshotsTest-649875217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:44:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ccdef4b3-1f1c-40d1-b2a4-1635a1fb5935 tempest-GroupSnapshotsTest-649875217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:44:16 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ccdef4b3-1f1c-40d1-b2a4-1635a1fb5935 tempest-GroupSnapshotsTest-649875217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:44:16 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ccdef4b3-1f1c-40d1-b2a4-1635a1fb5935 tempest-GroupSnapshotsTest-649875217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:44:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ccdef4b3-1f1c-40d1-b2a4-1635a1fb5935 tempest-GroupSnapshotsTest-649875217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:44:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ccdef4b3-1f1c-40d1-b2a4-1635a1fb5935 tempest-GroupSnapshotsTest-649875217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:44:16 devstack sudo[98753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:44:16 devstack sudo[98753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:44:16 devstack sudo[98750]: pam_unix(sudo:session): session closed for user root Jun 17 05:44:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8a15a1ec-7283-49b7-b950-757e71f4d4ba tempest-VolumesSnapshotTestJSON-145827129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32c260c5-65d3-4292-be07-5296ac8138fe -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-32c260c5-65d3-4292-be07-5296ac8138fe.e4d302f4-67d2-40be-b243-99f519c1a1ba" returned: 0 in 1.111s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:44:16 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [None req-8a15a1ec-7283-49b7-b950-757e71f4d4ba tempest-VolumesSnapshotTestJSON-145827129 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-32c260c5-65d3-4292-be07-5296ac8138fe.e4d302f4-67d2-40be-b243-99f519c1a1ba is being set with open permissions: ugo+rw Jun 17 05:44:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8a15a1ec-7283-49b7-b950-757e71f4d4ba tempest-VolumesSnapshotTestJSON-145827129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-32c260c5-65d3-4292-be07-5296ac8138fe.e4d302f4-67d2-40be-b243-99f519c1a1ba {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:44:16 devstack sudo[98758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-32c260c5-65d3-4292-be07-5296ac8138fe.e4d302f4-67d2-40be-b243-99f519c1a1ba Jun 17 05:44:16 devstack sudo[98758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:44:17 devstack sudo[98753]: pam_unix(sudo:session): session closed for user root Jun 17 05:44:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ccdef4b3-1f1c-40d1-b2a4-1635a1fb5935 tempest-GroupSnapshotsTest-649875217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.980s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:44:17 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-ccdef4b3-1f1c-40d1-b2a4-1635a1fb5935 tempest-GroupSnapshotsTest-649875217 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:44:17 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-ccdef4b3-1f1c-40d1-b2a4-1635a1fb5935 tempest-GroupSnapshotsTest-649875217 None] Delete group completed successfully. Jun 17 05:44:17 devstack sudo[98758]: pam_unix(sudo:session): session closed for user root Jun 17 05:44:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8a15a1ec-7283-49b7-b950-757e71f4d4ba tempest-VolumesSnapshotTestJSON-145827129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-32c260c5-65d3-4292-be07-5296ac8138fe.e4d302f4-67d2-40be-b243-99f519c1a1ba" returned: 0 in 1.111s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:44:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8a15a1ec-7283-49b7-b950-757e71f4d4ba tempest-VolumesSnapshotTestJSON-145827129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-32c260c5-65d3-4292-be07-5296ac8138fe.info {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:44:17 devstack sudo[98762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-32c260c5-65d3-4292-be07-5296ac8138fe.info Jun 17 05:44:17 devstack sudo[98762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:44:18 devstack sudo[98762]: pam_unix(sudo:session): session closed for user root Jun 17 05:44:18 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8a15a1ec-7283-49b7-b950-757e71f4d4ba tempest-VolumesSnapshotTestJSON-145827129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-32c260c5-65d3-4292-be07-5296ac8138fe.info" returned: 0 in 0.967s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:44:18 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [None req-8a15a1ec-7283-49b7-b950-757e71f4d4ba tempest-VolumesSnapshotTestJSON-145827129 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-32c260c5-65d3-4292-be07-5296ac8138fe.info is being set with open permissions: ugo+rw Jun 17 05:44:18 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8a15a1ec-7283-49b7-b950-757e71f4d4ba tempest-VolumesSnapshotTestJSON-145827129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-32c260c5-65d3-4292-be07-5296ac8138fe.info {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:44:18 devstack sudo[98766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-32c260c5-65d3-4292-be07-5296ac8138fe.info Jun 17 05:44:18 devstack sudo[98766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:44:19 devstack sudo[98766]: pam_unix(sudo:session): session closed for user root Jun 17 05:44:19 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8a15a1ec-7283-49b7-b950-757e71f4d4ba tempest-VolumesSnapshotTestJSON-145827129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-32c260c5-65d3-4292-be07-5296ac8138fe.info" returned: 0 in 1.031s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:44:19 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-8a15a1ec-7283-49b7-b950-757e71f4d4ba tempest-VolumesSnapshotTestJSON-145827129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.940s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:44:20 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-8a15a1ec-7283-49b7-b950-757e71f4d4ba tempest-VolumesSnapshotTestJSON-145827129 None] Create snapshot completed successfully Jun 17 05:44:20 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-a721d2b4-7420-4ef9-bfcd-357cceaa4333 tempest-VolumesSnapshotTestJSON-145827129 None] Acquiring lock "cinder-e4d302f4-67d2-40be-b243-99f519c1a1ba-delete_snapshot" by "delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:44:20 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-a721d2b4-7420-4ef9-bfcd-357cceaa4333 tempest-VolumesSnapshotTestJSON-145827129 None] Lock "cinder-e4d302f4-67d2-40be-b243-99f519c1a1ba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:44:20 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-a721d2b4-7420-4ef9-bfcd-357cceaa4333 tempest-VolumesSnapshotTestJSON-145827129 None] Acquiring lock "cinder-quobyte-32c260c5-65d3-4292-be07-5296ac8138fe" by "delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:44:20 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-a721d2b4-7420-4ef9-bfcd-357cceaa4333 tempest-VolumesSnapshotTestJSON-145827129 None] Lock "cinder-quobyte-32c260c5-65d3-4292-be07-5296ac8138fe" acquired by "delete_snapshot" :: waited 0.024s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:44:20 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-a721d2b4-7420-4ef9-bfcd-357cceaa4333 tempest-VolumesSnapshotTestJSON-145827129 None] Acquiring lock "cinder-quobyte-e4d302f4-67d2-40be-b243-99f519c1a1ba" by "_delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:44:20 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-a721d2b4-7420-4ef9-bfcd-357cceaa4333 tempest-VolumesSnapshotTestJSON-145827129 None] Lock "cinder-quobyte-e4d302f4-67d2-40be-b243-99f519c1a1ba" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:44:20 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-a721d2b4-7420-4ef9-bfcd-357cceaa4333 tempest-VolumesSnapshotTestJSON-145827129 None] Deleting offline snapshot e4d302f4-67d2-40be-b243-99f519c1a1ba of volume 32c260c5-65d3-4292-be07-5296ac8138fe {{(pid=92083) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 17 05:44:20 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-a721d2b4-7420-4ef9-bfcd-357cceaa4333 tempest-VolumesSnapshotTestJSON-145827129 None] snapshot_file for this snap is: volume-32c260c5-65d3-4292-be07-5296ac8138fe.e4d302f4-67d2-40be-b243-99f519c1a1ba {{(pid=92083) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 17 05:44:20 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cba7a1d-150d-4aa9-a570-97ffae23de43]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:44:20 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a721d2b4-7420-4ef9-bfcd-357cceaa4333 tempest-VolumesSnapshotTestJSON-145827129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-32c260c5-65d3-4292-be07-5296ac8138fe.e4d302f4-67d2-40be-b243-99f519c1a1ba {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:44:21 devstack sudo[98770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-32c260c5-65d3-4292-be07-5296ac8138fe.e4d302f4-67d2-40be-b243-99f519c1a1ba Jun 17 05:44:21 devstack sudo[98770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:44:21 devstack sudo[98770]: pam_unix(sudo:session): session closed for user root Jun 17 05:44:21 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a721d2b4-7420-4ef9-bfcd-357cceaa4333 tempest-VolumesSnapshotTestJSON-145827129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-32c260c5-65d3-4292-be07-5296ac8138fe.e4d302f4-67d2-40be-b243-99f519c1a1ba" returned: 0 in 1.018s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:44:21 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-a721d2b4-7420-4ef9-bfcd-357cceaa4333 tempest-VolumesSnapshotTestJSON-145827129 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32c260c5-65d3-4292-be07-5296ac8138fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92083) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 05:44:21 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d37fbe-8135-4a64-b63b-b061c4947407]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:44:21 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a721d2b4-7420-4ef9-bfcd-357cceaa4333 tempest-VolumesSnapshotTestJSON-145827129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-32c260c5-65d3-4292-be07-5296ac8138fe {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:44:22 devstack sudo[98775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-32c260c5-65d3-4292-be07-5296ac8138fe Jun 17 05:44:22 devstack sudo[98775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:44:22 devstack sudo[98775]: pam_unix(sudo:session): session closed for user root Jun 17 05:44:22 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a721d2b4-7420-4ef9-bfcd-357cceaa4333 tempest-VolumesSnapshotTestJSON-145827129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-32c260c5-65d3-4292-be07-5296ac8138fe" returned: 0 in 0.776s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:44:22 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a721d2b4-7420-4ef9-bfcd-357cceaa4333 tempest-VolumesSnapshotTestJSON-145827129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-32c260c5-65d3-4292-be07-5296ac8138fe.e4d302f4-67d2-40be-b243-99f519c1a1ba {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:44:22 devstack sudo[98780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-32c260c5-65d3-4292-be07-5296ac8138fe.e4d302f4-67d2-40be-b243-99f519c1a1ba Jun 17 05:44:22 devstack sudo[98780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:44:23 devstack sudo[98780]: pam_unix(sudo:session): session closed for user root Jun 17 05:44:23 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a721d2b4-7420-4ef9-bfcd-357cceaa4333 tempest-VolumesSnapshotTestJSON-145827129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-32c260c5-65d3-4292-be07-5296ac8138fe.e4d302f4-67d2-40be-b243-99f519c1a1ba" returned: 0 in 0.968s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:44:23 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a721d2b4-7420-4ef9-bfcd-357cceaa4333 tempest-VolumesSnapshotTestJSON-145827129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-32c260c5-65d3-4292-be07-5296ac8138fe.e4d302f4-67d2-40be-b243-99f519c1a1ba {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:44:23 devstack sudo[98786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-32c260c5-65d3-4292-be07-5296ac8138fe.e4d302f4-67d2-40be-b243-99f519c1a1ba Jun 17 05:44:23 devstack sudo[98786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:44:24 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-c376d888-2466-410b-91f9-82c20528a0a4 tempest-GroupsV320Test-24301630 None] Group tempest-GroupsV320Test-Group-538852220: creating Jun 17 05:44:24 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-c376d888-2466-410b-91f9-82c20528a0a4 tempest-GroupsV320Test-24301630 None] Group tempest-GroupsV320Test-Group-538852220: created successfully Jun 17 05:44:24 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-c376d888-2466-410b-91f9-82c20528a0a4 tempest-GroupsV320Test-24301630 None] Create group completed successfully. Jun 17 05:44:24 devstack sudo[98786]: pam_unix(sudo:session): session closed for user root Jun 17 05:44:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a721d2b4-7420-4ef9-bfcd-357cceaa4333 tempest-VolumesSnapshotTestJSON-145827129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-32c260c5-65d3-4292-be07-5296ac8138fe.e4d302f4-67d2-40be-b243-99f519c1a1ba" returned: 0 in 0.852s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:44:24 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-a721d2b4-7420-4ef9-bfcd-357cceaa4333 tempest-VolumesSnapshotTestJSON-145827129 None] Lock "cinder-quobyte-e4d302f4-67d2-40be-b243-99f519c1a1ba" released by "_delete_snapshot" :: held 3.767s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:44:24 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-a721d2b4-7420-4ef9-bfcd-357cceaa4333 tempest-VolumesSnapshotTestJSON-145827129 None] Lock "cinder-quobyte-32c260c5-65d3-4292-be07-5296ac8138fe" released by "delete_snapshot" :: held 3.804s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:44:24 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-a721d2b4-7420-4ef9-bfcd-357cceaa4333 tempest-VolumesSnapshotTestJSON-145827129 None] Created reservations ['f714114b-f355-414f-b310-79fb4c52949b', 'c2bb9426-5939-46c4-8d63-2b1271e88962', '51382b10-4345-4e71-a9dc-d3d1ca2e9ced', '55ba0992-9c73-412c-a9cb-2623aff79678'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:44:24 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-a721d2b4-7420-4ef9-bfcd-357cceaa4333 tempest-VolumesSnapshotTestJSON-145827129 None] Delete snapshot completed successfully. Jun 17 05:44:24 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-a721d2b4-7420-4ef9-bfcd-357cceaa4333 tempest-VolumesSnapshotTestJSON-145827129 None] Lock "cinder-e4d302f4-67d2-40be-b243-99f519c1a1ba-delete_snapshot" released by "delete_snapshot" :: held 4.018s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:44:25 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-79a45bea-0dc9-4ca9-9f6f-590b2f6019e1 tempest-VolumesSnapshotTestJSON-145827129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:44:25 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-79a45bea-0dc9-4ca9-9f6f-590b2f6019e1 tempest-VolumesSnapshotTestJSON-145827129 None] Flow 'volume_create_manager' (307cabdf-4c5f-48cd-ba54-e4f8bb82a0a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:44:25 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-79a45bea-0dc9-4ca9-9f6f-590b2f6019e1 tempest-VolumesSnapshotTestJSON-145827129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38c9eabd-f405-41e8-92c7-737d10914c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:44:25 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-79a45bea-0dc9-4ca9-9f6f-590b2f6019e1 tempest-VolumesSnapshotTestJSON-145827129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38c9eabd-f405-41e8-92c7-737d10914c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:44:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-528836496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20775249-bfb4-4c3a-bcb1-2fe1a380159c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a25655f92b243568375cdea8e080fb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:44:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:44:26Z,use_quota=True,user_id='ed17ca0128804d5096d31ee4ed1ff51e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:44:25 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-79a45bea-0dc9-4ca9-9f6f-590b2f6019e1 tempest-VolumesSnapshotTestJSON-145827129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (947df9fc-d13b-4033-a7c6-5145fc340733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:44:25 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-79a45bea-0dc9-4ca9-9f6f-590b2f6019e1 tempest-VolumesSnapshotTestJSON-145827129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (947df9fc-d13b-4033-a7c6-5145fc340733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:44:25 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-79a45bea-0dc9-4ca9-9f6f-590b2f6019e1 tempest-VolumesSnapshotTestJSON-145827129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfed7dba-47dc-4c05-bf11-be8c43aefe33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:44:25 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-79a45bea-0dc9-4ca9-9f6f-590b2f6019e1 tempest-VolumesSnapshotTestJSON-145827129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfed7dba-47dc-4c05-bf11-be8c43aefe33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20775249-bfb4-4c3a-bcb1-2fe1a380159c', 'volume_name': 'volume-20775249-bfb4-4c3a-bcb1-2fe1a380159c', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:44:25 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-79a45bea-0dc9-4ca9-9f6f-590b2f6019e1 tempest-VolumesSnapshotTestJSON-145827129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9a232a9-ca17-4415-b7f9-6c5e8855cade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:44:25 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-79a45bea-0dc9-4ca9-9f6f-590b2f6019e1 tempest-VolumesSnapshotTestJSON-145827129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9a232a9-ca17-4415-b7f9-6c5e8855cade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:44:25 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-79a45bea-0dc9-4ca9-9f6f-590b2f6019e1 tempest-VolumesSnapshotTestJSON-145827129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (821db3da-a94e-467b-83a8-cef30ae4c947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:44:25 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-79a45bea-0dc9-4ca9-9f6f-590b2f6019e1 tempest-VolumesSnapshotTestJSON-145827129 None] Volume 20775249-bfb4-4c3a-bcb1-2fe1a380159c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20775249-bfb4-4c3a-bcb1-2fe1a380159c', 'volume_size': 1} Jun 17 05:44:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-79a45bea-0dc9-4ca9-9f6f-590b2f6019e1 tempest-VolumesSnapshotTestJSON-145827129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:44:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-79a45bea-0dc9-4ca9-9f6f-590b2f6019e1 tempest-VolumesSnapshotTestJSON-145827129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:44:25 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-79a45bea-0dc9-4ca9-9f6f-590b2f6019e1 tempest-VolumesSnapshotTestJSON-145827129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:44:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-528836496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20775249-bfb4-4c3a-bcb1-2fe1a380159c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a25655f92b243568375cdea8e080fb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:44:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:44:26Z,use_quota=True,user_id='ed17ca0128804d5096d31ee4ed1ff51e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:44:25 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-79a45bea-0dc9-4ca9-9f6f-590b2f6019e1 tempest-VolumesSnapshotTestJSON-145827129 None] Creating volume 20775249-bfb4-4c3a-bcb1-2fe1a380159c {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:44:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-79a45bea-0dc9-4ca9-9f6f-590b2f6019e1 tempest-VolumesSnapshotTestJSON-145827129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:44:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-79a45bea-0dc9-4ca9-9f6f-590b2f6019e1 tempest-VolumesSnapshotTestJSON-145827129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:44:25 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-79a45bea-0dc9-4ca9-9f6f-590b2f6019e1 tempest-VolumesSnapshotTestJSON-145827129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:44:25 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-79a45bea-0dc9-4ca9-9f6f-590b2f6019e1 tempest-VolumesSnapshotTestJSON-145827129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:44:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-79a45bea-0dc9-4ca9-9f6f-590b2f6019e1 tempest-VolumesSnapshotTestJSON-145827129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:44:25 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-79a45bea-0dc9-4ca9-9f6f-590b2f6019e1 tempest-VolumesSnapshotTestJSON-145827129 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:44:25 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-79a45bea-0dc9-4ca9-9f6f-590b2f6019e1 tempest-VolumesSnapshotTestJSON-145827129 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:44:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-79a45bea-0dc9-4ca9-9f6f-590b2f6019e1 tempest-VolumesSnapshotTestJSON-145827129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-20775249-bfb4-4c3a-bcb1-2fe1a380159c 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:44:25 devstack sudo[98842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-20775249-bfb4-4c3a-bcb1-2fe1a380159c 1073741824 Jun 17 05:44:25 devstack sudo[98842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:44:25 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-1c53678e-82eb-4814-94dc-b00894b710e3 tempest-GroupsV320Test-24301630 None] Created reservations ['999ce794-69fd-42f5-8b7f-1cad57ddf1f7'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:44:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-1c53678e-82eb-4814-94dc-b00894b710e3 tempest-GroupsV320Test-24301630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:44:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-1c53678e-82eb-4814-94dc-b00894b710e3 tempest-GroupsV320Test-24301630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:44:25 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-1c53678e-82eb-4814-94dc-b00894b710e3 tempest-GroupsV320Test-24301630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:44:25 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-1c53678e-82eb-4814-94dc-b00894b710e3 tempest-GroupsV320Test-24301630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:44:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-1c53678e-82eb-4814-94dc-b00894b710e3 tempest-GroupsV320Test-24301630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:44:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1c53678e-82eb-4814-94dc-b00894b710e3 tempest-GroupsV320Test-24301630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:44:25 devstack sudo[98844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:44:25 devstack sudo[98844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:44:26 devstack sudo[98844]: pam_unix(sudo:session): session closed for user root Jun 17 05:44:26 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1c53678e-82eb-4814-94dc-b00894b710e3 tempest-GroupsV320Test-24301630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.669s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:44:26 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-1c53678e-82eb-4814-94dc-b00894b710e3 tempest-GroupsV320Test-24301630 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:44:26 devstack sudo[98842]: pam_unix(sudo:session): session closed for user root Jun 17 05:44:26 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-1c53678e-82eb-4814-94dc-b00894b710e3 tempest-GroupsV320Test-24301630 None] Delete group completed successfully. Jun 17 05:44:26 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-79a45bea-0dc9-4ca9-9f6f-590b2f6019e1 tempest-VolumesSnapshotTestJSON-145827129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-20775249-bfb4-4c3a-bcb1-2fe1a380159c 1073741824" returned: 0 in 0.805s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:44:26 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-79a45bea-0dc9-4ca9-9f6f-590b2f6019e1 tempest-VolumesSnapshotTestJSON-145827129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-20775249-bfb4-4c3a-bcb1-2fe1a380159c {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:44:26 devstack sudo[98851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-20775249-bfb4-4c3a-bcb1-2fe1a380159c Jun 17 05:44:26 devstack sudo[98851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:44:27 devstack sudo[98851]: pam_unix(sudo:session): session closed for user root Jun 17 05:44:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-79a45bea-0dc9-4ca9-9f6f-590b2f6019e1 tempest-VolumesSnapshotTestJSON-145827129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-20775249-bfb4-4c3a-bcb1-2fe1a380159c" returned: 0 in 0.687s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:44:27 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-79a45bea-0dc9-4ca9-9f6f-590b2f6019e1 tempest-VolumesSnapshotTestJSON-145827129 None] <== create_volume: return (1549ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:44:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-79a45bea-0dc9-4ca9-9f6f-590b2f6019e1 tempest-VolumesSnapshotTestJSON-145827129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.552s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:44:27 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-79a45bea-0dc9-4ca9-9f6f-590b2f6019e1 tempest-VolumesSnapshotTestJSON-145827129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (821db3da-a94e-467b-83a8-cef30ae4c947) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20775249-bfb4-4c3a-bcb1-2fe1a380159c', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:44:27 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-79a45bea-0dc9-4ca9-9f6f-590b2f6019e1 tempest-VolumesSnapshotTestJSON-145827129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18e50430-b3b2-4120-8e62-2493bd01884c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:44:27 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-79a45bea-0dc9-4ca9-9f6f-590b2f6019e1 tempest-VolumesSnapshotTestJSON-145827129 None] Volume volume-20775249-bfb4-4c3a-bcb1-2fe1a380159c (20775249-bfb4-4c3a-bcb1-2fe1a380159c): created successfully Jun 17 05:44:27 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-79a45bea-0dc9-4ca9-9f6f-590b2f6019e1 tempest-VolumesSnapshotTestJSON-145827129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18e50430-b3b2-4120-8e62-2493bd01884c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:44:27 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-79a45bea-0dc9-4ca9-9f6f-590b2f6019e1 tempest-VolumesSnapshotTestJSON-145827129 None] Flow 'volume_create_manager' (307cabdf-4c5f-48cd-ba54-e4f8bb82a0a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:44:27 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-79a45bea-0dc9-4ca9-9f6f-590b2f6019e1 tempest-VolumesSnapshotTestJSON-145827129 None] Created volume successfully. Jun 17 05:44:27 devstack cinder-volume[92083]: DEBUG oslo_service.periodic_task [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92083) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 05:44:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:44:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:44:27 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:44:27 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:44:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:44:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:44:27 devstack sudo[98854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:44:27 devstack sudo[98854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:44:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-58815f63-469a-478a-949b-28c9678a4b10 tempest-VolumesSnapshotTestJSON-145827129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:44:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-58815f63-469a-478a-949b-28c9678a4b10 tempest-VolumesSnapshotTestJSON-145827129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:44:28 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-58815f63-469a-478a-949b-28c9678a4b10 tempest-VolumesSnapshotTestJSON-145827129 None] Creating offline snapshot 6d9d4937-ac6d-460f-ab56-eb6a441ab5ab of volume 20775249-bfb4-4c3a-bcb1-2fe1a380159c {{(pid=92083) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 17 05:44:28 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[321e0554-7fc0-4fda-b714-36378aaaad38]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:44:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-58815f63-469a-478a-949b-28c9678a4b10 tempest-VolumesSnapshotTestJSON-145827129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-20775249-bfb4-4c3a-bcb1-2fe1a380159c {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:44:28 devstack sudo[98854]: pam_unix(sudo:session): session closed for user root Jun 17 05:44:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.680s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:44:28 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:44:28 devstack sudo[98857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-20775249-bfb4-4c3a-bcb1-2fe1a380159c Jun 17 05:44:28 devstack cinder-volume[92083]: DEBUG oslo_service.periodic_task [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running periodic task VolumeManager._thread_info {{(pid=92083) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 05:44:28 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] thread count: 8 {{(pid=92083) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 17 05:44:28 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] thread info: [<_MainThread(MainThread, started 133483869905024)>, , , , , , , ] {{(pid=92083) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 17 05:44:28 devstack sudo[98857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:44:28 devstack sudo[98857]: pam_unix(sudo:session): session closed for user root Jun 17 05:44:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-58815f63-469a-478a-949b-28c9678a4b10 tempest-VolumesSnapshotTestJSON-145827129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-20775249-bfb4-4c3a-bcb1-2fe1a380159c" returned: 0 in 0.826s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:44:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-58815f63-469a-478a-949b-28c9678a4b10 tempest-VolumesSnapshotTestJSON-145827129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-20775249-bfb4-4c3a-bcb1-2fe1a380159c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-20775249-bfb4-4c3a-bcb1-2fe1a380159c.6d9d4937-ac6d-460f-ab56-eb6a441ab5ab 1G {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:44:29 devstack sudo[98864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-20775249-bfb4-4c3a-bcb1-2fe1a380159c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-20775249-bfb4-4c3a-bcb1-2fe1a380159c.6d9d4937-ac6d-460f-ab56-eb6a441ab5ab 1G Jun 17 05:44:29 devstack sudo[98864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:44:29 devstack sudo[98864]: pam_unix(sudo:session): session closed for user root Jun 17 05:44:29 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-58815f63-469a-478a-949b-28c9678a4b10 tempest-VolumesSnapshotTestJSON-145827129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-20775249-bfb4-4c3a-bcb1-2fe1a380159c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-20775249-bfb4-4c3a-bcb1-2fe1a380159c.6d9d4937-ac6d-460f-ab56-eb6a441ab5ab 1G" returned: 0 in 0.854s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:44:29 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-58815f63-469a-478a-949b-28c9678a4b10 tempest-VolumesSnapshotTestJSON-145827129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20775249-bfb4-4c3a-bcb1-2fe1a380159c -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-20775249-bfb4-4c3a-bcb1-2fe1a380159c.6d9d4937-ac6d-460f-ab56-eb6a441ab5ab {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:44:29 devstack sudo[98872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20775249-bfb4-4c3a-bcb1-2fe1a380159c -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-20775249-bfb4-4c3a-bcb1-2fe1a380159c.6d9d4937-ac6d-460f-ab56-eb6a441ab5ab Jun 17 05:44:29 devstack sudo[98872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:44:30 devstack sudo[98872]: pam_unix(sudo:session): session closed for user root Jun 17 05:44:30 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-58815f63-469a-478a-949b-28c9678a4b10 tempest-VolumesSnapshotTestJSON-145827129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20775249-bfb4-4c3a-bcb1-2fe1a380159c -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-20775249-bfb4-4c3a-bcb1-2fe1a380159c.6d9d4937-ac6d-460f-ab56-eb6a441ab5ab" returned: 0 in 0.749s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:44:30 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [None req-58815f63-469a-478a-949b-28c9678a4b10 tempest-VolumesSnapshotTestJSON-145827129 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-20775249-bfb4-4c3a-bcb1-2fe1a380159c.6d9d4937-ac6d-460f-ab56-eb6a441ab5ab is being set with open permissions: ugo+rw Jun 17 05:44:30 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-58815f63-469a-478a-949b-28c9678a4b10 tempest-VolumesSnapshotTestJSON-145827129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-20775249-bfb4-4c3a-bcb1-2fe1a380159c.6d9d4937-ac6d-460f-ab56-eb6a441ab5ab {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:44:30 devstack sudo[98878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-20775249-bfb4-4c3a-bcb1-2fe1a380159c.6d9d4937-ac6d-460f-ab56-eb6a441ab5ab Jun 17 05:44:30 devstack sudo[98878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:44:31 devstack sudo[98878]: pam_unix(sudo:session): session closed for user root Jun 17 05:44:31 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-58815f63-469a-478a-949b-28c9678a4b10 tempest-VolumesSnapshotTestJSON-145827129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-20775249-bfb4-4c3a-bcb1-2fe1a380159c.6d9d4937-ac6d-460f-ab56-eb6a441ab5ab" returned: 0 in 0.605s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:44:31 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-58815f63-469a-478a-949b-28c9678a4b10 tempest-VolumesSnapshotTestJSON-145827129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-20775249-bfb4-4c3a-bcb1-2fe1a380159c.info {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:44:31 devstack sudo[98883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-20775249-bfb4-4c3a-bcb1-2fe1a380159c.info Jun 17 05:44:31 devstack sudo[98883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:44:31 devstack sudo[98883]: pam_unix(sudo:session): session closed for user root Jun 17 05:44:31 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-58815f63-469a-478a-949b-28c9678a4b10 tempest-VolumesSnapshotTestJSON-145827129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-20775249-bfb4-4c3a-bcb1-2fe1a380159c.info" returned: 0 in 0.657s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:44:31 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [None req-58815f63-469a-478a-949b-28c9678a4b10 tempest-VolumesSnapshotTestJSON-145827129 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-20775249-bfb4-4c3a-bcb1-2fe1a380159c.info is being set with open permissions: ugo+rw Jun 17 05:44:31 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-58815f63-469a-478a-949b-28c9678a4b10 tempest-VolumesSnapshotTestJSON-145827129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-20775249-bfb4-4c3a-bcb1-2fe1a380159c.info {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:44:31 devstack sudo[98886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-20775249-bfb4-4c3a-bcb1-2fe1a380159c.info Jun 17 05:44:31 devstack sudo[98886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:44:32 devstack sudo[98886]: pam_unix(sudo:session): session closed for user root Jun 17 05:44:32 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-58815f63-469a-478a-949b-28c9678a4b10 tempest-VolumesSnapshotTestJSON-145827129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-20775249-bfb4-4c3a-bcb1-2fe1a380159c.info" returned: 0 in 0.668s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:44:32 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-58815f63-469a-478a-949b-28c9678a4b10 tempest-VolumesSnapshotTestJSON-145827129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.457s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:44:32 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-58815f63-469a-478a-949b-28c9678a4b10 tempest-VolumesSnapshotTestJSON-145827129 None] Create snapshot completed successfully Jun 17 05:44:32 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ae64782-b198-44b7-822d-1bd79c6446fd tempest-SnapshotsActionsTest-2140039854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:44:32 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-7ae64782-b198-44b7-822d-1bd79c6446fd tempest-SnapshotsActionsTest-2140039854 None] Flow 'volume_create_manager' (5f150e43-556f-4dd5-ba46-c7a90003275f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:44:32 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-7ae64782-b198-44b7-822d-1bd79c6446fd tempest-SnapshotsActionsTest-2140039854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ba4f50c-fb1c-4638-bb82-69c0aff6cddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:44:32 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-7ae64782-b198-44b7-822d-1bd79c6446fd tempest-SnapshotsActionsTest-2140039854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ba4f50c-fb1c-4638-bb82-69c0aff6cddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:44:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-57632400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35d4c519-6d52-4aab-9423-f29c54fcc9ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e86d390a85b41ae9177ddcd68ec5ac2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:44:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:44:33Z,use_quota=True,user_id='f5e4639c69fe49e9b5e6711c69b4eb9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:44:32 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-7ae64782-b198-44b7-822d-1bd79c6446fd tempest-SnapshotsActionsTest-2140039854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21249a90-6b58-4336-ab98-2bb450acf42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:44:32 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-7ae64782-b198-44b7-822d-1bd79c6446fd tempest-SnapshotsActionsTest-2140039854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21249a90-6b58-4336-ab98-2bb450acf42a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:44:32 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-7ae64782-b198-44b7-822d-1bd79c6446fd tempest-SnapshotsActionsTest-2140039854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (529fe8cc-960c-46ce-b005-af226ee08c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:44:32 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-7ae64782-b198-44b7-822d-1bd79c6446fd tempest-SnapshotsActionsTest-2140039854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (529fe8cc-960c-46ce-b005-af226ee08c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35d4c519-6d52-4aab-9423-f29c54fcc9ef', 'volume_name': 'volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:44:32 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-7ae64782-b198-44b7-822d-1bd79c6446fd tempest-SnapshotsActionsTest-2140039854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac35ac03-e169-4929-a01a-bca5173d5967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:44:32 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-7ae64782-b198-44b7-822d-1bd79c6446fd tempest-SnapshotsActionsTest-2140039854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac35ac03-e169-4929-a01a-bca5173d5967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:44:32 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-7ae64782-b198-44b7-822d-1bd79c6446fd tempest-SnapshotsActionsTest-2140039854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7369e9e2-f142-428b-b817-4540b6fa595d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:44:32 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-7ae64782-b198-44b7-822d-1bd79c6446fd tempest-SnapshotsActionsTest-2140039854 None] Volume 35d4c519-6d52-4aab-9423-f29c54fcc9ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef', 'volume_size': 1} Jun 17 05:44:32 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-7ae64782-b198-44b7-822d-1bd79c6446fd tempest-SnapshotsActionsTest-2140039854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:44:32 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-7ae64782-b198-44b7-822d-1bd79c6446fd tempest-SnapshotsActionsTest-2140039854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:44:32 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-7ae64782-b198-44b7-822d-1bd79c6446fd tempest-SnapshotsActionsTest-2140039854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:44:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-57632400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35d4c519-6d52-4aab-9423-f29c54fcc9ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e86d390a85b41ae9177ddcd68ec5ac2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:44:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:44:33Z,use_quota=True,user_id='f5e4639c69fe49e9b5e6711c69b4eb9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:44:32 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-7ae64782-b198-44b7-822d-1bd79c6446fd tempest-SnapshotsActionsTest-2140039854 None] Creating volume 35d4c519-6d52-4aab-9423-f29c54fcc9ef {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:44:32 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-7ae64782-b198-44b7-822d-1bd79c6446fd tempest-SnapshotsActionsTest-2140039854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:44:32 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-7ae64782-b198-44b7-822d-1bd79c6446fd tempest-SnapshotsActionsTest-2140039854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:44:32 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-7ae64782-b198-44b7-822d-1bd79c6446fd tempest-SnapshotsActionsTest-2140039854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:44:32 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-7ae64782-b198-44b7-822d-1bd79c6446fd tempest-SnapshotsActionsTest-2140039854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:44:32 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-7ae64782-b198-44b7-822d-1bd79c6446fd tempest-SnapshotsActionsTest-2140039854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:44:32 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-7ae64782-b198-44b7-822d-1bd79c6446fd tempest-SnapshotsActionsTest-2140039854 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:44:32 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-7ae64782-b198-44b7-822d-1bd79c6446fd tempest-SnapshotsActionsTest-2140039854 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:44:32 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-7ae64782-b198-44b7-822d-1bd79c6446fd tempest-SnapshotsActionsTest-2140039854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:44:32 devstack sudo[98889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef 1073741824 Jun 17 05:44:32 devstack sudo[98889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:44:33 devstack sudo[98889]: pam_unix(sudo:session): session closed for user root Jun 17 05:44:33 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-7ae64782-b198-44b7-822d-1bd79c6446fd tempest-SnapshotsActionsTest-2140039854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef 1073741824" returned: 0 in 0.845s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:44:33 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-7ae64782-b198-44b7-822d-1bd79c6446fd tempest-SnapshotsActionsTest-2140039854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:44:33 devstack sudo[98895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef Jun 17 05:44:33 devstack sudo[98895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:44:33 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-2aac2f6f-43d0-4f5c-85f0-53e33a6c383d tempest-VolumesSnapshotTestJSON-145827129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:44:33 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-2aac2f6f-43d0-4f5c-85f0-53e33a6c383d tempest-VolumesSnapshotTestJSON-145827129 None] Flow 'volume_create_manager' (3c56aea3-d5f5-4381-82c3-6352c2aa1ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:44:33 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-2aac2f6f-43d0-4f5c-85f0-53e33a6c383d tempest-VolumesSnapshotTestJSON-145827129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3d2880c-cb02-48e5-97c8-50d484682b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:44:33 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-2aac2f6f-43d0-4f5c-85f0-53e33a6c383d tempest-VolumesSnapshotTestJSON-145827129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3d2880c-cb02-48e5-97c8-50d484682b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:44:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1354729623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fbe041a-645b-4296-b3f1-c2ed3b9dd7e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a25655f92b243568375cdea8e080fb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:44:34Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=6d9d4937-ac6d-460f-ab56-eb6a441ab5ab,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:44:34Z,use_quota=True,user_id='ed17ca0128804d5096d31ee4ed1ff51e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:44:33 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-2aac2f6f-43d0-4f5c-85f0-53e33a6c383d tempest-VolumesSnapshotTestJSON-145827129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87c72c3d-0c64-4448-b674-35080c4cd504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:44:33 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-2aac2f6f-43d0-4f5c-85f0-53e33a6c383d tempest-VolumesSnapshotTestJSON-145827129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87c72c3d-0c64-4448-b674-35080c4cd504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:44:33 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-2aac2f6f-43d0-4f5c-85f0-53e33a6c383d tempest-VolumesSnapshotTestJSON-145827129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80b46369-f42c-4ec2-9cf7-2c8ffc086124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:44:33 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-2aac2f6f-43d0-4f5c-85f0-53e33a6c383d tempest-VolumesSnapshotTestJSON-145827129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80b46369-f42c-4ec2-9cf7-2c8ffc086124) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7fbe041a-645b-4296-b3f1-c2ed3b9dd7e8', 'volume_name': 'volume-7fbe041a-645b-4296-b3f1-c2ed3b9dd7e8', 'volume_size': 2, 'snapshot_id': '6d9d4937-ac6d-460f-ab56-eb6a441ab5ab'}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:44:34 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-2aac2f6f-43d0-4f5c-85f0-53e33a6c383d tempest-VolumesSnapshotTestJSON-145827129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2835bf0-ef7f-49bc-9979-a345d181b6a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:44:34 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-2aac2f6f-43d0-4f5c-85f0-53e33a6c383d tempest-VolumesSnapshotTestJSON-145827129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2835bf0-ef7f-49bc-9979-a345d181b6a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:44:34 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-2aac2f6f-43d0-4f5c-85f0-53e33a6c383d tempest-VolumesSnapshotTestJSON-145827129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69cf0049-a22c-4f9a-96f1-2196816941ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:44:34 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-2aac2f6f-43d0-4f5c-85f0-53e33a6c383d tempest-VolumesSnapshotTestJSON-145827129 None] Volume 7fbe041a-645b-4296-b3f1-c2ed3b9dd7e8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7fbe041a-645b-4296-b3f1-c2ed3b9dd7e8', 'volume_size': 2, 'snapshot_id': '6d9d4937-ac6d-460f-ab56-eb6a441ab5ab'} Jun 17 05:44:34 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-2aac2f6f-43d0-4f5c-85f0-53e33a6c383d tempest-VolumesSnapshotTestJSON-145827129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:44:34 devstack sudo[98895]: pam_unix(sudo:session): session closed for user root Jun 17 05:44:34 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-7ae64782-b198-44b7-822d-1bd79c6446fd tempest-SnapshotsActionsTest-2140039854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef" returned: 0 in 0.632s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:44:34 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-7ae64782-b198-44b7-822d-1bd79c6446fd tempest-SnapshotsActionsTest-2140039854 None] <== create_volume: return (1536ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:44:34 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-7ae64782-b198-44b7-822d-1bd79c6446fd tempest-SnapshotsActionsTest-2140039854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.539s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:44:34 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-2aac2f6f-43d0-4f5c-85f0-53e33a6c383d tempest-VolumesSnapshotTestJSON-145827129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.204s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:44:34 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-2aac2f6f-43d0-4f5c-85f0-53e33a6c383d tempest-VolumesSnapshotTestJSON-145827129 None] Acquiring lock "cinder-quobyte-6d9d4937-ac6d-460f-ab56-eb6a441ab5ab-7fbe041a-645b-4296-b3f1-c2ed3b9dd7e8" by "_create_volume_from_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:44:34 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-7ae64782-b198-44b7-822d-1bd79c6446fd tempest-SnapshotsActionsTest-2140039854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7369e9e2-f142-428b-b817-4540b6fa595d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:44:34 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-7ae64782-b198-44b7-822d-1bd79c6446fd tempest-SnapshotsActionsTest-2140039854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1562ad58-e753-4ad7-b9a0-34f9810120fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:44:34 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-2aac2f6f-43d0-4f5c-85f0-53e33a6c383d tempest-VolumesSnapshotTestJSON-145827129 None] Lock "cinder-quobyte-6d9d4937-ac6d-460f-ab56-eb6a441ab5ab-7fbe041a-645b-4296-b3f1-c2ed3b9dd7e8" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:44:34 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-2aac2f6f-43d0-4f5c-85f0-53e33a6c383d tempest-VolumesSnapshotTestJSON-145827129 None] Creating volume 7fbe041a-645b-4296-b3f1-c2ed3b9dd7e8 from snapshot 6d9d4937-ac6d-460f-ab56-eb6a441ab5ab {{(pid=92083) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 17 05:44:34 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-2aac2f6f-43d0-4f5c-85f0-53e33a6c383d tempest-VolumesSnapshotTestJSON-145827129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:44:34 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-2aac2f6f-43d0-4f5c-85f0-53e33a6c383d tempest-VolumesSnapshotTestJSON-145827129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:44:34 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-2aac2f6f-43d0-4f5c-85f0-53e33a6c383d tempest-VolumesSnapshotTestJSON-145827129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:44:34 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-2aac2f6f-43d0-4f5c-85f0-53e33a6c383d tempest-VolumesSnapshotTestJSON-145827129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:44:34 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-2aac2f6f-43d0-4f5c-85f0-53e33a6c383d tempest-VolumesSnapshotTestJSON-145827129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:44:34 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-2aac2f6f-43d0-4f5c-85f0-53e33a6c383d tempest-VolumesSnapshotTestJSON-145827129 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:44:34 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-2aac2f6f-43d0-4f5c-85f0-53e33a6c383d tempest-VolumesSnapshotTestJSON-145827129 None] Acquiring lock "cinder-quobyte-7fbe041a-645b-4296-b3f1-c2ed3b9dd7e8" by "_copy_volume_from_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:44:34 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-7ae64782-b198-44b7-822d-1bd79c6446fd tempest-SnapshotsActionsTest-2140039854 None] Volume volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef (35d4c519-6d52-4aab-9423-f29c54fcc9ef): created successfully Jun 17 05:44:34 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-7ae64782-b198-44b7-822d-1bd79c6446fd tempest-SnapshotsActionsTest-2140039854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1562ad58-e753-4ad7-b9a0-34f9810120fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:44:34 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-7ae64782-b198-44b7-822d-1bd79c6446fd tempest-SnapshotsActionsTest-2140039854 None] Flow 'volume_create_manager' (5f150e43-556f-4dd5-ba46-c7a90003275f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:44:34 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-2aac2f6f-43d0-4f5c-85f0-53e33a6c383d tempest-VolumesSnapshotTestJSON-145827129 None] Lock "cinder-quobyte-7fbe041a-645b-4296-b3f1-c2ed3b9dd7e8" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:44:34 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-2aac2f6f-43d0-4f5c-85f0-53e33a6c383d tempest-VolumesSnapshotTestJSON-145827129 None] snapshot: 6d9d4937-ac6d-460f-ab56-eb6a441ab5ab, volume: 7fbe041a-645b-4296-b3f1-c2ed3b9dd7e8, {{(pid=92083) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 17 05:44:34 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-7ae64782-b198-44b7-822d-1bd79c6446fd tempest-SnapshotsActionsTest-2140039854 None] Created volume successfully. Jun 17 05:44:34 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-2aac2f6f-43d0-4f5c-85f0-53e33a6c383d tempest-VolumesSnapshotTestJSON-145827129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:44:34 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-2aac2f6f-43d0-4f5c-85f0-53e33a6c383d tempest-VolumesSnapshotTestJSON-145827129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:44:34 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-2aac2f6f-43d0-4f5c-85f0-53e33a6c383d tempest-VolumesSnapshotTestJSON-145827129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:44:34 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-2aac2f6f-43d0-4f5c-85f0-53e33a6c383d tempest-VolumesSnapshotTestJSON-145827129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:44:34 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-2aac2f6f-43d0-4f5c-85f0-53e33a6c383d tempest-VolumesSnapshotTestJSON-145827129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:44:34 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c0d898-2fca-4131-ab92-15b8c9449455]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:44:34 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-2aac2f6f-43d0-4f5c-85f0-53e33a6c383d tempest-VolumesSnapshotTestJSON-145827129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-20775249-bfb4-4c3a-bcb1-2fe1a380159c.6d9d4937-ac6d-460f-ab56-eb6a441ab5ab {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:44:34 devstack sudo[98898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-20775249-bfb4-4c3a-bcb1-2fe1a380159c.6d9d4937-ac6d-460f-ab56-eb6a441ab5ab Jun 17 05:44:34 devstack sudo[98898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:44:34 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ab953543-a1c1-40b6-aa9e-bcf3e0cb4cba tempest-SnapshotsActionsTest-2140039854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:44:35 devstack sudo[98898]: pam_unix(sudo:session): session closed for user root Jun 17 05:44:35 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-2aac2f6f-43d0-4f5c-85f0-53e33a6c383d tempest-VolumesSnapshotTestJSON-145827129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-20775249-bfb4-4c3a-bcb1-2fe1a380159c.6d9d4937-ac6d-460f-ab56-eb6a441ab5ab" returned: 0 in 0.870s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:44:35 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-2aac2f6f-43d0-4f5c-85f0-53e33a6c383d tempest-VolumesSnapshotTestJSON-145827129 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20775249-bfb4-4c3a-bcb1-2fe1a380159c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92083) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 05:44:35 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-2aac2f6f-43d0-4f5c-85f0-53e33a6c383d tempest-VolumesSnapshotTestJSON-145827129 None] will copy from snapshot at /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-20775249-bfb4-4c3a-bcb1-2fe1a380159c {{(pid=92083) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 17 05:44:35 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-2aac2f6f-43d0-4f5c-85f0-53e33a6c383d tempest-VolumesSnapshotTestJSON-145827129 None] Creating direct copy from snapshot {{(pid=92083) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 17 05:44:35 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[44cad80b-1a7c-479e-afa3-03d5d115a6bd]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:44:35 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-2aac2f6f-43d0-4f5c-85f0-53e33a6c383d tempest-VolumesSnapshotTestJSON-145827129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-20775249-bfb4-4c3a-bcb1-2fe1a380159c {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:44:35 devstack sudo[98905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-20775249-bfb4-4c3a-bcb1-2fe1a380159c Jun 17 05:44:35 devstack sudo[98905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:44:35 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-1734308c-0c69-44e0-bfcd-d65d29ddd264 tempest-AttachVolumeShelveTestJSON-18917466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:44:35 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1734308c-0c69-44e0-bfcd-d65d29ddd264 tempest-AttachVolumeShelveTestJSON-18917466 None] Flow 'volume_create_manager' (080cad96-0d9d-4216-8ea3-536fefccd848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:44:35 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1734308c-0c69-44e0-bfcd-d65d29ddd264 tempest-AttachVolumeShelveTestJSON-18917466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88831f9d-b190-4cff-bf84-c4b8251ef039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:44:35 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1734308c-0c69-44e0-bfcd-d65d29ddd264 tempest-AttachVolumeShelveTestJSON-18917466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88831f9d-b190-4cff-bf84-c4b8251ef039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:44:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-8131308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4578d47f-5034-4726-bf92-cd551c4b7ee0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93ca4f29b39d454f99f68638ab30a62e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:44:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:44:36Z,use_quota=True,user_id='04ec6a2cee2a4296b212ab142a01446d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:44:35 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1734308c-0c69-44e0-bfcd-d65d29ddd264 tempest-AttachVolumeShelveTestJSON-18917466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09113627-c7d4-496e-8d68-2367e3eabb41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:44:35 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1734308c-0c69-44e0-bfcd-d65d29ddd264 tempest-AttachVolumeShelveTestJSON-18917466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09113627-c7d4-496e-8d68-2367e3eabb41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:44:35 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1734308c-0c69-44e0-bfcd-d65d29ddd264 tempest-AttachVolumeShelveTestJSON-18917466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c33bbe5-6b24-4f08-afc2-388127e4f294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:44:35 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1734308c-0c69-44e0-bfcd-d65d29ddd264 tempest-AttachVolumeShelveTestJSON-18917466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c33bbe5-6b24-4f08-afc2-388127e4f294) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4578d47f-5034-4726-bf92-cd551c4b7ee0', 'volume_name': 'volume-4578d47f-5034-4726-bf92-cd551c4b7ee0', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:44:35 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1734308c-0c69-44e0-bfcd-d65d29ddd264 tempest-AttachVolumeShelveTestJSON-18917466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78af2cfe-b982-4336-8be8-9e7b3e4e3047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:44:35 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1734308c-0c69-44e0-bfcd-d65d29ddd264 tempest-AttachVolumeShelveTestJSON-18917466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78af2cfe-b982-4336-8be8-9e7b3e4e3047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:44:35 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1734308c-0c69-44e0-bfcd-d65d29ddd264 tempest-AttachVolumeShelveTestJSON-18917466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05289e87-b64e-4912-9c9f-c3b7efe76ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:44:35 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-1734308c-0c69-44e0-bfcd-d65d29ddd264 tempest-AttachVolumeShelveTestJSON-18917466 None] Volume 4578d47f-5034-4726-bf92-cd551c4b7ee0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4578d47f-5034-4726-bf92-cd551c4b7ee0', 'volume_size': 1} Jun 17 05:44:35 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-1734308c-0c69-44e0-bfcd-d65d29ddd264 tempest-AttachVolumeShelveTestJSON-18917466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:44:36 devstack sudo[98905]: pam_unix(sudo:session): session closed for user root Jun 17 05:44:36 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-2aac2f6f-43d0-4f5c-85f0-53e33a6c383d tempest-VolumesSnapshotTestJSON-145827129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-20775249-bfb4-4c3a-bcb1-2fe1a380159c" returned: 0 in 0.847s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:44:36 devstack cinder-volume[92083]: DEBUG cinder.utils [None req-2aac2f6f-43d0-4f5c-85f0-53e33a6c383d tempest-VolumesSnapshotTestJSON-145827129 None] Path /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7fbe041a-645b-4296-b3f1-c2ed3b9dd7e8 not found in is_blk_device check {{(pid=92083) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 17 05:44:36 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-2aac2f6f-43d0-4f5c-85f0-53e33a6c383d tempest-VolumesSnapshotTestJSON-145827129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-20775249-bfb4-4c3a-bcb1-2fe1a380159c /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7fbe041a-645b-4296-b3f1-c2ed3b9dd7e8 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:44:36 devstack sudo[98910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-20775249-bfb4-4c3a-bcb1-2fe1a380159c /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7fbe041a-645b-4296-b3f1-c2ed3b9dd7e8 Jun 17 05:44:36 devstack sudo[98910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:44:41 devstack sudo[98910]: pam_unix(sudo:session): session closed for user root Jun 17 05:44:41 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-2aac2f6f-43d0-4f5c-85f0-53e33a6c383d tempest-VolumesSnapshotTestJSON-145827129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-20775249-bfb4-4c3a-bcb1-2fe1a380159c /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7fbe041a-645b-4296-b3f1-c2ed3b9dd7e8" returned: 0 in 5.037s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:44:41 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[547ebec6-df8f-43ba-8a7f-1b9d7867902f]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:44:41 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-2aac2f6f-43d0-4f5c-85f0-53e33a6c383d tempest-VolumesSnapshotTestJSON-145827129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-20775249-bfb4-4c3a-bcb1-2fe1a380159c {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:44:41 devstack sudo[98944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-20775249-bfb4-4c3a-bcb1-2fe1a380159c Jun 17 05:44:41 devstack sudo[98944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:44:42 devstack sudo[98944]: pam_unix(sudo:session): session closed for user root Jun 17 05:44:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-2aac2f6f-43d0-4f5c-85f0-53e33a6c383d tempest-VolumesSnapshotTestJSON-145827129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-20775249-bfb4-4c3a-bcb1-2fe1a380159c" returned: 0 in 1.015s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:44:42 devstack cinder-volume[92083]: DEBUG cinder.image.image_utils [None req-2aac2f6f-43d0-4f5c-85f0-53e33a6c383d tempest-VolumesSnapshotTestJSON-145827129 None] Image conversion details: src /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-20775249-bfb4-4c3a-bcb1-2fe1a380159c, size 1024.00 MB, duration 5.04 sec, destination /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7fbe041a-645b-4296-b3f1-c2ed3b9dd7e8 {{(pid=92083) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 17 05:44:42 devstack cinder-volume[92083]: INFO cinder.image.image_utils [None req-2aac2f6f-43d0-4f5c-85f0-53e33a6c383d tempest-VolumesSnapshotTestJSON-145827129 None] Converted 1024.00 MB image at 203.23 MB/s Jun 17 05:44:42 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [None req-2aac2f6f-43d0-4f5c-85f0-53e33a6c383d tempest-VolumesSnapshotTestJSON-145827129 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7fbe041a-645b-4296-b3f1-c2ed3b9dd7e8 is being set with open permissions: ugo+rw Jun 17 05:44:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-2aac2f6f-43d0-4f5c-85f0-53e33a6c383d tempest-VolumesSnapshotTestJSON-145827129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7fbe041a-645b-4296-b3f1-c2ed3b9dd7e8 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:44:42 devstack sudo[98998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7fbe041a-645b-4296-b3f1-c2ed3b9dd7e8 Jun 17 05:44:42 devstack sudo[98998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:44:42 devstack sudo[98998]: pam_unix(sudo:session): session closed for user root Jun 17 05:44:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-2aac2f6f-43d0-4f5c-85f0-53e33a6c383d tempest-VolumesSnapshotTestJSON-145827129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7fbe041a-645b-4296-b3f1-c2ed3b9dd7e8" returned: 0 in 0.771s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:44:42 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-2aac2f6f-43d0-4f5c-85f0-53e33a6c383d tempest-VolumesSnapshotTestJSON-145827129 None] Lock "cinder-quobyte-7fbe041a-645b-4296-b3f1-c2ed3b9dd7e8" released by "_copy_volume_from_snapshot" :: held 8.662s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:44:42 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-2aac2f6f-43d0-4f5c-85f0-53e33a6c383d tempest-VolumesSnapshotTestJSON-145827129 None] Lock "cinder-quobyte-6d9d4937-ac6d-460f-ab56-eb6a441ab5ab-7fbe041a-645b-4296-b3f1-c2ed3b9dd7e8" released by "_create_volume_from_snapshot" :: held 8.704s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:44:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-2aac2f6f-43d0-4f5c-85f0-53e33a6c383d tempest-VolumesSnapshotTestJSON-145827129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.730s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:44:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ab953543-a1c1-40b6-aa9e-bcf3e0cb4cba tempest-SnapshotsActionsTest-2140039854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.021s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:44:43 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-ab953543-a1c1-40b6-aa9e-bcf3e0cb4cba tempest-SnapshotsActionsTest-2140039854 None] Creating offline snapshot 2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd of volume 35d4c519-6d52-4aab-9423-f29c54fcc9ef {{(pid=92083) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 17 05:44:43 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-2aac2f6f-43d0-4f5c-85f0-53e33a6c383d tempest-VolumesSnapshotTestJSON-145827129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69cf0049-a22c-4f9a-96f1-2196816941ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fbe041a-645b-4296-b3f1-c2ed3b9dd7e8', 'volume_size': 2, 'snapshot_id': '6d9d4937-ac6d-460f-ab56-eb6a441ab5ab'}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:44:43 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-2aac2f6f-43d0-4f5c-85f0-53e33a6c383d tempest-VolumesSnapshotTestJSON-145827129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34d82a72-e09a-442d-b717-855dfaf0840b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:44:43 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6e9156-bf11-4988-98ea-aa655b0cea3f]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:44:43 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ab953543-a1c1-40b6-aa9e-bcf3e0cb4cba tempest-SnapshotsActionsTest-2140039854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:44:43 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-2aac2f6f-43d0-4f5c-85f0-53e33a6c383d tempest-VolumesSnapshotTestJSON-145827129 None] Volume volume-7fbe041a-645b-4296-b3f1-c2ed3b9dd7e8 (7fbe041a-645b-4296-b3f1-c2ed3b9dd7e8): created successfully Jun 17 05:44:43 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-2aac2f6f-43d0-4f5c-85f0-53e33a6c383d tempest-VolumesSnapshotTestJSON-145827129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34d82a72-e09a-442d-b717-855dfaf0840b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:44:43 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-2aac2f6f-43d0-4f5c-85f0-53e33a6c383d tempest-VolumesSnapshotTestJSON-145827129 None] Flow 'volume_create_manager' (3c56aea3-d5f5-4381-82c3-6352c2aa1ef5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:44:43 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-2aac2f6f-43d0-4f5c-85f0-53e33a6c383d tempest-VolumesSnapshotTestJSON-145827129 None] Created volume successfully. Jun 17 05:44:43 devstack sudo[99014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef Jun 17 05:44:43 devstack sudo[99014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:44:43 devstack sudo[99014]: pam_unix(sudo:session): session closed for user root Jun 17 05:44:43 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ab953543-a1c1-40b6-aa9e-bcf3e0cb4cba tempest-SnapshotsActionsTest-2140039854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef" returned: 0 in 0.771s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:44:43 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ab953543-a1c1-40b6-aa9e-bcf3e0cb4cba tempest-SnapshotsActionsTest-2140039854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd 1G {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:44:43 devstack sudo[99020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd 1G Jun 17 05:44:43 devstack sudo[99020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:44:43 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-0801b30f-4347-44fe-8587-6a406220019b tempest-VolumesSnapshotTestJSON-145827129 None] Acquiring lock "cinder-7fbe041a-645b-4296-b3f1-c2ed3b9dd7e8-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:44:44 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-0801b30f-4347-44fe-8587-6a406220019b tempest-VolumesSnapshotTestJSON-145827129 None] Lock "cinder-7fbe041a-645b-4296-b3f1-c2ed3b9dd7e8-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:44:44 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-0801b30f-4347-44fe-8587-6a406220019b tempest-VolumesSnapshotTestJSON-145827129 None] Acquiring lock "cinder-quobyte-7fbe041a-645b-4296-b3f1-c2ed3b9dd7e8" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:44:44 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-0801b30f-4347-44fe-8587-6a406220019b tempest-VolumesSnapshotTestJSON-145827129 None] Lock "cinder-quobyte-7fbe041a-645b-4296-b3f1-c2ed3b9dd7e8" acquired by "delete_volume" :: waited 0.022s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:44:44 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d507419-3edf-4ba6-9a9f-6f45da186ae5]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:44:44 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0801b30f-4347-44fe-8587-6a406220019b tempest-VolumesSnapshotTestJSON-145827129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7fbe041a-645b-4296-b3f1-c2ed3b9dd7e8 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:44:44 devstack sudo[99022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7fbe041a-645b-4296-b3f1-c2ed3b9dd7e8 Jun 17 05:44:44 devstack sudo[99022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:44:44 devstack sudo[99020]: pam_unix(sudo:session): session closed for user root Jun 17 05:44:44 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ab953543-a1c1-40b6-aa9e-bcf3e0cb4cba tempest-SnapshotsActionsTest-2140039854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd 1G" returned: 0 in 1.164s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:44:44 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ab953543-a1c1-40b6-aa9e-bcf3e0cb4cba tempest-SnapshotsActionsTest-2140039854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:44:45 devstack sudo[99030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd Jun 17 05:44:45 devstack sudo[99030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:44:45 devstack sudo[99022]: pam_unix(sudo:session): session closed for user root Jun 17 05:44:45 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0801b30f-4347-44fe-8587-6a406220019b tempest-VolumesSnapshotTestJSON-145827129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7fbe041a-645b-4296-b3f1-c2ed3b9dd7e8" returned: 0 in 0.989s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:44:45 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0801b30f-4347-44fe-8587-6a406220019b tempest-VolumesSnapshotTestJSON-145827129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7fbe041a-645b-4296-b3f1-c2ed3b9dd7e8 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:44:45 devstack sudo[99033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7fbe041a-645b-4296-b3f1-c2ed3b9dd7e8 Jun 17 05:44:45 devstack sudo[99033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:44:45 devstack sudo[99030]: pam_unix(sudo:session): session closed for user root Jun 17 05:44:45 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ab953543-a1c1-40b6-aa9e-bcf3e0cb4cba tempest-SnapshotsActionsTest-2140039854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd" returned: 0 in 0.851s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:44:45 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [None req-ab953543-a1c1-40b6-aa9e-bcf3e0cb4cba tempest-SnapshotsActionsTest-2140039854 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd is being set with open permissions: ugo+rw Jun 17 05:44:45 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ab953543-a1c1-40b6-aa9e-bcf3e0cb4cba tempest-SnapshotsActionsTest-2140039854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:44:45 devstack sudo[99040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd Jun 17 05:44:45 devstack sudo[99040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:44:45 devstack sudo[99033]: pam_unix(sudo:session): session closed for user root Jun 17 05:44:45 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0801b30f-4347-44fe-8587-6a406220019b tempest-VolumesSnapshotTestJSON-145827129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7fbe041a-645b-4296-b3f1-c2ed3b9dd7e8" returned: 0 in 0.783s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:44:45 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-0801b30f-4347-44fe-8587-6a406220019b tempest-VolumesSnapshotTestJSON-145827129 None] Lock "cinder-quobyte-7fbe041a-645b-4296-b3f1-c2ed3b9dd7e8" released by "delete_volume" :: held 1.850s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:44:46 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-0801b30f-4347-44fe-8587-6a406220019b tempest-VolumesSnapshotTestJSON-145827129 None] Created reservations ['8be5d388-d040-4395-912c-e6710141bbdf', 'ad37a38a-c2f0-41a3-b6f4-0b3b6f72f3fd', '4a1a522d-14a7-431b-b35d-1a9d64d19c10', 'abc36193-a82c-400b-b137-217bd00058a9'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:44:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-0801b30f-4347-44fe-8587-6a406220019b tempest-VolumesSnapshotTestJSON-145827129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:44:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-0801b30f-4347-44fe-8587-6a406220019b tempest-VolumesSnapshotTestJSON-145827129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:44:46 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-0801b30f-4347-44fe-8587-6a406220019b tempest-VolumesSnapshotTestJSON-145827129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:44:46 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-0801b30f-4347-44fe-8587-6a406220019b tempest-VolumesSnapshotTestJSON-145827129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:44:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-0801b30f-4347-44fe-8587-6a406220019b tempest-VolumesSnapshotTestJSON-145827129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:44:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0801b30f-4347-44fe-8587-6a406220019b tempest-VolumesSnapshotTestJSON-145827129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:44:46 devstack sudo[99046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:44:46 devstack sudo[99046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:44:46 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-838e1abf-d5d5-40eb-925e-1e08f1610ae3 tempest-VolumesSnapshotTestJSON-145827129 None] Acquiring lock "cinder-6d9d4937-ac6d-460f-ab56-eb6a441ab5ab-delete_snapshot" by "delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:44:46 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-838e1abf-d5d5-40eb-925e-1e08f1610ae3 tempest-VolumesSnapshotTestJSON-145827129 None] Lock "cinder-6d9d4937-ac6d-460f-ab56-eb6a441ab5ab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:44:46 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-838e1abf-d5d5-40eb-925e-1e08f1610ae3 tempest-VolumesSnapshotTestJSON-145827129 None] Acquiring lock "cinder-quobyte-20775249-bfb4-4c3a-bcb1-2fe1a380159c" by "delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:44:46 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-838e1abf-d5d5-40eb-925e-1e08f1610ae3 tempest-VolumesSnapshotTestJSON-145827129 None] Lock "cinder-quobyte-20775249-bfb4-4c3a-bcb1-2fe1a380159c" acquired by "delete_snapshot" :: waited 0.034s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:44:46 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-838e1abf-d5d5-40eb-925e-1e08f1610ae3 tempest-VolumesSnapshotTestJSON-145827129 None] Acquiring lock "cinder-quobyte-6d9d4937-ac6d-460f-ab56-eb6a441ab5ab" by "_delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:44:46 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-838e1abf-d5d5-40eb-925e-1e08f1610ae3 tempest-VolumesSnapshotTestJSON-145827129 None] Lock "cinder-quobyte-6d9d4937-ac6d-460f-ab56-eb6a441ab5ab" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:44:46 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-838e1abf-d5d5-40eb-925e-1e08f1610ae3 tempest-VolumesSnapshotTestJSON-145827129 None] Deleting offline snapshot 6d9d4937-ac6d-460f-ab56-eb6a441ab5ab of volume 20775249-bfb4-4c3a-bcb1-2fe1a380159c {{(pid=92083) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 17 05:44:46 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-838e1abf-d5d5-40eb-925e-1e08f1610ae3 tempest-VolumesSnapshotTestJSON-145827129 None] snapshot_file for this snap is: volume-20775249-bfb4-4c3a-bcb1-2fe1a380159c.6d9d4937-ac6d-460f-ab56-eb6a441ab5ab {{(pid=92083) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 17 05:44:46 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f91965-f643-4d8a-b357-e1d4daf8f76f]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:44:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-838e1abf-d5d5-40eb-925e-1e08f1610ae3 tempest-VolumesSnapshotTestJSON-145827129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-20775249-bfb4-4c3a-bcb1-2fe1a380159c.6d9d4937-ac6d-460f-ab56-eb6a441ab5ab {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:44:46 devstack sudo[99040]: pam_unix(sudo:session): session closed for user root Jun 17 05:44:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ab953543-a1c1-40b6-aa9e-bcf3e0cb4cba tempest-SnapshotsActionsTest-2140039854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd" returned: 0 in 1.057s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:44:46 devstack sudo[99061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-20775249-bfb4-4c3a-bcb1-2fe1a380159c.6d9d4937-ac6d-460f-ab56-eb6a441ab5ab Jun 17 05:44:46 devstack sudo[99061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:44:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ab953543-a1c1-40b6-aa9e-bcf3e0cb4cba tempest-SnapshotsActionsTest-2140039854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.info {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:44:47 devstack sudo[99064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.info Jun 17 05:44:47 devstack sudo[99064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:44:47 devstack sudo[99046]: pam_unix(sudo:session): session closed for user root Jun 17 05:44:47 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0801b30f-4347-44fe-8587-6a406220019b tempest-VolumesSnapshotTestJSON-145827129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.909s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:44:47 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-0801b30f-4347-44fe-8587-6a406220019b tempest-VolumesSnapshotTestJSON-145827129 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:44:47 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-0801b30f-4347-44fe-8587-6a406220019b tempest-VolumesSnapshotTestJSON-145827129 None] Deleted volume successfully. Jun 17 05:44:47 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-0801b30f-4347-44fe-8587-6a406220019b tempest-VolumesSnapshotTestJSON-145827129 None] Lock "cinder-7fbe041a-645b-4296-b3f1-c2ed3b9dd7e8-delete_volume" released by "delete_volume" :: held 3.140s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:44:48 devstack sudo[99061]: pam_unix(sudo:session): session closed for user root Jun 17 05:44:48 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-838e1abf-d5d5-40eb-925e-1e08f1610ae3 tempest-VolumesSnapshotTestJSON-145827129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-20775249-bfb4-4c3a-bcb1-2fe1a380159c.6d9d4937-ac6d-460f-ab56-eb6a441ab5ab" returned: 0 in 1.255s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:44:48 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-838e1abf-d5d5-40eb-925e-1e08f1610ae3 tempest-VolumesSnapshotTestJSON-145827129 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20775249-bfb4-4c3a-bcb1-2fe1a380159c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92083) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 05:44:48 devstack sudo[99064]: pam_unix(sudo:session): session closed for user root Jun 17 05:44:48 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ab953543-a1c1-40b6-aa9e-bcf3e0cb4cba tempest-SnapshotsActionsTest-2140039854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.info" returned: 0 in 1.096s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:44:48 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [None req-ab953543-a1c1-40b6-aa9e-bcf3e0cb4cba tempest-SnapshotsActionsTest-2140039854 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.info is being set with open permissions: ugo+rw Jun 17 05:44:48 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ab953543-a1c1-40b6-aa9e-bcf3e0cb4cba tempest-SnapshotsActionsTest-2140039854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.info {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:44:48 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[23861e39-c92d-4669-b5cb-0f877f0c326a]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:44:48 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-838e1abf-d5d5-40eb-925e-1e08f1610ae3 tempest-VolumesSnapshotTestJSON-145827129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-20775249-bfb4-4c3a-bcb1-2fe1a380159c {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:44:48 devstack sudo[99073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.info Jun 17 05:44:48 devstack sudo[99073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:44:48 devstack sudo[99074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-20775249-bfb4-4c3a-bcb1-2fe1a380159c Jun 17 05:44:48 devstack sudo[99074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:44:48 devstack sudo[99073]: pam_unix(sudo:session): session closed for user root Jun 17 05:44:48 devstack sudo[99074]: pam_unix(sudo:session): session closed for user root Jun 17 05:44:48 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ab953543-a1c1-40b6-aa9e-bcf3e0cb4cba tempest-SnapshotsActionsTest-2140039854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.info" returned: 0 in 0.765s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:44:48 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ab953543-a1c1-40b6-aa9e-bcf3e0cb4cba tempest-SnapshotsActionsTest-2140039854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.862s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:44:48 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-1734308c-0c69-44e0-bfcd-d65d29ddd264 tempest-AttachVolumeShelveTestJSON-18917466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.058s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:44:48 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-1734308c-0c69-44e0-bfcd-d65d29ddd264 tempest-AttachVolumeShelveTestJSON-18917466 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:44:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-8131308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4578d47f-5034-4726-bf92-cd551c4b7ee0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93ca4f29b39d454f99f68638ab30a62e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:44:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:44:36Z,use_quota=True,user_id='04ec6a2cee2a4296b212ab142a01446d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:44:48 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-1734308c-0c69-44e0-bfcd-d65d29ddd264 tempest-AttachVolumeShelveTestJSON-18917466 None] Creating volume 4578d47f-5034-4726-bf92-cd551c4b7ee0 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:44:48 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-1734308c-0c69-44e0-bfcd-d65d29ddd264 tempest-AttachVolumeShelveTestJSON-18917466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:44:48 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-1734308c-0c69-44e0-bfcd-d65d29ddd264 tempest-AttachVolumeShelveTestJSON-18917466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:44:48 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-1734308c-0c69-44e0-bfcd-d65d29ddd264 tempest-AttachVolumeShelveTestJSON-18917466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:44:48 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-1734308c-0c69-44e0-bfcd-d65d29ddd264 tempest-AttachVolumeShelveTestJSON-18917466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:44:48 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-1734308c-0c69-44e0-bfcd-d65d29ddd264 tempest-AttachVolumeShelveTestJSON-18917466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:44:48 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-1734308c-0c69-44e0-bfcd-d65d29ddd264 tempest-AttachVolumeShelveTestJSON-18917466 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:44:48 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-1734308c-0c69-44e0-bfcd-d65d29ddd264 tempest-AttachVolumeShelveTestJSON-18917466 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:44:48 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1734308c-0c69-44e0-bfcd-d65d29ddd264 tempest-AttachVolumeShelveTestJSON-18917466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4578d47f-5034-4726-bf92-cd551c4b7ee0 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:44:48 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-838e1abf-d5d5-40eb-925e-1e08f1610ae3 tempest-VolumesSnapshotTestJSON-145827129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-20775249-bfb4-4c3a-bcb1-2fe1a380159c" returned: 0 in 0.799s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:44:48 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-838e1abf-d5d5-40eb-925e-1e08f1610ae3 tempest-VolumesSnapshotTestJSON-145827129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-20775249-bfb4-4c3a-bcb1-2fe1a380159c.6d9d4937-ac6d-460f-ab56-eb6a441ab5ab {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:44:48 devstack sudo[99082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4578d47f-5034-4726-bf92-cd551c4b7ee0 1073741824 Jun 17 05:44:48 devstack sudo[99082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:44:48 devstack sudo[99083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-20775249-bfb4-4c3a-bcb1-2fe1a380159c.6d9d4937-ac6d-460f-ab56-eb6a441ab5ab Jun 17 05:44:48 devstack sudo[99083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:44:48 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-ab953543-a1c1-40b6-aa9e-bcf3e0cb4cba tempest-SnapshotsActionsTest-2140039854 None] Create snapshot completed successfully Jun 17 05:44:49 devstack sudo[99083]: pam_unix(sudo:session): session closed for user root Jun 17 05:44:49 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-838e1abf-d5d5-40eb-925e-1e08f1610ae3 tempest-VolumesSnapshotTestJSON-145827129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-20775249-bfb4-4c3a-bcb1-2fe1a380159c.6d9d4937-ac6d-460f-ab56-eb6a441ab5ab" returned: 0 in 0.846s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:44:49 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-838e1abf-d5d5-40eb-925e-1e08f1610ae3 tempest-VolumesSnapshotTestJSON-145827129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-20775249-bfb4-4c3a-bcb1-2fe1a380159c.6d9d4937-ac6d-460f-ab56-eb6a441ab5ab {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:44:49 devstack sudo[99094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-20775249-bfb4-4c3a-bcb1-2fe1a380159c.6d9d4937-ac6d-460f-ab56-eb6a441ab5ab Jun 17 05:44:49 devstack sudo[99094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:44:49 devstack sudo[99082]: pam_unix(sudo:session): session closed for user root Jun 17 05:44:49 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1734308c-0c69-44e0-bfcd-d65d29ddd264 tempest-AttachVolumeShelveTestJSON-18917466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4578d47f-5034-4726-bf92-cd551c4b7ee0 1073741824" returned: 0 in 0.964s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:44:49 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1734308c-0c69-44e0-bfcd-d65d29ddd264 tempest-AttachVolumeShelveTestJSON-18917466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4578d47f-5034-4726-bf92-cd551c4b7ee0 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:44:49 devstack sudo[99096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4578d47f-5034-4726-bf92-cd551c4b7ee0 Jun 17 05:44:49 devstack sudo[99096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:44:50 devstack sudo[99094]: pam_unix(sudo:session): session closed for user root Jun 17 05:44:50 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-838e1abf-d5d5-40eb-925e-1e08f1610ae3 tempest-VolumesSnapshotTestJSON-145827129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-20775249-bfb4-4c3a-bcb1-2fe1a380159c.6d9d4937-ac6d-460f-ab56-eb6a441ab5ab" returned: 0 in 0.746s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:44:50 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-838e1abf-d5d5-40eb-925e-1e08f1610ae3 tempest-VolumesSnapshotTestJSON-145827129 None] Lock "cinder-quobyte-6d9d4937-ac6d-460f-ab56-eb6a441ab5ab" released by "_delete_snapshot" :: held 3.904s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:44:50 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-838e1abf-d5d5-40eb-925e-1e08f1610ae3 tempest-VolumesSnapshotTestJSON-145827129 None] Lock "cinder-quobyte-20775249-bfb4-4c3a-bcb1-2fe1a380159c" released by "delete_snapshot" :: held 3.960s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:44:50 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-81079718-199a-41ca-8b96-bec1a40ca506 tempest-SnapshotsActionsTest-2140039854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:44:50 devstack sudo[99096]: pam_unix(sudo:session): session closed for user root Jun 17 05:44:50 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1734308c-0c69-44e0-bfcd-d65d29ddd264 tempest-AttachVolumeShelveTestJSON-18917466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4578d47f-5034-4726-bf92-cd551c4b7ee0" returned: 0 in 0.735s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:44:50 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-1734308c-0c69-44e0-bfcd-d65d29ddd264 tempest-AttachVolumeShelveTestJSON-18917466 None] <== create_volume: return (1757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:44:50 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-1734308c-0c69-44e0-bfcd-d65d29ddd264 tempest-AttachVolumeShelveTestJSON-18917466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.761s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:44:50 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-81079718-199a-41ca-8b96-bec1a40ca506 tempest-SnapshotsActionsTest-2140039854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.030s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:44:50 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-81079718-199a-41ca-8b96-bec1a40ca506 tempest-SnapshotsActionsTest-2140039854 None] Creating offline snapshot dd25fcab-d29f-44dc-b5a0-e4ab40f87851 of volume 35d4c519-6d52-4aab-9423-f29c54fcc9ef {{(pid=92083) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 17 05:44:50 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1734308c-0c69-44e0-bfcd-d65d29ddd264 tempest-AttachVolumeShelveTestJSON-18917466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05289e87-b64e-4912-9c9f-c3b7efe76ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4578d47f-5034-4726-bf92-cd551c4b7ee0', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:44:50 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1734308c-0c69-44e0-bfcd-d65d29ddd264 tempest-AttachVolumeShelveTestJSON-18917466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2b1912b-a5c6-4cf4-87ad-b55907b79fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:44:50 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[6855dc82-484f-441c-9e34-1ed4f10a6d25]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:44:50 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-81079718-199a-41ca-8b96-bec1a40ca506 tempest-SnapshotsActionsTest-2140039854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:44:50 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-838e1abf-d5d5-40eb-925e-1e08f1610ae3 tempest-VolumesSnapshotTestJSON-145827129 None] Created reservations ['2c0b29a2-2947-431b-b724-5a4bedac3f62', 'c4602b11-9fc4-437c-963b-12b539e6ea96', 'e97073c7-ecc2-4853-98de-55d6627238e8', '107af417-6acc-4cf4-b36e-fc3cfca6a96e'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:44:50 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-1734308c-0c69-44e0-bfcd-d65d29ddd264 tempest-AttachVolumeShelveTestJSON-18917466 None] Volume volume-4578d47f-5034-4726-bf92-cd551c4b7ee0 (4578d47f-5034-4726-bf92-cd551c4b7ee0): created successfully Jun 17 05:44:50 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1734308c-0c69-44e0-bfcd-d65d29ddd264 tempest-AttachVolumeShelveTestJSON-18917466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2b1912b-a5c6-4cf4-87ad-b55907b79fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:44:50 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1734308c-0c69-44e0-bfcd-d65d29ddd264 tempest-AttachVolumeShelveTestJSON-18917466 None] Flow 'volume_create_manager' (080cad96-0d9d-4216-8ea3-536fefccd848) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:44:50 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-1734308c-0c69-44e0-bfcd-d65d29ddd264 tempest-AttachVolumeShelveTestJSON-18917466 None] Created volume successfully. Jun 17 05:44:50 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-838e1abf-d5d5-40eb-925e-1e08f1610ae3 tempest-VolumesSnapshotTestJSON-145827129 None] Delete snapshot completed successfully. Jun 17 05:44:50 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-838e1abf-d5d5-40eb-925e-1e08f1610ae3 tempest-VolumesSnapshotTestJSON-145827129 None] Lock "cinder-6d9d4937-ac6d-460f-ab56-eb6a441ab5ab-delete_snapshot" released by "delete_snapshot" :: held 4.257s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:44:50 devstack sudo[99100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd Jun 17 05:44:50 devstack sudo[99100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:44:51 devstack sudo[99100]: pam_unix(sudo:session): session closed for user root Jun 17 05:44:51 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-81079718-199a-41ca-8b96-bec1a40ca506 tempest-SnapshotsActionsTest-2140039854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd" returned: 0 in 0.802s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:44:51 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-81079718-199a-41ca-8b96-bec1a40ca506 tempest-SnapshotsActionsTest-2140039854 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92083) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 05:44:51 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-81079718-199a-41ca-8b96-bec1a40ca506 tempest-SnapshotsActionsTest-2140039854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.dd25fcab-d29f-44dc-b5a0-e4ab40f87851 1G {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:44:51 devstack sudo[99109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.dd25fcab-d29f-44dc-b5a0-e4ab40f87851 1G Jun 17 05:44:51 devstack sudo[99109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:44:51 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-21018dbb-2e77-4c8d-8975-e4488ae42d52 tempest-VolumesSnapshotTestJSON-145827129 None] Acquiring lock "cinder-20775249-bfb4-4c3a-bcb1-2fe1a380159c-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:44:51 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-21018dbb-2e77-4c8d-8975-e4488ae42d52 tempest-VolumesSnapshotTestJSON-145827129 None] Lock "cinder-20775249-bfb4-4c3a-bcb1-2fe1a380159c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:44:52 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-21018dbb-2e77-4c8d-8975-e4488ae42d52 tempest-VolumesSnapshotTestJSON-145827129 None] Acquiring lock "cinder-quobyte-20775249-bfb4-4c3a-bcb1-2fe1a380159c" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:44:52 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-21018dbb-2e77-4c8d-8975-e4488ae42d52 tempest-VolumesSnapshotTestJSON-145827129 None] Lock "cinder-quobyte-20775249-bfb4-4c3a-bcb1-2fe1a380159c" acquired by "delete_volume" :: waited 0.023s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:44:52 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d361b6ca-37f3-4d26-b577-fd6f315bd41a]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:44:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-21018dbb-2e77-4c8d-8975-e4488ae42d52 tempest-VolumesSnapshotTestJSON-145827129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-20775249-bfb4-4c3a-bcb1-2fe1a380159c {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:44:52 devstack sudo[99114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-20775249-bfb4-4c3a-bcb1-2fe1a380159c Jun 17 05:44:52 devstack sudo[99114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:44:52 devstack sudo[99109]: pam_unix(sudo:session): session closed for user root Jun 17 05:44:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-81079718-199a-41ca-8b96-bec1a40ca506 tempest-SnapshotsActionsTest-2140039854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.dd25fcab-d29f-44dc-b5a0-e4ab40f87851 1G" returned: 0 in 0.963s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:44:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-81079718-199a-41ca-8b96-bec1a40ca506 tempest-SnapshotsActionsTest-2140039854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.dd25fcab-d29f-44dc-b5a0-e4ab40f87851 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:44:52 devstack sudo[99117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.dd25fcab-d29f-44dc-b5a0-e4ab40f87851 Jun 17 05:44:52 devstack sudo[99117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:44:52 devstack sudo[99114]: pam_unix(sudo:session): session closed for user root Jun 17 05:44:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-21018dbb-2e77-4c8d-8975-e4488ae42d52 tempest-VolumesSnapshotTestJSON-145827129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-20775249-bfb4-4c3a-bcb1-2fe1a380159c" returned: 0 in 0.878s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:44:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-21018dbb-2e77-4c8d-8975-e4488ae42d52 tempest-VolumesSnapshotTestJSON-145827129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-20775249-bfb4-4c3a-bcb1-2fe1a380159c {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:44:53 devstack sudo[99122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-20775249-bfb4-4c3a-bcb1-2fe1a380159c Jun 17 05:44:53 devstack sudo[99122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:44:53 devstack sudo[99117]: pam_unix(sudo:session): session closed for user root Jun 17 05:44:53 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-81079718-199a-41ca-8b96-bec1a40ca506 tempest-SnapshotsActionsTest-2140039854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.dd25fcab-d29f-44dc-b5a0-e4ab40f87851" returned: 0 in 0.742s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:44:53 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [None req-81079718-199a-41ca-8b96-bec1a40ca506 tempest-SnapshotsActionsTest-2140039854 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.dd25fcab-d29f-44dc-b5a0-e4ab40f87851 is being set with open permissions: ugo+rw Jun 17 05:44:53 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-81079718-199a-41ca-8b96-bec1a40ca506 tempest-SnapshotsActionsTest-2140039854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.dd25fcab-d29f-44dc-b5a0-e4ab40f87851 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:44:53 devstack sudo[99129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.dd25fcab-d29f-44dc-b5a0-e4ab40f87851 Jun 17 05:44:53 devstack sudo[99129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:44:53 devstack sudo[99122]: pam_unix(sudo:session): session closed for user root Jun 17 05:44:53 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-21018dbb-2e77-4c8d-8975-e4488ae42d52 tempest-VolumesSnapshotTestJSON-145827129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-20775249-bfb4-4c3a-bcb1-2fe1a380159c" returned: 0 in 0.629s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:44:53 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-21018dbb-2e77-4c8d-8975-e4488ae42d52 tempest-VolumesSnapshotTestJSON-145827129 None] Lock "cinder-quobyte-20775249-bfb4-4c3a-bcb1-2fe1a380159c" released by "delete_volume" :: held 1.566s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:44:53 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-21018dbb-2e77-4c8d-8975-e4488ae42d52 tempest-VolumesSnapshotTestJSON-145827129 None] Created reservations ['df4ba5d5-01e7-4954-a2ad-574d68b9939e', '7bae42c5-f100-47bc-90c6-57e5b414ca0d', '92cb8445-e55a-4f46-b859-14740bb064f9', '702e000c-8c5d-4144-93a4-071c187f7ca8'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:44:53 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-21018dbb-2e77-4c8d-8975-e4488ae42d52 tempest-VolumesSnapshotTestJSON-145827129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:44:53 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-21018dbb-2e77-4c8d-8975-e4488ae42d52 tempest-VolumesSnapshotTestJSON-145827129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:44:53 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-21018dbb-2e77-4c8d-8975-e4488ae42d52 tempest-VolumesSnapshotTestJSON-145827129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:44:53 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-21018dbb-2e77-4c8d-8975-e4488ae42d52 tempest-VolumesSnapshotTestJSON-145827129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:44:53 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-21018dbb-2e77-4c8d-8975-e4488ae42d52 tempest-VolumesSnapshotTestJSON-145827129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:44:53 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-21018dbb-2e77-4c8d-8975-e4488ae42d52 tempest-VolumesSnapshotTestJSON-145827129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:44:53 devstack sudo[99133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:44:53 devstack sudo[99133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:44:53 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-81079718-199a-41ca-8b96-bec1a40ca506 tempest-SnapshotsActionsTest-2140039854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.dd25fcab-d29f-44dc-b5a0-e4ab40f87851" returned: 0 in 0.749s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:44:53 devstack sudo[99129]: pam_unix(sudo:session): session closed for user root Jun 17 05:44:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-81079718-199a-41ca-8b96-bec1a40ca506 tempest-SnapshotsActionsTest-2140039854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.432s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:44:54 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-81079718-199a-41ca-8b96-bec1a40ca506 tempest-SnapshotsActionsTest-2140039854 None] Create snapshot completed successfully Jun 17 05:44:54 devstack sudo[99133]: pam_unix(sudo:session): session closed for user root Jun 17 05:44:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-21018dbb-2e77-4c8d-8975-e4488ae42d52 tempest-VolumesSnapshotTestJSON-145827129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 1.198s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:44:54 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-21018dbb-2e77-4c8d-8975-e4488ae42d52 tempest-VolumesSnapshotTestJSON-145827129 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:44:55 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-21018dbb-2e77-4c8d-8975-e4488ae42d52 tempest-VolumesSnapshotTestJSON-145827129 None] Deleted volume successfully. Jun 17 05:44:55 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-21018dbb-2e77-4c8d-8975-e4488ae42d52 tempest-VolumesSnapshotTestJSON-145827129 None] Lock "cinder-20775249-bfb4-4c3a-bcb1-2fe1a380159c-delete_volume" released by "delete_volume" :: held 3.093s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:44:55 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-0e9889a1-22fa-440f-bb8f-213a47cdf780 tempest-SnapshotsActionsTest-1752299106 None] Acquiring lock "cinder-dd25fcab-d29f-44dc-b5a0-e4ab40f87851-delete_snapshot" by "delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:44:55 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-0e9889a1-22fa-440f-bb8f-213a47cdf780 tempest-SnapshotsActionsTest-1752299106 None] Lock "cinder-dd25fcab-d29f-44dc-b5a0-e4ab40f87851-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:44:55 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-0e9889a1-22fa-440f-bb8f-213a47cdf780 tempest-SnapshotsActionsTest-1752299106 None] Acquiring lock "cinder-quobyte-35d4c519-6d52-4aab-9423-f29c54fcc9ef" by "delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:44:55 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-0e9889a1-22fa-440f-bb8f-213a47cdf780 tempest-SnapshotsActionsTest-1752299106 None] Lock "cinder-quobyte-35d4c519-6d52-4aab-9423-f29c54fcc9ef" acquired by "delete_snapshot" :: waited 0.034s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:44:55 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-0e9889a1-22fa-440f-bb8f-213a47cdf780 tempest-SnapshotsActionsTest-1752299106 None] Acquiring lock "cinder-quobyte-dd25fcab-d29f-44dc-b5a0-e4ab40f87851" by "_delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:44:55 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-0e9889a1-22fa-440f-bb8f-213a47cdf780 tempest-SnapshotsActionsTest-1752299106 None] Lock "cinder-quobyte-dd25fcab-d29f-44dc-b5a0-e4ab40f87851" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:44:55 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-0e9889a1-22fa-440f-bb8f-213a47cdf780 tempest-SnapshotsActionsTest-1752299106 None] Deleting offline snapshot dd25fcab-d29f-44dc-b5a0-e4ab40f87851 of volume 35d4c519-6d52-4aab-9423-f29c54fcc9ef {{(pid=92083) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 17 05:44:55 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-0e9889a1-22fa-440f-bb8f-213a47cdf780 tempest-SnapshotsActionsTest-1752299106 None] snapshot_file for this snap is: volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.dd25fcab-d29f-44dc-b5a0-e4ab40f87851 {{(pid=92083) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 17 05:44:55 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ede197-6f87-4e51-964c-de6960644c0b]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:44:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0e9889a1-22fa-440f-bb8f-213a47cdf780 tempest-SnapshotsActionsTest-1752299106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.dd25fcab-d29f-44dc-b5a0-e4ab40f87851 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:44:55 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-69f44ee9-ba20-4f48-832f-0f2db535e276 tempest-VolumesSnapshotTestJSON-145827129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:44:55 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-69f44ee9-ba20-4f48-832f-0f2db535e276 tempest-VolumesSnapshotTestJSON-145827129 None] Flow 'volume_create_manager' (7173444c-b07b-4f91-9652-7a1f38ce00b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:44:55 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-69f44ee9-ba20-4f48-832f-0f2db535e276 tempest-VolumesSnapshotTestJSON-145827129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (275c412c-dfe7-465a-b7c4-c01e40b9bd3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:44:55 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-69f44ee9-ba20-4f48-832f-0f2db535e276 tempest-VolumesSnapshotTestJSON-145827129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (275c412c-dfe7-465a-b7c4-c01e40b9bd3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:44:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1466192223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9066415-1a82-491f-9439-79daedc3911a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a25655f92b243568375cdea8e080fb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:44:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:44:55Z,use_quota=True,user_id='ed17ca0128804d5096d31ee4ed1ff51e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:44:55 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-69f44ee9-ba20-4f48-832f-0f2db535e276 tempest-VolumesSnapshotTestJSON-145827129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba1a75ba-9b9a-48b0-a458-0cb6cf74b9cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:44:55 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-69f44ee9-ba20-4f48-832f-0f2db535e276 tempest-VolumesSnapshotTestJSON-145827129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba1a75ba-9b9a-48b0-a458-0cb6cf74b9cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:44:55 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-69f44ee9-ba20-4f48-832f-0f2db535e276 tempest-VolumesSnapshotTestJSON-145827129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dea37d8-59ef-48d0-b024-05ef951db482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:44:55 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-69f44ee9-ba20-4f48-832f-0f2db535e276 tempest-VolumesSnapshotTestJSON-145827129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dea37d8-59ef-48d0-b024-05ef951db482) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9066415-1a82-491f-9439-79daedc3911a', 'volume_name': 'volume-a9066415-1a82-491f-9439-79daedc3911a', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:44:55 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-69f44ee9-ba20-4f48-832f-0f2db535e276 tempest-VolumesSnapshotTestJSON-145827129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4edb137d-a713-4641-90e8-445a8726f621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:44:55 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-69f44ee9-ba20-4f48-832f-0f2db535e276 tempest-VolumesSnapshotTestJSON-145827129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4edb137d-a713-4641-90e8-445a8726f621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:44:55 devstack sudo[99173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.dd25fcab-d29f-44dc-b5a0-e4ab40f87851 Jun 17 05:44:55 devstack sudo[99173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:44:55 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-69f44ee9-ba20-4f48-832f-0f2db535e276 tempest-VolumesSnapshotTestJSON-145827129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cc41993-2d95-42f4-bece-b2a48bd084eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:44:55 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-69f44ee9-ba20-4f48-832f-0f2db535e276 tempest-VolumesSnapshotTestJSON-145827129 None] Volume a9066415-1a82-491f-9439-79daedc3911a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9066415-1a82-491f-9439-79daedc3911a', 'volume_size': 1} Jun 17 05:44:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-69f44ee9-ba20-4f48-832f-0f2db535e276 tempest-VolumesSnapshotTestJSON-145827129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:44:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-69f44ee9-ba20-4f48-832f-0f2db535e276 tempest-VolumesSnapshotTestJSON-145827129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:44:55 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-69f44ee9-ba20-4f48-832f-0f2db535e276 tempest-VolumesSnapshotTestJSON-145827129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:44:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1466192223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9066415-1a82-491f-9439-79daedc3911a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a25655f92b243568375cdea8e080fb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:44:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:44:55Z,use_quota=True,user_id='ed17ca0128804d5096d31ee4ed1ff51e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:44:55 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-69f44ee9-ba20-4f48-832f-0f2db535e276 tempest-VolumesSnapshotTestJSON-145827129 None] Creating volume a9066415-1a82-491f-9439-79daedc3911a {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:44:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-69f44ee9-ba20-4f48-832f-0f2db535e276 tempest-VolumesSnapshotTestJSON-145827129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:44:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-69f44ee9-ba20-4f48-832f-0f2db535e276 tempest-VolumesSnapshotTestJSON-145827129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:44:55 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-69f44ee9-ba20-4f48-832f-0f2db535e276 tempest-VolumesSnapshotTestJSON-145827129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:44:55 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-69f44ee9-ba20-4f48-832f-0f2db535e276 tempest-VolumesSnapshotTestJSON-145827129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:44:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-69f44ee9-ba20-4f48-832f-0f2db535e276 tempest-VolumesSnapshotTestJSON-145827129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:44:55 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-69f44ee9-ba20-4f48-832f-0f2db535e276 tempest-VolumesSnapshotTestJSON-145827129 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:44:55 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-69f44ee9-ba20-4f48-832f-0f2db535e276 tempest-VolumesSnapshotTestJSON-145827129 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:44:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-69f44ee9-ba20-4f48-832f-0f2db535e276 tempest-VolumesSnapshotTestJSON-145827129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a9066415-1a82-491f-9439-79daedc3911a 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:44:55 devstack sudo[99175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a9066415-1a82-491f-9439-79daedc3911a 1073741824 Jun 17 05:44:55 devstack sudo[99175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:44:56 devstack sudo[99173]: pam_unix(sudo:session): session closed for user root Jun 17 05:44:56 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0e9889a1-22fa-440f-bb8f-213a47cdf780 tempest-SnapshotsActionsTest-1752299106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.dd25fcab-d29f-44dc-b5a0-e4ab40f87851" returned: 0 in 0.871s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:44:56 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-0e9889a1-22fa-440f-bb8f-213a47cdf780 tempest-SnapshotsActionsTest-1752299106 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92083) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 05:44:56 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[10729b23-dfed-48f6-bd47-09918aaa3469]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:44:56 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0e9889a1-22fa-440f-bb8f-213a47cdf780 tempest-SnapshotsActionsTest-1752299106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:44:56 devstack sudo[99175]: pam_unix(sudo:session): session closed for user root Jun 17 05:44:56 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-69f44ee9-ba20-4f48-832f-0f2db535e276 tempest-VolumesSnapshotTestJSON-145827129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a9066415-1a82-491f-9439-79daedc3911a 1073741824" returned: 0 in 0.867s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:44:56 devstack sudo[99203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd Jun 17 05:44:56 devstack sudo[99203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:44:56 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-69f44ee9-ba20-4f48-832f-0f2db535e276 tempest-VolumesSnapshotTestJSON-145827129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a9066415-1a82-491f-9439-79daedc3911a {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:44:56 devstack sudo[99205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a9066415-1a82-491f-9439-79daedc3911a Jun 17 05:44:56 devstack sudo[99205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:44:56 devstack sudo[99203]: pam_unix(sudo:session): session closed for user root Jun 17 05:44:56 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0e9889a1-22fa-440f-bb8f-213a47cdf780 tempest-SnapshotsActionsTest-1752299106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd" returned: 0 in 0.788s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:44:56 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-0e9889a1-22fa-440f-bb8f-213a47cdf780 tempest-SnapshotsActionsTest-1752299106 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92083) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 05:44:56 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0e9889a1-22fa-440f-bb8f-213a47cdf780 tempest-SnapshotsActionsTest-1752299106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.dd25fcab-d29f-44dc-b5a0-e4ab40f87851 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:44:56 devstack sudo[99218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.dd25fcab-d29f-44dc-b5a0-e4ab40f87851 Jun 17 05:44:56 devstack sudo[99218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:44:56 devstack sudo[99205]: pam_unix(sudo:session): session closed for user root Jun 17 05:44:56 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-69f44ee9-ba20-4f48-832f-0f2db535e276 tempest-VolumesSnapshotTestJSON-145827129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a9066415-1a82-491f-9439-79daedc3911a" returned: 0 in 0.697s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:44:56 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-69f44ee9-ba20-4f48-832f-0f2db535e276 tempest-VolumesSnapshotTestJSON-145827129 None] <== create_volume: return (1611ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:44:56 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-69f44ee9-ba20-4f48-832f-0f2db535e276 tempest-VolumesSnapshotTestJSON-145827129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.613s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:44:57 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-69f44ee9-ba20-4f48-832f-0f2db535e276 tempest-VolumesSnapshotTestJSON-145827129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cc41993-2d95-42f4-bece-b2a48bd084eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9066415-1a82-491f-9439-79daedc3911a', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:44:57 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-69f44ee9-ba20-4f48-832f-0f2db535e276 tempest-VolumesSnapshotTestJSON-145827129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c77c119b-1a79-4d7e-bc60-40bbabb2a20d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:44:57 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-69f44ee9-ba20-4f48-832f-0f2db535e276 tempest-VolumesSnapshotTestJSON-145827129 None] Volume volume-a9066415-1a82-491f-9439-79daedc3911a (a9066415-1a82-491f-9439-79daedc3911a): created successfully Jun 17 05:44:57 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-69f44ee9-ba20-4f48-832f-0f2db535e276 tempest-VolumesSnapshotTestJSON-145827129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c77c119b-1a79-4d7e-bc60-40bbabb2a20d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:44:57 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-69f44ee9-ba20-4f48-832f-0f2db535e276 tempest-VolumesSnapshotTestJSON-145827129 None] Flow 'volume_create_manager' (7173444c-b07b-4f91-9652-7a1f38ce00b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:44:57 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-69f44ee9-ba20-4f48-832f-0f2db535e276 tempest-VolumesSnapshotTestJSON-145827129 None] Created volume successfully. Jun 17 05:44:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-f0261364-05a4-4138-b684-0c025d69b895 tempest-VolumesSnapshotTestJSON-145827129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:44:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-f0261364-05a4-4138-b684-0c025d69b895 tempest-VolumesSnapshotTestJSON-145827129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:44:57 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-f0261364-05a4-4138-b684-0c025d69b895 tempest-VolumesSnapshotTestJSON-145827129 None] Creating offline snapshot 683398be-e816-44da-bcb4-20a3f3ba67d5 of volume a9066415-1a82-491f-9439-79daedc3911a {{(pid=92083) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 17 05:44:57 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b41acfc-4311-4587-a995-b7d980f6bf4f]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:44:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f0261364-05a4-4138-b684-0c025d69b895 tempest-VolumesSnapshotTestJSON-145827129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a9066415-1a82-491f-9439-79daedc3911a {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:44:57 devstack sudo[99223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a9066415-1a82-491f-9439-79daedc3911a Jun 17 05:44:57 devstack sudo[99223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:44:57 devstack sudo[99218]: pam_unix(sudo:session): session closed for user root Jun 17 05:44:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0e9889a1-22fa-440f-bb8f-213a47cdf780 tempest-SnapshotsActionsTest-1752299106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.dd25fcab-d29f-44dc-b5a0-e4ab40f87851" returned: 0 in 0.786s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:44:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0e9889a1-22fa-440f-bb8f-213a47cdf780 tempest-SnapshotsActionsTest-1752299106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.dd25fcab-d29f-44dc-b5a0-e4ab40f87851 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:44:57 devstack sudo[99225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.dd25fcab-d29f-44dc-b5a0-e4ab40f87851 Jun 17 05:44:57 devstack sudo[99225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:44:58 devstack sudo[99223]: pam_unix(sudo:session): session closed for user root Jun 17 05:44:58 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f0261364-05a4-4138-b684-0c025d69b895 tempest-VolumesSnapshotTestJSON-145827129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a9066415-1a82-491f-9439-79daedc3911a" returned: 0 in 0.791s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:44:58 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f0261364-05a4-4138-b684-0c025d69b895 tempest-VolumesSnapshotTestJSON-145827129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a9066415-1a82-491f-9439-79daedc3911a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a9066415-1a82-491f-9439-79daedc3911a.683398be-e816-44da-bcb4-20a3f3ba67d5 1G {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:44:58 devstack sudo[99225]: pam_unix(sudo:session): session closed for user root Jun 17 05:44:58 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0e9889a1-22fa-440f-bb8f-213a47cdf780 tempest-SnapshotsActionsTest-1752299106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.dd25fcab-d29f-44dc-b5a0-e4ab40f87851" returned: 0 in 0.679s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:44:58 devstack sudo[99231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a9066415-1a82-491f-9439-79daedc3911a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a9066415-1a82-491f-9439-79daedc3911a.683398be-e816-44da-bcb4-20a3f3ba67d5 1G Jun 17 05:44:58 devstack sudo[99231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:44:58 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-0e9889a1-22fa-440f-bb8f-213a47cdf780 tempest-SnapshotsActionsTest-1752299106 None] Lock "cinder-quobyte-dd25fcab-d29f-44dc-b5a0-e4ab40f87851" released by "_delete_snapshot" :: held 3.237s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:44:58 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-0e9889a1-22fa-440f-bb8f-213a47cdf780 tempest-SnapshotsActionsTest-1752299106 None] Lock "cinder-quobyte-35d4c519-6d52-4aab-9423-f29c54fcc9ef" released by "delete_snapshot" :: held 3.265s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:44:58 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-0e9889a1-22fa-440f-bb8f-213a47cdf780 tempest-SnapshotsActionsTest-1752299106 None] Created reservations ['fc376a43-9b5e-48a2-beec-d9bb660373b3', 'bcffdf3a-d3f0-4e5a-bbcf-26a48e5810b7', 'afca2dd4-967e-4cb1-a435-69b1dfc4184c', '99bec13f-df2c-4e6b-8c41-155afdf40a66'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:44:58 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-0e9889a1-22fa-440f-bb8f-213a47cdf780 tempest-SnapshotsActionsTest-1752299106 None] Delete snapshot completed successfully. Jun 17 05:44:58 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-0e9889a1-22fa-440f-bb8f-213a47cdf780 tempest-SnapshotsActionsTest-1752299106 None] Lock "cinder-dd25fcab-d29f-44dc-b5a0-e4ab40f87851-delete_snapshot" released by "delete_snapshot" :: held 3.437s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:44:59 devstack sudo[99231]: pam_unix(sudo:session): session closed for user root Jun 17 05:44:59 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f0261364-05a4-4138-b684-0c025d69b895 tempest-VolumesSnapshotTestJSON-145827129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a9066415-1a82-491f-9439-79daedc3911a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a9066415-1a82-491f-9439-79daedc3911a.683398be-e816-44da-bcb4-20a3f3ba67d5 1G" returned: 0 in 0.816s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:44:59 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f0261364-05a4-4138-b684-0c025d69b895 tempest-VolumesSnapshotTestJSON-145827129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9066415-1a82-491f-9439-79daedc3911a -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a9066415-1a82-491f-9439-79daedc3911a.683398be-e816-44da-bcb4-20a3f3ba67d5 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:44:59 devstack sudo[99238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9066415-1a82-491f-9439-79daedc3911a -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a9066415-1a82-491f-9439-79daedc3911a.683398be-e816-44da-bcb4-20a3f3ba67d5 Jun 17 05:44:59 devstack sudo[99238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:44:59 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-1f0d46e3-32a1-4df5-a311-1c761f17e307 tempest-SnapshotsActionsTest-2140039854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:44:59 devstack sudo[99238]: pam_unix(sudo:session): session closed for user root Jun 17 05:44:59 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f0261364-05a4-4138-b684-0c025d69b895 tempest-VolumesSnapshotTestJSON-145827129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9066415-1a82-491f-9439-79daedc3911a -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a9066415-1a82-491f-9439-79daedc3911a.683398be-e816-44da-bcb4-20a3f3ba67d5" returned: 0 in 0.733s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:44:59 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [None req-f0261364-05a4-4138-b684-0c025d69b895 tempest-VolumesSnapshotTestJSON-145827129 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a9066415-1a82-491f-9439-79daedc3911a.683398be-e816-44da-bcb4-20a3f3ba67d5 is being set with open permissions: ugo+rw Jun 17 05:44:59 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f0261364-05a4-4138-b684-0c025d69b895 tempest-VolumesSnapshotTestJSON-145827129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a9066415-1a82-491f-9439-79daedc3911a.683398be-e816-44da-bcb4-20a3f3ba67d5 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:44:59 devstack sudo[99244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a9066415-1a82-491f-9439-79daedc3911a.683398be-e816-44da-bcb4-20a3f3ba67d5 Jun 17 05:44:59 devstack sudo[99244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:45:00 devstack sudo[99244]: pam_unix(sudo:session): session closed for user root Jun 17 05:45:00 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f0261364-05a4-4138-b684-0c025d69b895 tempest-VolumesSnapshotTestJSON-145827129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a9066415-1a82-491f-9439-79daedc3911a.683398be-e816-44da-bcb4-20a3f3ba67d5" returned: 0 in 0.601s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:45:00 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f0261364-05a4-4138-b684-0c025d69b895 tempest-VolumesSnapshotTestJSON-145827129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a9066415-1a82-491f-9439-79daedc3911a.info {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:45:00 devstack sudo[99247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a9066415-1a82-491f-9439-79daedc3911a.info Jun 17 05:45:00 devstack sudo[99247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:45:01 devstack sudo[99247]: pam_unix(sudo:session): session closed for user root Jun 17 05:45:01 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f0261364-05a4-4138-b684-0c025d69b895 tempest-VolumesSnapshotTestJSON-145827129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a9066415-1a82-491f-9439-79daedc3911a.info" returned: 0 in 0.601s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:45:01 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [None req-f0261364-05a4-4138-b684-0c025d69b895 tempest-VolumesSnapshotTestJSON-145827129 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a9066415-1a82-491f-9439-79daedc3911a.info is being set with open permissions: ugo+rw Jun 17 05:45:01 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f0261364-05a4-4138-b684-0c025d69b895 tempest-VolumesSnapshotTestJSON-145827129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a9066415-1a82-491f-9439-79daedc3911a.info {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:45:01 devstack sudo[99251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a9066415-1a82-491f-9439-79daedc3911a.info Jun 17 05:45:01 devstack sudo[99251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:45:01 devstack sudo[99251]: pam_unix(sudo:session): session closed for user root Jun 17 05:45:01 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f0261364-05a4-4138-b684-0c025d69b895 tempest-VolumesSnapshotTestJSON-145827129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a9066415-1a82-491f-9439-79daedc3911a.info" returned: 0 in 0.598s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:45:01 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-f0261364-05a4-4138-b684-0c025d69b895 tempest-VolumesSnapshotTestJSON-145827129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.222s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:45:01 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-1f0d46e3-32a1-4df5-a311-1c761f17e307 tempest-SnapshotsActionsTest-2140039854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.107s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:45:01 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-1f0d46e3-32a1-4df5-a311-1c761f17e307 tempest-SnapshotsActionsTest-2140039854 None] Creating offline snapshot 84dfede9-0ff7-42fe-af8e-69cf52bbb0d1 of volume 35d4c519-6d52-4aab-9423-f29c54fcc9ef {{(pid=92083) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 17 05:45:01 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c9e9bb-3853-4b8f-bb01-f0122401b9a5]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:45:01 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1f0d46e3-32a1-4df5-a311-1c761f17e307 tempest-SnapshotsActionsTest-2140039854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:45:01 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-f0261364-05a4-4138-b684-0c025d69b895 tempest-VolumesSnapshotTestJSON-145827129 None] Create snapshot completed successfully Jun 17 05:45:01 devstack sudo[99256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd Jun 17 05:45:01 devstack sudo[99256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:45:02 devstack sudo[99256]: pam_unix(sudo:session): session closed for user root Jun 17 05:45:02 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1f0d46e3-32a1-4df5-a311-1c761f17e307 tempest-SnapshotsActionsTest-2140039854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd" returned: 0 in 0.722s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:45:02 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-1f0d46e3-32a1-4df5-a311-1c761f17e307 tempest-SnapshotsActionsTest-2140039854 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92083) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 05:45:02 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1f0d46e3-32a1-4df5-a311-1c761f17e307 tempest-SnapshotsActionsTest-2140039854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.84dfede9-0ff7-42fe-af8e-69cf52bbb0d1 1G {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:45:02 devstack sudo[99261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.84dfede9-0ff7-42fe-af8e-69cf52bbb0d1 1G Jun 17 05:45:02 devstack sudo[99261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:45:03 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-84c73557-5bab-4e17-8209-6316ffdfc7c5 tempest-VolumesSnapshotTestJSON-145827129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:45:03 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-84c73557-5bab-4e17-8209-6316ffdfc7c5 tempest-VolumesSnapshotTestJSON-145827129 None] Flow 'volume_create_manager' (8f41857c-3d83-43fa-a25a-61c341dab206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:45:03 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-84c73557-5bab-4e17-8209-6316ffdfc7c5 tempest-VolumesSnapshotTestJSON-145827129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71d82a2b-7505-4189-841f-8526aee69819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:45:03 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-84c73557-5bab-4e17-8209-6316ffdfc7c5 tempest-VolumesSnapshotTestJSON-145827129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71d82a2b-7505-4189-841f-8526aee69819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:45:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1948401252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a2bcc6e-05b9-42a7-b9e9-6cb1c4f14158,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a25655f92b243568375cdea8e080fb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:45:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=683398be-e816-44da-bcb4-20a3f3ba67d5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:45:03Z,use_quota=True,user_id='ed17ca0128804d5096d31ee4ed1ff51e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:45:03 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-84c73557-5bab-4e17-8209-6316ffdfc7c5 tempest-VolumesSnapshotTestJSON-145827129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89cabc9e-20d1-42ba-a7fd-a0327a7a61ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:45:03 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-84c73557-5bab-4e17-8209-6316ffdfc7c5 tempest-VolumesSnapshotTestJSON-145827129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89cabc9e-20d1-42ba-a7fd-a0327a7a61ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:45:03 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-84c73557-5bab-4e17-8209-6316ffdfc7c5 tempest-VolumesSnapshotTestJSON-145827129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8afc00d6-14c5-4e45-ab18-ef1201d1694b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:45:03 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-84c73557-5bab-4e17-8209-6316ffdfc7c5 tempest-VolumesSnapshotTestJSON-145827129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8afc00d6-14c5-4e45-ab18-ef1201d1694b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9a2bcc6e-05b9-42a7-b9e9-6cb1c4f14158', 'volume_name': 'volume-9a2bcc6e-05b9-42a7-b9e9-6cb1c4f14158', 'volume_size': 1, 'snapshot_id': '683398be-e816-44da-bcb4-20a3f3ba67d5'}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:45:03 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-84c73557-5bab-4e17-8209-6316ffdfc7c5 tempest-VolumesSnapshotTestJSON-145827129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4130d37-b811-467d-9df8-59e6e964fe9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:45:03 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-84c73557-5bab-4e17-8209-6316ffdfc7c5 tempest-VolumesSnapshotTestJSON-145827129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4130d37-b811-467d-9df8-59e6e964fe9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:45:03 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-84c73557-5bab-4e17-8209-6316ffdfc7c5 tempest-VolumesSnapshotTestJSON-145827129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4b24bbb-0f00-422c-8a70-c4469674f356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:45:03 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-84c73557-5bab-4e17-8209-6316ffdfc7c5 tempest-VolumesSnapshotTestJSON-145827129 None] Volume 9a2bcc6e-05b9-42a7-b9e9-6cb1c4f14158: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9a2bcc6e-05b9-42a7-b9e9-6cb1c4f14158', 'volume_size': 1, 'snapshot_id': '683398be-e816-44da-bcb4-20a3f3ba67d5'} Jun 17 05:45:03 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-84c73557-5bab-4e17-8209-6316ffdfc7c5 tempest-VolumesSnapshotTestJSON-145827129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:45:03 devstack sudo[99261]: pam_unix(sudo:session): session closed for user root Jun 17 05:45:03 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1f0d46e3-32a1-4df5-a311-1c761f17e307 tempest-SnapshotsActionsTest-2140039854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.84dfede9-0ff7-42fe-af8e-69cf52bbb0d1 1G" returned: 0 in 1.047s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:45:03 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1f0d46e3-32a1-4df5-a311-1c761f17e307 tempest-SnapshotsActionsTest-2140039854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.84dfede9-0ff7-42fe-af8e-69cf52bbb0d1 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:45:03 devstack sudo[99268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.84dfede9-0ff7-42fe-af8e-69cf52bbb0d1 Jun 17 05:45:03 devstack sudo[99268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:45:04 devstack sudo[99268]: pam_unix(sudo:session): session closed for user root Jun 17 05:45:04 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1f0d46e3-32a1-4df5-a311-1c761f17e307 tempest-SnapshotsActionsTest-2140039854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.84dfede9-0ff7-42fe-af8e-69cf52bbb0d1" returned: 0 in 0.735s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:45:04 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [None req-1f0d46e3-32a1-4df5-a311-1c761f17e307 tempest-SnapshotsActionsTest-2140039854 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.84dfede9-0ff7-42fe-af8e-69cf52bbb0d1 is being set with open permissions: ugo+rw Jun 17 05:45:04 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1f0d46e3-32a1-4df5-a311-1c761f17e307 tempest-SnapshotsActionsTest-2140039854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.84dfede9-0ff7-42fe-af8e-69cf52bbb0d1 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:45:04 devstack sudo[99273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.84dfede9-0ff7-42fe-af8e-69cf52bbb0d1 Jun 17 05:45:04 devstack sudo[99273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:45:05 devstack sudo[99273]: pam_unix(sudo:session): session closed for user root Jun 17 05:45:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1f0d46e3-32a1-4df5-a311-1c761f17e307 tempest-SnapshotsActionsTest-2140039854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.84dfede9-0ff7-42fe-af8e-69cf52bbb0d1" returned: 0 in 0.669s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:45:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-1f0d46e3-32a1-4df5-a311-1c761f17e307 tempest-SnapshotsActionsTest-2140039854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.276s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:45:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-84c73557-5bab-4e17-8209-6316ffdfc7c5 tempest-VolumesSnapshotTestJSON-145827129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.531s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:45:05 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-84c73557-5bab-4e17-8209-6316ffdfc7c5 tempest-VolumesSnapshotTestJSON-145827129 None] Acquiring lock "cinder-quobyte-683398be-e816-44da-bcb4-20a3f3ba67d5-9a2bcc6e-05b9-42a7-b9e9-6cb1c4f14158" by "_create_volume_from_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:45:05 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-1f0d46e3-32a1-4df5-a311-1c761f17e307 tempest-SnapshotsActionsTest-2140039854 None] Create snapshot completed successfully Jun 17 05:45:05 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-84c73557-5bab-4e17-8209-6316ffdfc7c5 tempest-VolumesSnapshotTestJSON-145827129 None] Lock "cinder-quobyte-683398be-e816-44da-bcb4-20a3f3ba67d5-9a2bcc6e-05b9-42a7-b9e9-6cb1c4f14158" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:45:05 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-84c73557-5bab-4e17-8209-6316ffdfc7c5 tempest-VolumesSnapshotTestJSON-145827129 None] Creating volume 9a2bcc6e-05b9-42a7-b9e9-6cb1c4f14158 from snapshot 683398be-e816-44da-bcb4-20a3f3ba67d5 {{(pid=92083) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 17 05:45:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-84c73557-5bab-4e17-8209-6316ffdfc7c5 tempest-VolumesSnapshotTestJSON-145827129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:45:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-84c73557-5bab-4e17-8209-6316ffdfc7c5 tempest-VolumesSnapshotTestJSON-145827129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:45:05 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-84c73557-5bab-4e17-8209-6316ffdfc7c5 tempest-VolumesSnapshotTestJSON-145827129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:45:05 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-84c73557-5bab-4e17-8209-6316ffdfc7c5 tempest-VolumesSnapshotTestJSON-145827129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:45:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-84c73557-5bab-4e17-8209-6316ffdfc7c5 tempest-VolumesSnapshotTestJSON-145827129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:45:05 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-84c73557-5bab-4e17-8209-6316ffdfc7c5 tempest-VolumesSnapshotTestJSON-145827129 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:45:05 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-84c73557-5bab-4e17-8209-6316ffdfc7c5 tempest-VolumesSnapshotTestJSON-145827129 None] Acquiring lock "cinder-quobyte-9a2bcc6e-05b9-42a7-b9e9-6cb1c4f14158" by "_copy_volume_from_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:45:05 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-84c73557-5bab-4e17-8209-6316ffdfc7c5 tempest-VolumesSnapshotTestJSON-145827129 None] Lock "cinder-quobyte-9a2bcc6e-05b9-42a7-b9e9-6cb1c4f14158" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:45:05 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-84c73557-5bab-4e17-8209-6316ffdfc7c5 tempest-VolumesSnapshotTestJSON-145827129 None] snapshot: 683398be-e816-44da-bcb4-20a3f3ba67d5, volume: 9a2bcc6e-05b9-42a7-b9e9-6cb1c4f14158, {{(pid=92083) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 17 05:45:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-84c73557-5bab-4e17-8209-6316ffdfc7c5 tempest-VolumesSnapshotTestJSON-145827129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:45:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-84c73557-5bab-4e17-8209-6316ffdfc7c5 tempest-VolumesSnapshotTestJSON-145827129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:45:05 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-84c73557-5bab-4e17-8209-6316ffdfc7c5 tempest-VolumesSnapshotTestJSON-145827129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:45:05 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-84c73557-5bab-4e17-8209-6316ffdfc7c5 tempest-VolumesSnapshotTestJSON-145827129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:45:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-84c73557-5bab-4e17-8209-6316ffdfc7c5 tempest-VolumesSnapshotTestJSON-145827129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:45:05 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c1e6b7-2001-4ca8-8a1c-60940155c49f]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:45:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-84c73557-5bab-4e17-8209-6316ffdfc7c5 tempest-VolumesSnapshotTestJSON-145827129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a9066415-1a82-491f-9439-79daedc3911a.683398be-e816-44da-bcb4-20a3f3ba67d5 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:45:05 devstack sudo[99276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a9066415-1a82-491f-9439-79daedc3911a.683398be-e816-44da-bcb4-20a3f3ba67d5 Jun 17 05:45:05 devstack sudo[99276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:45:05 devstack sudo[99276]: pam_unix(sudo:session): session closed for user root Jun 17 05:45:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-84c73557-5bab-4e17-8209-6316ffdfc7c5 tempest-VolumesSnapshotTestJSON-145827129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a9066415-1a82-491f-9439-79daedc3911a.683398be-e816-44da-bcb4-20a3f3ba67d5" returned: 0 in 0.729s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:45:05 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-84c73557-5bab-4e17-8209-6316ffdfc7c5 tempest-VolumesSnapshotTestJSON-145827129 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9066415-1a82-491f-9439-79daedc3911a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92083) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 05:45:05 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-84c73557-5bab-4e17-8209-6316ffdfc7c5 tempest-VolumesSnapshotTestJSON-145827129 None] will copy from snapshot at /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a9066415-1a82-491f-9439-79daedc3911a {{(pid=92083) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 17 05:45:05 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-84c73557-5bab-4e17-8209-6316ffdfc7c5 tempest-VolumesSnapshotTestJSON-145827129 None] Creating direct copy from snapshot {{(pid=92083) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 17 05:45:05 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[febf6270-b6c0-43ac-a633-9dc73eecfa7c]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:45:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-84c73557-5bab-4e17-8209-6316ffdfc7c5 tempest-VolumesSnapshotTestJSON-145827129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a9066415-1a82-491f-9439-79daedc3911a {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:45:06 devstack sudo[99281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a9066415-1a82-491f-9439-79daedc3911a Jun 17 05:45:06 devstack sudo[99281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:45:06 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-f68c328d-4982-4a53-a6ff-be788810a960 tempest-SnapshotsActionsTest-1752299106 None] Acquiring lock "cinder-84dfede9-0ff7-42fe-af8e-69cf52bbb0d1-delete_snapshot" by "delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:45:06 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-f68c328d-4982-4a53-a6ff-be788810a960 tempest-SnapshotsActionsTest-1752299106 None] Lock "cinder-84dfede9-0ff7-42fe-af8e-69cf52bbb0d1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:45:06 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-f68c328d-4982-4a53-a6ff-be788810a960 tempest-SnapshotsActionsTest-1752299106 None] Acquiring lock "cinder-quobyte-35d4c519-6d52-4aab-9423-f29c54fcc9ef" by "delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:45:06 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-f68c328d-4982-4a53-a6ff-be788810a960 tempest-SnapshotsActionsTest-1752299106 None] Lock "cinder-quobyte-35d4c519-6d52-4aab-9423-f29c54fcc9ef" acquired by "delete_snapshot" :: waited 0.031s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:45:06 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-f68c328d-4982-4a53-a6ff-be788810a960 tempest-SnapshotsActionsTest-1752299106 None] Acquiring lock "cinder-quobyte-84dfede9-0ff7-42fe-af8e-69cf52bbb0d1" by "_delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:45:06 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-f68c328d-4982-4a53-a6ff-be788810a960 tempest-SnapshotsActionsTest-1752299106 None] Lock "cinder-quobyte-84dfede9-0ff7-42fe-af8e-69cf52bbb0d1" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:45:06 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-f68c328d-4982-4a53-a6ff-be788810a960 tempest-SnapshotsActionsTest-1752299106 None] Deleting offline snapshot 84dfede9-0ff7-42fe-af8e-69cf52bbb0d1 of volume 35d4c519-6d52-4aab-9423-f29c54fcc9ef {{(pid=92083) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 17 05:45:06 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-f68c328d-4982-4a53-a6ff-be788810a960 tempest-SnapshotsActionsTest-1752299106 None] snapshot_file for this snap is: volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.84dfede9-0ff7-42fe-af8e-69cf52bbb0d1 {{(pid=92083) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 17 05:45:06 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9655a14-5dd0-4d08-93a7-ab4004ec1b4d]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:45:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f68c328d-4982-4a53-a6ff-be788810a960 tempest-SnapshotsActionsTest-1752299106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.84dfede9-0ff7-42fe-af8e-69cf52bbb0d1 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:45:06 devstack sudo[99283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.84dfede9-0ff7-42fe-af8e-69cf52bbb0d1 Jun 17 05:45:06 devstack sudo[99283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:45:06 devstack sudo[99281]: pam_unix(sudo:session): session closed for user root Jun 17 05:45:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-84c73557-5bab-4e17-8209-6316ffdfc7c5 tempest-VolumesSnapshotTestJSON-145827129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a9066415-1a82-491f-9439-79daedc3911a" returned: 0 in 0.989s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:45:06 devstack cinder-volume[92083]: DEBUG cinder.utils [None req-84c73557-5bab-4e17-8209-6316ffdfc7c5 tempest-VolumesSnapshotTestJSON-145827129 None] Path /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9a2bcc6e-05b9-42a7-b9e9-6cb1c4f14158 not found in is_blk_device check {{(pid=92083) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 17 05:45:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-84c73557-5bab-4e17-8209-6316ffdfc7c5 tempest-VolumesSnapshotTestJSON-145827129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a9066415-1a82-491f-9439-79daedc3911a /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9a2bcc6e-05b9-42a7-b9e9-6cb1c4f14158 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:45:06 devstack sudo[99288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a9066415-1a82-491f-9439-79daedc3911a /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9a2bcc6e-05b9-42a7-b9e9-6cb1c4f14158 Jun 17 05:45:06 devstack sudo[99288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:45:07 devstack cinder-volume[92083]: DEBUG dbcounter [-] [92083] Writing DB stats cinder:SELECT=90,cinder:INSERT=21,cinder:UPDATE=82,cinder:DELETE=5 {{(pid=92083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:45:07 devstack cinder-volume[92083]: DEBUG dbcounter [-] [92083] Writing DB stats cinder:SELECT=93,cinder:UPDATE=80,cinder:INSERT=19,cinder:DELETE=9 {{(pid=92083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:45:07 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [req-97801d9f-213a-4c3d-8a22-952b87b10394 req-d995d6f8-c3fd-4ef2-aa4c-674c90e7b536 tempest-AttachVolumeShelveTestJSON-18917466 None] No connector for attachment 4c1a5f12-aebd-4b46-b9b9-04d717d9c60a; skipping storage backend terminate_connection call. {{(pid=92083) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jun 17 05:45:07 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [req-97801d9f-213a-4c3d-8a22-952b87b10394 req-d995d6f8-c3fd-4ef2-aa4c-674c90e7b536 tempest-AttachVolumeShelveTestJSON-18917466 None] Deleting attachment 4c1a5f12-aebd-4b46-b9b9-04d717d9c60a. {{(pid=92083) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 17 05:45:07 devstack sudo[99283]: pam_unix(sudo:session): session closed for user root Jun 17 05:45:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f68c328d-4982-4a53-a6ff-be788810a960 tempest-SnapshotsActionsTest-1752299106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.84dfede9-0ff7-42fe-af8e-69cf52bbb0d1" returned: 0 in 0.918s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:45:07 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-f68c328d-4982-4a53-a6ff-be788810a960 tempest-SnapshotsActionsTest-1752299106 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92083) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 05:45:07 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeea08f6-a147-4216-a868-3d0552001526]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:45:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f68c328d-4982-4a53-a6ff-be788810a960 tempest-SnapshotsActionsTest-1752299106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:45:07 devstack sudo[99293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd Jun 17 05:45:07 devstack sudo[99293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:45:08 devstack sudo[99293]: pam_unix(sudo:session): session closed for user root Jun 17 05:45:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f68c328d-4982-4a53-a6ff-be788810a960 tempest-SnapshotsActionsTest-1752299106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd" returned: 0 in 1.151s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:45:08 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-f68c328d-4982-4a53-a6ff-be788810a960 tempest-SnapshotsActionsTest-1752299106 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92083) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 05:45:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f68c328d-4982-4a53-a6ff-be788810a960 tempest-SnapshotsActionsTest-1752299106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.84dfede9-0ff7-42fe-af8e-69cf52bbb0d1 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:45:08 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a19a000-6c1a-40a0-a09e-2a26c67e8c65 tempest-AttachVolumeNegativeTest-1827868215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:45:08 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6a19a000-6c1a-40a0-a09e-2a26c67e8c65 tempest-AttachVolumeNegativeTest-1827868215 None] Flow 'volume_create_manager' (dc3454b1-09e0-4cce-92f7-c9a1f665d304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:45:08 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6a19a000-6c1a-40a0-a09e-2a26c67e8c65 tempest-AttachVolumeNegativeTest-1827868215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c2a7fb3-f7cb-407d-88d6-a51c3a984a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:45:08 devstack sudo[99312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.84dfede9-0ff7-42fe-af8e-69cf52bbb0d1 Jun 17 05:45:08 devstack sudo[99312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:45:08 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6a19a000-6c1a-40a0-a09e-2a26c67e8c65 tempest-AttachVolumeNegativeTest-1827868215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c2a7fb3-f7cb-407d-88d6-a51c3a984a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:45:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1706665728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f60c0803-95ae-4048-9840-c45bbe383601,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c02a66f7d37409daee1a984e0052823',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:45:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:45:08Z,use_quota=True,user_id='23e65f7b04184a998e98388dd4c3169a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:45:08 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6a19a000-6c1a-40a0-a09e-2a26c67e8c65 tempest-AttachVolumeNegativeTest-1827868215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad488044-c346-4b13-a998-1c1ff1333fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:45:08 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6a19a000-6c1a-40a0-a09e-2a26c67e8c65 tempest-AttachVolumeNegativeTest-1827868215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad488044-c346-4b13-a998-1c1ff1333fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:45:08 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6a19a000-6c1a-40a0-a09e-2a26c67e8c65 tempest-AttachVolumeNegativeTest-1827868215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25586745-55e4-4ec3-9ec1-8c81450b4129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:45:08 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6a19a000-6c1a-40a0-a09e-2a26c67e8c65 tempest-AttachVolumeNegativeTest-1827868215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25586745-55e4-4ec3-9ec1-8c81450b4129) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f60c0803-95ae-4048-9840-c45bbe383601', 'volume_name': 'volume-f60c0803-95ae-4048-9840-c45bbe383601', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:45:08 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6a19a000-6c1a-40a0-a09e-2a26c67e8c65 tempest-AttachVolumeNegativeTest-1827868215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8dd5f8c-2d44-4278-89df-520c682f98db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:45:08 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6a19a000-6c1a-40a0-a09e-2a26c67e8c65 tempest-AttachVolumeNegativeTest-1827868215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8dd5f8c-2d44-4278-89df-520c682f98db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:45:08 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6a19a000-6c1a-40a0-a09e-2a26c67e8c65 tempest-AttachVolumeNegativeTest-1827868215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f13608a6-de41-4497-b383-57281e0123f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:45:08 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-6a19a000-6c1a-40a0-a09e-2a26c67e8c65 tempest-AttachVolumeNegativeTest-1827868215 None] Volume f60c0803-95ae-4048-9840-c45bbe383601: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f60c0803-95ae-4048-9840-c45bbe383601', 'volume_size': 1} Jun 17 05:45:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-6a19a000-6c1a-40a0-a09e-2a26c67e8c65 tempest-AttachVolumeNegativeTest-1827868215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:45:10 devstack sudo[99312]: pam_unix(sudo:session): session closed for user root Jun 17 05:45:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f68c328d-4982-4a53-a6ff-be788810a960 tempest-SnapshotsActionsTest-1752299106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.84dfede9-0ff7-42fe-af8e-69cf52bbb0d1" returned: 0 in 1.848s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:45:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f68c328d-4982-4a53-a6ff-be788810a960 tempest-SnapshotsActionsTest-1752299106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.84dfede9-0ff7-42fe-af8e-69cf52bbb0d1 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:45:10 devstack sudo[99320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.84dfede9-0ff7-42fe-af8e-69cf52bbb0d1 Jun 17 05:45:10 devstack sudo[99320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:45:12 devstack sudo[99320]: pam_unix(sudo:session): session closed for user root Jun 17 05:45:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f68c328d-4982-4a53-a6ff-be788810a960 tempest-SnapshotsActionsTest-1752299106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.84dfede9-0ff7-42fe-af8e-69cf52bbb0d1" returned: 0 in 1.994s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:45:12 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-f68c328d-4982-4a53-a6ff-be788810a960 tempest-SnapshotsActionsTest-1752299106 None] Lock "cinder-quobyte-84dfede9-0ff7-42fe-af8e-69cf52bbb0d1" released by "_delete_snapshot" :: held 6.063s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:45:12 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-f68c328d-4982-4a53-a6ff-be788810a960 tempest-SnapshotsActionsTest-1752299106 None] Lock "cinder-quobyte-35d4c519-6d52-4aab-9423-f29c54fcc9ef" released by "delete_snapshot" :: held 6.098s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:45:12 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-f68c328d-4982-4a53-a6ff-be788810a960 tempest-SnapshotsActionsTest-1752299106 None] Created reservations ['09565d6a-1954-4799-9363-be5039f7a808', 'bff8ac1f-01bb-47aa-8f45-1c781f88a5fb', 'b60c88f9-5fae-4072-b9da-67fad8414f1c', '00a83c0a-3e94-45b0-b881-c17413c6ec60'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:45:12 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-f68c328d-4982-4a53-a6ff-be788810a960 tempest-SnapshotsActionsTest-1752299106 None] Delete snapshot completed successfully. Jun 17 05:45:12 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-f68c328d-4982-4a53-a6ff-be788810a960 tempest-SnapshotsActionsTest-1752299106 None] Lock "cinder-84dfede9-0ff7-42fe-af8e-69cf52bbb0d1-delete_snapshot" released by "delete_snapshot" :: held 6.376s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:45:13 devstack sudo[99288]: pam_unix(sudo:session): session closed for user root Jun 17 05:45:13 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-84c73557-5bab-4e17-8209-6316ffdfc7c5 tempest-VolumesSnapshotTestJSON-145827129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a9066415-1a82-491f-9439-79daedc3911a /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9a2bcc6e-05b9-42a7-b9e9-6cb1c4f14158" returned: 0 in 6.099s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:45:13 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d0106e-f159-407d-b93e-77cad2544b81]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:45:13 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-84c73557-5bab-4e17-8209-6316ffdfc7c5 tempest-VolumesSnapshotTestJSON-145827129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a9066415-1a82-491f-9439-79daedc3911a {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:45:13 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-f01c3f55-172e-43ff-95cf-22622fe24fd6 tempest-SnapshotsActionsTest-2140039854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:45:13 devstack sudo[99324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a9066415-1a82-491f-9439-79daedc3911a Jun 17 05:45:13 devstack sudo[99324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:45:13 devstack sudo[99324]: pam_unix(sudo:session): session closed for user root Jun 17 05:45:13 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-84c73557-5bab-4e17-8209-6316ffdfc7c5 tempest-VolumesSnapshotTestJSON-145827129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a9066415-1a82-491f-9439-79daedc3911a" returned: 0 in 0.860s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:45:13 devstack cinder-volume[92083]: DEBUG cinder.image.image_utils [None req-84c73557-5bab-4e17-8209-6316ffdfc7c5 tempest-VolumesSnapshotTestJSON-145827129 None] Image conversion details: src /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a9066415-1a82-491f-9439-79daedc3911a, size 1024.00 MB, duration 6.10 sec, destination /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9a2bcc6e-05b9-42a7-b9e9-6cb1c4f14158 {{(pid=92083) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 17 05:45:13 devstack cinder-volume[92083]: INFO cinder.image.image_utils [None req-84c73557-5bab-4e17-8209-6316ffdfc7c5 tempest-VolumesSnapshotTestJSON-145827129 None] Converted 1024.00 MB image at 167.87 MB/s Jun 17 05:45:13 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [None req-84c73557-5bab-4e17-8209-6316ffdfc7c5 tempest-VolumesSnapshotTestJSON-145827129 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9a2bcc6e-05b9-42a7-b9e9-6cb1c4f14158 is being set with open permissions: ugo+rw Jun 17 05:45:13 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-84c73557-5bab-4e17-8209-6316ffdfc7c5 tempest-VolumesSnapshotTestJSON-145827129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9a2bcc6e-05b9-42a7-b9e9-6cb1c4f14158 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:45:13 devstack sudo[99329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9a2bcc6e-05b9-42a7-b9e9-6cb1c4f14158 Jun 17 05:45:13 devstack sudo[99329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:45:14 devstack sudo[99329]: pam_unix(sudo:session): session closed for user root Jun 17 05:45:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-84c73557-5bab-4e17-8209-6316ffdfc7c5 tempest-VolumesSnapshotTestJSON-145827129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9a2bcc6e-05b9-42a7-b9e9-6cb1c4f14158" returned: 0 in 0.582s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:45:14 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-84c73557-5bab-4e17-8209-6316ffdfc7c5 tempest-VolumesSnapshotTestJSON-145827129 None] Lock "cinder-quobyte-9a2bcc6e-05b9-42a7-b9e9-6cb1c4f14158" released by "_copy_volume_from_snapshot" :: held 9.366s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:45:14 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-84c73557-5bab-4e17-8209-6316ffdfc7c5 tempest-VolumesSnapshotTestJSON-145827129 None] Lock "cinder-quobyte-683398be-e816-44da-bcb4-20a3f3ba67d5-9a2bcc6e-05b9-42a7-b9e9-6cb1c4f14158" released by "_create_volume_from_snapshot" :: held 9.400s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:45:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-84c73557-5bab-4e17-8209-6316ffdfc7c5 tempest-VolumesSnapshotTestJSON-145827129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.435s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:45:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-6a19a000-6c1a-40a0-a09e-2a26c67e8c65 tempest-AttachVolumeNegativeTest-1827868215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.957s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:45:14 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-6a19a000-6c1a-40a0-a09e-2a26c67e8c65 tempest-AttachVolumeNegativeTest-1827868215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:45:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1706665728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f60c0803-95ae-4048-9840-c45bbe383601,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c02a66f7d37409daee1a984e0052823',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:45:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:45:08Z,use_quota=True,user_id='23e65f7b04184a998e98388dd4c3169a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:45:14 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-6a19a000-6c1a-40a0-a09e-2a26c67e8c65 tempest-AttachVolumeNegativeTest-1827868215 None] Creating volume f60c0803-95ae-4048-9840-c45bbe383601 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:45:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-6a19a000-6c1a-40a0-a09e-2a26c67e8c65 tempest-AttachVolumeNegativeTest-1827868215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:45:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-6a19a000-6c1a-40a0-a09e-2a26c67e8c65 tempest-AttachVolumeNegativeTest-1827868215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:45:14 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-6a19a000-6c1a-40a0-a09e-2a26c67e8c65 tempest-AttachVolumeNegativeTest-1827868215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:45:14 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-6a19a000-6c1a-40a0-a09e-2a26c67e8c65 tempest-AttachVolumeNegativeTest-1827868215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:45:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-6a19a000-6c1a-40a0-a09e-2a26c67e8c65 tempest-AttachVolumeNegativeTest-1827868215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:45:14 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-6a19a000-6c1a-40a0-a09e-2a26c67e8c65 tempest-AttachVolumeNegativeTest-1827868215 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:45:14 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-6a19a000-6c1a-40a0-a09e-2a26c67e8c65 tempest-AttachVolumeNegativeTest-1827868215 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:45:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6a19a000-6c1a-40a0-a09e-2a26c67e8c65 tempest-AttachVolumeNegativeTest-1827868215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f60c0803-95ae-4048-9840-c45bbe383601 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:45:14 devstack sudo[99332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f60c0803-95ae-4048-9840-c45bbe383601 1073741824 Jun 17 05:45:14 devstack sudo[99332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:45:14 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-84c73557-5bab-4e17-8209-6316ffdfc7c5 tempest-VolumesSnapshotTestJSON-145827129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4b24bbb-0f00-422c-8a70-c4469674f356) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a2bcc6e-05b9-42a7-b9e9-6cb1c4f14158', 'volume_size': 1, 'snapshot_id': '683398be-e816-44da-bcb4-20a3f3ba67d5'}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:45:14 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-84c73557-5bab-4e17-8209-6316ffdfc7c5 tempest-VolumesSnapshotTestJSON-145827129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f832a506-4e34-4258-87bb-11f0ad3a7a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:45:14 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-84c73557-5bab-4e17-8209-6316ffdfc7c5 tempest-VolumesSnapshotTestJSON-145827129 None] Volume volume-9a2bcc6e-05b9-42a7-b9e9-6cb1c4f14158 (9a2bcc6e-05b9-42a7-b9e9-6cb1c4f14158): created successfully Jun 17 05:45:14 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-84c73557-5bab-4e17-8209-6316ffdfc7c5 tempest-VolumesSnapshotTestJSON-145827129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f832a506-4e34-4258-87bb-11f0ad3a7a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:45:14 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-84c73557-5bab-4e17-8209-6316ffdfc7c5 tempest-VolumesSnapshotTestJSON-145827129 None] Flow 'volume_create_manager' (8f41857c-3d83-43fa-a25a-61c341dab206) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:45:14 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-84c73557-5bab-4e17-8209-6316ffdfc7c5 tempest-VolumesSnapshotTestJSON-145827129 None] Created volume successfully. Jun 17 05:45:14 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-36b606b0-0c88-4877-8151-f4afa1da3c51 tempest-VolumesSnapshotTestJSON-145827129 None] Acquiring lock "cinder-9a2bcc6e-05b9-42a7-b9e9-6cb1c4f14158-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:45:14 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-36b606b0-0c88-4877-8151-f4afa1da3c51 tempest-VolumesSnapshotTestJSON-145827129 None] Lock "cinder-9a2bcc6e-05b9-42a7-b9e9-6cb1c4f14158-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:45:14 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-36b606b0-0c88-4877-8151-f4afa1da3c51 tempest-VolumesSnapshotTestJSON-145827129 None] Acquiring lock "cinder-quobyte-9a2bcc6e-05b9-42a7-b9e9-6cb1c4f14158" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:45:14 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-36b606b0-0c88-4877-8151-f4afa1da3c51 tempest-VolumesSnapshotTestJSON-145827129 None] Lock "cinder-quobyte-9a2bcc6e-05b9-42a7-b9e9-6cb1c4f14158" acquired by "delete_volume" :: waited 0.022s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:45:14 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8cc479-ebca-442a-af17-f25c555db67f]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:45:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-36b606b0-0c88-4877-8151-f4afa1da3c51 tempest-VolumesSnapshotTestJSON-145827129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9a2bcc6e-05b9-42a7-b9e9-6cb1c4f14158 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:45:15 devstack sudo[99340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9a2bcc6e-05b9-42a7-b9e9-6cb1c4f14158 Jun 17 05:45:15 devstack sudo[99340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:45:15 devstack sudo[99332]: pam_unix(sudo:session): session closed for user root Jun 17 05:45:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6a19a000-6c1a-40a0-a09e-2a26c67e8c65 tempest-AttachVolumeNegativeTest-1827868215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f60c0803-95ae-4048-9840-c45bbe383601 1073741824" returned: 0 in 0.818s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:45:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6a19a000-6c1a-40a0-a09e-2a26c67e8c65 tempest-AttachVolumeNegativeTest-1827868215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f60c0803-95ae-4048-9840-c45bbe383601 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:45:15 devstack sudo[99345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f60c0803-95ae-4048-9840-c45bbe383601 Jun 17 05:45:15 devstack sudo[99345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:45:15 devstack sudo[99340]: pam_unix(sudo:session): session closed for user root Jun 17 05:45:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-36b606b0-0c88-4877-8151-f4afa1da3c51 tempest-VolumesSnapshotTestJSON-145827129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9a2bcc6e-05b9-42a7-b9e9-6cb1c4f14158" returned: 0 in 0.721s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:45:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-36b606b0-0c88-4877-8151-f4afa1da3c51 tempest-VolumesSnapshotTestJSON-145827129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9a2bcc6e-05b9-42a7-b9e9-6cb1c4f14158 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:45:15 devstack sudo[99350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9a2bcc6e-05b9-42a7-b9e9-6cb1c4f14158 Jun 17 05:45:15 devstack sudo[99350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:45:16 devstack sudo[99345]: pam_unix(sudo:session): session closed for user root Jun 17 05:45:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6a19a000-6c1a-40a0-a09e-2a26c67e8c65 tempest-AttachVolumeNegativeTest-1827868215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f60c0803-95ae-4048-9840-c45bbe383601" returned: 0 in 0.649s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:45:16 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-6a19a000-6c1a-40a0-a09e-2a26c67e8c65 tempest-AttachVolumeNegativeTest-1827868215 None] <== create_volume: return (1518ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:45:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-6a19a000-6c1a-40a0-a09e-2a26c67e8c65 tempest-AttachVolumeNegativeTest-1827868215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.521s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:45:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-f01c3f55-172e-43ff-95cf-22622fe24fd6 tempest-SnapshotsActionsTest-2140039854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.901s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:45:16 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-f01c3f55-172e-43ff-95cf-22622fe24fd6 tempest-SnapshotsActionsTest-2140039854 None] Creating offline snapshot d9bd2577-a8ed-4884-9e62-cc801627afaf of volume 35d4c519-6d52-4aab-9423-f29c54fcc9ef {{(pid=92083) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 17 05:45:16 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6a19a000-6c1a-40a0-a09e-2a26c67e8c65 tempest-AttachVolumeNegativeTest-1827868215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f13608a6-de41-4497-b383-57281e0123f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f60c0803-95ae-4048-9840-c45bbe383601', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:45:16 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6a19a000-6c1a-40a0-a09e-2a26c67e8c65 tempest-AttachVolumeNegativeTest-1827868215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b77ebac4-b470-487c-9e01-555ecaf02796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:45:16 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ea9fd2-1588-4001-b6af-ca010ba42987]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:45:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f01c3f55-172e-43ff-95cf-22622fe24fd6 tempest-SnapshotsActionsTest-2140039854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:45:16 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-6a19a000-6c1a-40a0-a09e-2a26c67e8c65 tempest-AttachVolumeNegativeTest-1827868215 None] Volume volume-f60c0803-95ae-4048-9840-c45bbe383601 (f60c0803-95ae-4048-9840-c45bbe383601): created successfully Jun 17 05:45:16 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6a19a000-6c1a-40a0-a09e-2a26c67e8c65 tempest-AttachVolumeNegativeTest-1827868215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b77ebac4-b470-487c-9e01-555ecaf02796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:45:16 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6a19a000-6c1a-40a0-a09e-2a26c67e8c65 tempest-AttachVolumeNegativeTest-1827868215 None] Flow 'volume_create_manager' (dc3454b1-09e0-4cce-92f7-c9a1f665d304) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:45:16 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-6a19a000-6c1a-40a0-a09e-2a26c67e8c65 tempest-AttachVolumeNegativeTest-1827868215 None] Created volume successfully. Jun 17 05:45:16 devstack sudo[99353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd Jun 17 05:45:16 devstack sudo[99353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:45:16 devstack sudo[99350]: pam_unix(sudo:session): session closed for user root Jun 17 05:45:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-36b606b0-0c88-4877-8151-f4afa1da3c51 tempest-VolumesSnapshotTestJSON-145827129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9a2bcc6e-05b9-42a7-b9e9-6cb1c4f14158" returned: 0 in 0.645s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:45:16 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-36b606b0-0c88-4877-8151-f4afa1da3c51 tempest-VolumesSnapshotTestJSON-145827129 None] Lock "cinder-quobyte-9a2bcc6e-05b9-42a7-b9e9-6cb1c4f14158" released by "delete_volume" :: held 1.415s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:45:16 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-36b606b0-0c88-4877-8151-f4afa1da3c51 tempest-VolumesSnapshotTestJSON-145827129 None] Created reservations ['79538d74-9de1-4fe2-9dd0-4f2a3644a352', '76d45fac-874b-4b90-9276-2a4411e5a600', 'efccfdec-d64b-48c8-8b79-8ab8b25d098a', '3a33c05c-6302-4eb7-a782-df949cc16fde'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:45:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-36b606b0-0c88-4877-8151-f4afa1da3c51 tempest-VolumesSnapshotTestJSON-145827129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:45:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-36b606b0-0c88-4877-8151-f4afa1da3c51 tempest-VolumesSnapshotTestJSON-145827129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:45:16 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-36b606b0-0c88-4877-8151-f4afa1da3c51 tempest-VolumesSnapshotTestJSON-145827129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:45:16 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-36b606b0-0c88-4877-8151-f4afa1da3c51 tempest-VolumesSnapshotTestJSON-145827129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:45:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-36b606b0-0c88-4877-8151-f4afa1da3c51 tempest-VolumesSnapshotTestJSON-145827129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:45:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-36b606b0-0c88-4877-8151-f4afa1da3c51 tempest-VolumesSnapshotTestJSON-145827129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:45:16 devstack sudo[99356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:45:16 devstack sudo[99356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:45:16 devstack sudo[99353]: pam_unix(sudo:session): session closed for user root Jun 17 05:45:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f01c3f55-172e-43ff-95cf-22622fe24fd6 tempest-SnapshotsActionsTest-2140039854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd" returned: 0 in 0.727s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:45:16 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-f01c3f55-172e-43ff-95cf-22622fe24fd6 tempest-SnapshotsActionsTest-2140039854 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92083) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 05:45:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f01c3f55-172e-43ff-95cf-22622fe24fd6 tempest-SnapshotsActionsTest-2140039854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.d9bd2577-a8ed-4884-9e62-cc801627afaf 1G {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:45:16 devstack sudo[99361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.d9bd2577-a8ed-4884-9e62-cc801627afaf 1G Jun 17 05:45:16 devstack sudo[99361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:45:17 devstack sudo[99356]: pam_unix(sudo:session): session closed for user root Jun 17 05:45:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-36b606b0-0c88-4877-8151-f4afa1da3c51 tempest-VolumesSnapshotTestJSON-145827129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.720s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:45:17 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-36b606b0-0c88-4877-8151-f4afa1da3c51 tempest-VolumesSnapshotTestJSON-145827129 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:45:17 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-36b606b0-0c88-4877-8151-f4afa1da3c51 tempest-VolumesSnapshotTestJSON-145827129 None] Deleted volume successfully. Jun 17 05:45:17 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-36b606b0-0c88-4877-8151-f4afa1da3c51 tempest-VolumesSnapshotTestJSON-145827129 None] Lock "cinder-9a2bcc6e-05b9-42a7-b9e9-6cb1c4f14158-delete_volume" released by "delete_volume" :: held 2.343s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:45:17 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-007c6b14-c655-4280-8b58-841ff080fe51 tempest-VolumesSnapshotTestJSON-145827129 None] Acquiring lock "cinder-683398be-e816-44da-bcb4-20a3f3ba67d5-delete_snapshot" by "delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:45:17 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-007c6b14-c655-4280-8b58-841ff080fe51 tempest-VolumesSnapshotTestJSON-145827129 None] Lock "cinder-683398be-e816-44da-bcb4-20a3f3ba67d5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:45:17 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-007c6b14-c655-4280-8b58-841ff080fe51 tempest-VolumesSnapshotTestJSON-145827129 None] Acquiring lock "cinder-quobyte-a9066415-1a82-491f-9439-79daedc3911a" by "delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:45:17 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-007c6b14-c655-4280-8b58-841ff080fe51 tempest-VolumesSnapshotTestJSON-145827129 None] Lock "cinder-quobyte-a9066415-1a82-491f-9439-79daedc3911a" acquired by "delete_snapshot" :: waited 0.026s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:45:17 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-007c6b14-c655-4280-8b58-841ff080fe51 tempest-VolumesSnapshotTestJSON-145827129 None] Acquiring lock "cinder-quobyte-683398be-e816-44da-bcb4-20a3f3ba67d5" by "_delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:45:17 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-007c6b14-c655-4280-8b58-841ff080fe51 tempest-VolumesSnapshotTestJSON-145827129 None] Lock "cinder-quobyte-683398be-e816-44da-bcb4-20a3f3ba67d5" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:45:17 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-007c6b14-c655-4280-8b58-841ff080fe51 tempest-VolumesSnapshotTestJSON-145827129 None] Deleting offline snapshot 683398be-e816-44da-bcb4-20a3f3ba67d5 of volume a9066415-1a82-491f-9439-79daedc3911a {{(pid=92083) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 17 05:45:17 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-007c6b14-c655-4280-8b58-841ff080fe51 tempest-VolumesSnapshotTestJSON-145827129 None] snapshot_file for this snap is: volume-a9066415-1a82-491f-9439-79daedc3911a.683398be-e816-44da-bcb4-20a3f3ba67d5 {{(pid=92083) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 17 05:45:17 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[23192e3d-a276-4441-a397-d419c61ebc8b]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:45:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-007c6b14-c655-4280-8b58-841ff080fe51 tempest-VolumesSnapshotTestJSON-145827129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a9066415-1a82-491f-9439-79daedc3911a.683398be-e816-44da-bcb4-20a3f3ba67d5 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:45:17 devstack sudo[99364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a9066415-1a82-491f-9439-79daedc3911a.683398be-e816-44da-bcb4-20a3f3ba67d5 Jun 17 05:45:17 devstack sudo[99364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:45:17 devstack sudo[99361]: pam_unix(sudo:session): session closed for user root Jun 17 05:45:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f01c3f55-172e-43ff-95cf-22622fe24fd6 tempest-SnapshotsActionsTest-2140039854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.d9bd2577-a8ed-4884-9e62-cc801627afaf 1G" returned: 0 in 0.964s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:45:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f01c3f55-172e-43ff-95cf-22622fe24fd6 tempest-SnapshotsActionsTest-2140039854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.d9bd2577-a8ed-4884-9e62-cc801627afaf {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:45:17 devstack sudo[99369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.d9bd2577-a8ed-4884-9e62-cc801627afaf Jun 17 05:45:17 devstack sudo[99369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:45:18 devstack sudo[99364]: pam_unix(sudo:session): session closed for user root Jun 17 05:45:18 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-007c6b14-c655-4280-8b58-841ff080fe51 tempest-VolumesSnapshotTestJSON-145827129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a9066415-1a82-491f-9439-79daedc3911a.683398be-e816-44da-bcb4-20a3f3ba67d5" returned: 0 in 0.804s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:45:18 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-007c6b14-c655-4280-8b58-841ff080fe51 tempest-VolumesSnapshotTestJSON-145827129 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9066415-1a82-491f-9439-79daedc3911a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92083) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 05:45:18 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d51f81-5583-477b-b19b-08fdc4257726]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:45:18 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-007c6b14-c655-4280-8b58-841ff080fe51 tempest-VolumesSnapshotTestJSON-145827129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a9066415-1a82-491f-9439-79daedc3911a {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:45:18 devstack sudo[99380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a9066415-1a82-491f-9439-79daedc3911a Jun 17 05:45:18 devstack sudo[99380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:45:18 devstack sudo[99369]: pam_unix(sudo:session): session closed for user root Jun 17 05:45:18 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f01c3f55-172e-43ff-95cf-22622fe24fd6 tempest-SnapshotsActionsTest-2140039854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.d9bd2577-a8ed-4884-9e62-cc801627afaf" returned: 0 in 0.730s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:45:18 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [None req-f01c3f55-172e-43ff-95cf-22622fe24fd6 tempest-SnapshotsActionsTest-2140039854 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.d9bd2577-a8ed-4884-9e62-cc801627afaf is being set with open permissions: ugo+rw Jun 17 05:45:18 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f01c3f55-172e-43ff-95cf-22622fe24fd6 tempest-SnapshotsActionsTest-2140039854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.d9bd2577-a8ed-4884-9e62-cc801627afaf {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:45:18 devstack sudo[99385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.d9bd2577-a8ed-4884-9e62-cc801627afaf Jun 17 05:45:18 devstack sudo[99385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:45:18 devstack sudo[99380]: pam_unix(sudo:session): session closed for user root Jun 17 05:45:18 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-007c6b14-c655-4280-8b58-841ff080fe51 tempest-VolumesSnapshotTestJSON-145827129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a9066415-1a82-491f-9439-79daedc3911a" returned: 0 in 0.777s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:45:18 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-007c6b14-c655-4280-8b58-841ff080fe51 tempest-VolumesSnapshotTestJSON-145827129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a9066415-1a82-491f-9439-79daedc3911a.683398be-e816-44da-bcb4-20a3f3ba67d5 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:45:18 devstack sudo[99391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a9066415-1a82-491f-9439-79daedc3911a.683398be-e816-44da-bcb4-20a3f3ba67d5 Jun 17 05:45:18 devstack sudo[99391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:45:19 devstack sudo[99385]: pam_unix(sudo:session): session closed for user root Jun 17 05:45:19 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f01c3f55-172e-43ff-95cf-22622fe24fd6 tempest-SnapshotsActionsTest-2140039854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.d9bd2577-a8ed-4884-9e62-cc801627afaf" returned: 0 in 0.617s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:45:19 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-f01c3f55-172e-43ff-95cf-22622fe24fd6 tempest-SnapshotsActionsTest-2140039854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.148s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:45:19 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-f01c3f55-172e-43ff-95cf-22622fe24fd6 tempest-SnapshotsActionsTest-2140039854 None] Create snapshot completed successfully Jun 17 05:45:19 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-6d6dfccc-2ab1-4aad-9967-b5084d7210ea tempest-SnapshotsActionsTest-1752299106 None] Acquiring lock "cinder-d9bd2577-a8ed-4884-9e62-cc801627afaf-delete_snapshot" by "delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:45:19 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-6d6dfccc-2ab1-4aad-9967-b5084d7210ea tempest-SnapshotsActionsTest-1752299106 None] Lock "cinder-d9bd2577-a8ed-4884-9e62-cc801627afaf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:45:19 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-6d6dfccc-2ab1-4aad-9967-b5084d7210ea tempest-SnapshotsActionsTest-1752299106 None] Acquiring lock "cinder-quobyte-35d4c519-6d52-4aab-9423-f29c54fcc9ef" by "delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:45:19 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-6d6dfccc-2ab1-4aad-9967-b5084d7210ea tempest-SnapshotsActionsTest-1752299106 None] Lock "cinder-quobyte-35d4c519-6d52-4aab-9423-f29c54fcc9ef" acquired by "delete_snapshot" :: waited 0.016s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:45:19 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-6d6dfccc-2ab1-4aad-9967-b5084d7210ea tempest-SnapshotsActionsTest-1752299106 None] Acquiring lock "cinder-quobyte-d9bd2577-a8ed-4884-9e62-cc801627afaf" by "_delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:45:19 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-6d6dfccc-2ab1-4aad-9967-b5084d7210ea tempest-SnapshotsActionsTest-1752299106 None] Lock "cinder-quobyte-d9bd2577-a8ed-4884-9e62-cc801627afaf" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:45:19 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-6d6dfccc-2ab1-4aad-9967-b5084d7210ea tempest-SnapshotsActionsTest-1752299106 None] Deleting offline snapshot d9bd2577-a8ed-4884-9e62-cc801627afaf of volume 35d4c519-6d52-4aab-9423-f29c54fcc9ef {{(pid=92083) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 17 05:45:19 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-6d6dfccc-2ab1-4aad-9967-b5084d7210ea tempest-SnapshotsActionsTest-1752299106 None] snapshot_file for this snap is: volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.d9bd2577-a8ed-4884-9e62-cc801627afaf {{(pid=92083) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 17 05:45:19 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[753e5ad1-53fa-4ab3-ab5b-a58fd76153f2]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:45:19 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6d6dfccc-2ab1-4aad-9967-b5084d7210ea tempest-SnapshotsActionsTest-1752299106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.d9bd2577-a8ed-4884-9e62-cc801627afaf {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:45:19 devstack sudo[99397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.d9bd2577-a8ed-4884-9e62-cc801627afaf Jun 17 05:45:19 devstack sudo[99397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:45:19 devstack sudo[99391]: pam_unix(sudo:session): session closed for user root Jun 17 05:45:19 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-007c6b14-c655-4280-8b58-841ff080fe51 tempest-VolumesSnapshotTestJSON-145827129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a9066415-1a82-491f-9439-79daedc3911a.683398be-e816-44da-bcb4-20a3f3ba67d5" returned: 0 in 0.827s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:45:19 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-007c6b14-c655-4280-8b58-841ff080fe51 tempest-VolumesSnapshotTestJSON-145827129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a9066415-1a82-491f-9439-79daedc3911a.683398be-e816-44da-bcb4-20a3f3ba67d5 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:45:19 devstack sudo[99399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a9066415-1a82-491f-9439-79daedc3911a.683398be-e816-44da-bcb4-20a3f3ba67d5 Jun 17 05:45:19 devstack sudo[99399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:45:20 devstack sudo[99399]: pam_unix(sudo:session): session closed for user root Jun 17 05:45:20 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-007c6b14-c655-4280-8b58-841ff080fe51 tempest-VolumesSnapshotTestJSON-145827129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a9066415-1a82-491f-9439-79daedc3911a.683398be-e816-44da-bcb4-20a3f3ba67d5" returned: 0 in 0.679s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:45:20 devstack sudo[99397]: pam_unix(sudo:session): session closed for user root Jun 17 05:45:20 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6d6dfccc-2ab1-4aad-9967-b5084d7210ea tempest-SnapshotsActionsTest-1752299106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.d9bd2577-a8ed-4884-9e62-cc801627afaf" returned: 0 in 0.859s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:45:20 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-6d6dfccc-2ab1-4aad-9967-b5084d7210ea tempest-SnapshotsActionsTest-1752299106 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92083) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 05:45:20 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[86bf6497-6fb8-43c7-94fd-15b566bd4f1e]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:45:20 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6d6dfccc-2ab1-4aad-9967-b5084d7210ea tempest-SnapshotsActionsTest-1752299106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:45:20 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-007c6b14-c655-4280-8b58-841ff080fe51 tempest-VolumesSnapshotTestJSON-145827129 None] Lock "cinder-quobyte-683398be-e816-44da-bcb4-20a3f3ba67d5" released by "_delete_snapshot" :: held 3.281s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:45:20 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-007c6b14-c655-4280-8b58-841ff080fe51 tempest-VolumesSnapshotTestJSON-145827129 None] Lock "cinder-quobyte-a9066415-1a82-491f-9439-79daedc3911a" released by "delete_snapshot" :: held 3.317s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:45:20 devstack sudo[99408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd Jun 17 05:45:20 devstack sudo[99408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:45:20 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-007c6b14-c655-4280-8b58-841ff080fe51 tempest-VolumesSnapshotTestJSON-145827129 None] Created reservations ['9c8d7e58-d40d-4f9c-92b7-6696fceb0567', '42249b6e-f1de-45cd-8de1-7aa7decd8284', '776ba7e4-5a1a-4b95-9e31-898bbb15f201', '88eac856-8e60-45ed-9b2f-d79eafdbafa9'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:45:20 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-007c6b14-c655-4280-8b58-841ff080fe51 tempest-VolumesSnapshotTestJSON-145827129 None] Delete snapshot completed successfully. Jun 17 05:45:20 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-007c6b14-c655-4280-8b58-841ff080fe51 tempest-VolumesSnapshotTestJSON-145827129 None] Lock "cinder-683398be-e816-44da-bcb4-20a3f3ba67d5-delete_snapshot" released by "delete_snapshot" :: held 3.532s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:45:21 devstack sudo[99408]: pam_unix(sudo:session): session closed for user root Jun 17 05:45:21 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6d6dfccc-2ab1-4aad-9967-b5084d7210ea tempest-SnapshotsActionsTest-1752299106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd" returned: 0 in 0.814s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:45:21 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-6d6dfccc-2ab1-4aad-9967-b5084d7210ea tempest-SnapshotsActionsTest-1752299106 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92083) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 05:45:21 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6d6dfccc-2ab1-4aad-9967-b5084d7210ea tempest-SnapshotsActionsTest-1752299106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.d9bd2577-a8ed-4884-9e62-cc801627afaf {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:45:21 devstack sudo[99418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.d9bd2577-a8ed-4884-9e62-cc801627afaf Jun 17 05:45:21 devstack sudo[99418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:45:21 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-0bd0f0db-57ea-4c44-ab73-bd56ba6500c3 tempest-VolumesSnapshotTestJSON-145827129 None] Acquiring lock "cinder-a9066415-1a82-491f-9439-79daedc3911a-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:45:21 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-0bd0f0db-57ea-4c44-ab73-bd56ba6500c3 tempest-VolumesSnapshotTestJSON-145827129 None] Lock "cinder-a9066415-1a82-491f-9439-79daedc3911a-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:45:21 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-0bd0f0db-57ea-4c44-ab73-bd56ba6500c3 tempest-VolumesSnapshotTestJSON-145827129 None] Acquiring lock "cinder-quobyte-a9066415-1a82-491f-9439-79daedc3911a" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:45:21 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-0bd0f0db-57ea-4c44-ab73-bd56ba6500c3 tempest-VolumesSnapshotTestJSON-145827129 None] Lock "cinder-quobyte-a9066415-1a82-491f-9439-79daedc3911a" acquired by "delete_volume" :: waited 0.016s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:45:21 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c8214c-58ad-4d5e-b474-734ee223fbbb]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:45:21 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0bd0f0db-57ea-4c44-ab73-bd56ba6500c3 tempest-VolumesSnapshotTestJSON-145827129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a9066415-1a82-491f-9439-79daedc3911a {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:45:21 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-532c95d9-24df-41a9-9d4f-7685cef3a4c0 req-831dc163-b5be-4d8e-a2d2-0a2f45ecd119 tempest-AttachVolumeNegativeTest-1827868215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:45:21 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-532c95d9-24df-41a9-9d4f-7685cef3a4c0 req-831dc163-b5be-4d8e-a2d2-0a2f45ecd119 tempest-AttachVolumeNegativeTest-1827868215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:45:21 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[41457bd0-0833-4e40-adc1-9a935756e419]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:45:21 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-532c95d9-24df-41a9-9d4f-7685cef3a4c0 req-831dc163-b5be-4d8e-a2d2-0a2f45ecd119 tempest-AttachVolumeNegativeTest-1827868215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f60c0803-95ae-4048-9840-c45bbe383601 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:45:21 devstack sudo[99423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a9066415-1a82-491f-9439-79daedc3911a Jun 17 05:45:21 devstack sudo[99423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:45:22 devstack sudo[99428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f60c0803-95ae-4048-9840-c45bbe383601 Jun 17 05:45:22 devstack sudo[99428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:45:22 devstack sudo[99418]: pam_unix(sudo:session): session closed for user root Jun 17 05:45:22 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6d6dfccc-2ab1-4aad-9967-b5084d7210ea tempest-SnapshotsActionsTest-1752299106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.d9bd2577-a8ed-4884-9e62-cc801627afaf" returned: 0 in 0.945s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:45:22 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6d6dfccc-2ab1-4aad-9967-b5084d7210ea tempest-SnapshotsActionsTest-1752299106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.d9bd2577-a8ed-4884-9e62-cc801627afaf {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:45:22 devstack sudo[99442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.d9bd2577-a8ed-4884-9e62-cc801627afaf Jun 17 05:45:22 devstack sudo[99442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:45:22 devstack sudo[99423]: pam_unix(sudo:session): session closed for user root Jun 17 05:45:22 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0bd0f0db-57ea-4c44-ab73-bd56ba6500c3 tempest-VolumesSnapshotTestJSON-145827129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a9066415-1a82-491f-9439-79daedc3911a" returned: 0 in 0.876s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:45:22 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0bd0f0db-57ea-4c44-ab73-bd56ba6500c3 tempest-VolumesSnapshotTestJSON-145827129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a9066415-1a82-491f-9439-79daedc3911a {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:45:22 devstack sudo[99461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a9066415-1a82-491f-9439-79daedc3911a Jun 17 05:45:22 devstack sudo[99461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:45:22 devstack sudo[99428]: pam_unix(sudo:session): session closed for user root Jun 17 05:45:22 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-532c95d9-24df-41a9-9d4f-7685cef3a4c0 req-831dc163-b5be-4d8e-a2d2-0a2f45ecd119 tempest-AttachVolumeNegativeTest-1827868215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f60c0803-95ae-4048-9840-c45bbe383601" returned: 0 in 0.915s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:45:22 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-532c95d9-24df-41a9-9d4f-7685cef3a4c0 req-831dc163-b5be-4d8e-a2d2-0a2f45ecd119 tempest-AttachVolumeNegativeTest-1827868215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.942s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:45:22 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [req-532c95d9-24df-41a9-9d4f-7685cef3a4c0 req-831dc163-b5be-4d8e-a2d2-0a2f45ecd119 tempest-AttachVolumeNegativeTest-1827868215 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f', 'name': 'volume-f60c0803-95ae-4048-9840-c45bbe383601', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '83423784-b9c0-4b49-9f00-59064213950f', 'enforce_multipath': True} {{(pid=92083) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 17 05:45:22 devstack cinder-volume[92083]: INFO cinder.volume.manager [req-532c95d9-24df-41a9-9d4f-7685cef3a4c0 req-831dc163-b5be-4d8e-a2d2-0a2f45ecd119 tempest-AttachVolumeNegativeTest-1827868215 None] attachment_update completed successfully. Jun 17 05:45:23 devstack sudo[99442]: pam_unix(sudo:session): session closed for user root Jun 17 05:45:23 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6d6dfccc-2ab1-4aad-9967-b5084d7210ea tempest-SnapshotsActionsTest-1752299106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.d9bd2577-a8ed-4884-9e62-cc801627afaf" returned: 0 in 0.750s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:45:23 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-6d6dfccc-2ab1-4aad-9967-b5084d7210ea tempest-SnapshotsActionsTest-1752299106 None] Lock "cinder-quobyte-d9bd2577-a8ed-4884-9e62-cc801627afaf" released by "_delete_snapshot" :: held 3.494s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:45:23 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-6d6dfccc-2ab1-4aad-9967-b5084d7210ea tempest-SnapshotsActionsTest-1752299106 None] Lock "cinder-quobyte-35d4c519-6d52-4aab-9423-f29c54fcc9ef" released by "delete_snapshot" :: held 3.529s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:45:23 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-6d6dfccc-2ab1-4aad-9967-b5084d7210ea tempest-SnapshotsActionsTest-1752299106 None] Created reservations ['5b449ea1-c5fe-4d02-a527-c37a2e4fec97', 'eeb1f8d8-28a0-4b56-a466-df87d2145f68', '3ea703c4-fa74-439c-960e-96551ecb9b5a', '22e9cc00-beab-4a47-9d50-1be886201bb7'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:45:23 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-6d6dfccc-2ab1-4aad-9967-b5084d7210ea tempest-SnapshotsActionsTest-1752299106 None] Delete snapshot completed successfully. Jun 17 05:45:23 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-6d6dfccc-2ab1-4aad-9967-b5084d7210ea tempest-SnapshotsActionsTest-1752299106 None] Lock "cinder-d9bd2577-a8ed-4884-9e62-cc801627afaf-delete_snapshot" released by "delete_snapshot" :: held 3.666s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:45:23 devstack sudo[99461]: pam_unix(sudo:session): session closed for user root Jun 17 05:45:23 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0bd0f0db-57ea-4c44-ab73-bd56ba6500c3 tempest-VolumesSnapshotTestJSON-145827129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a9066415-1a82-491f-9439-79daedc3911a" returned: 0 in 0.647s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:45:23 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-0bd0f0db-57ea-4c44-ab73-bd56ba6500c3 tempest-VolumesSnapshotTestJSON-145827129 None] Lock "cinder-quobyte-a9066415-1a82-491f-9439-79daedc3911a" released by "delete_volume" :: held 1.606s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:45:23 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-0bd0f0db-57ea-4c44-ab73-bd56ba6500c3 tempest-VolumesSnapshotTestJSON-145827129 None] Created reservations ['b2824ffc-135e-4225-8784-7791b46bb1bc', '96a271e7-093d-4fef-9706-65e908e6c844', '8edb0074-1dc5-44a6-8f99-30176ce8c52d', '44d24181-5d50-4f5f-bac7-4dc9c853d29c'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:45:23 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-0bd0f0db-57ea-4c44-ab73-bd56ba6500c3 tempest-VolumesSnapshotTestJSON-145827129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:45:23 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-0bd0f0db-57ea-4c44-ab73-bd56ba6500c3 tempest-VolumesSnapshotTestJSON-145827129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:45:23 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-0bd0f0db-57ea-4c44-ab73-bd56ba6500c3 tempest-VolumesSnapshotTestJSON-145827129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:45:23 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-0bd0f0db-57ea-4c44-ab73-bd56ba6500c3 tempest-VolumesSnapshotTestJSON-145827129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:45:23 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-0bd0f0db-57ea-4c44-ab73-bd56ba6500c3 tempest-VolumesSnapshotTestJSON-145827129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:45:23 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0bd0f0db-57ea-4c44-ab73-bd56ba6500c3 tempest-VolumesSnapshotTestJSON-145827129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:45:23 devstack sudo[99473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:45:23 devstack sudo[99473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:45:23 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-f4b77db9-04a4-439d-828d-e975d3b5e704 tempest-VolumesSnapshotTestJSON-145827129 None] Acquiring lock "cinder-32c260c5-65d3-4292-be07-5296ac8138fe-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:45:24 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-f4b77db9-04a4-439d-828d-e975d3b5e704 tempest-VolumesSnapshotTestJSON-145827129 None] Lock "cinder-32c260c5-65d3-4292-be07-5296ac8138fe-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:45:24 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-f4b77db9-04a4-439d-828d-e975d3b5e704 tempest-VolumesSnapshotTestJSON-145827129 None] Acquiring lock "cinder-quobyte-32c260c5-65d3-4292-be07-5296ac8138fe" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:45:24 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-f4b77db9-04a4-439d-828d-e975d3b5e704 tempest-VolumesSnapshotTestJSON-145827129 None] Lock "cinder-quobyte-32c260c5-65d3-4292-be07-5296ac8138fe" acquired by "delete_volume" :: waited 0.024s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:45:24 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b3c0cb2-e169-4180-b0f1-0cb27ed0670a]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:45:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f4b77db9-04a4-439d-828d-e975d3b5e704 tempest-VolumesSnapshotTestJSON-145827129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-32c260c5-65d3-4292-be07-5296ac8138fe {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:45:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-525d952c-485d-4b0e-b4c4-25f3d2ae52dc tempest-SnapshotsActionsTest-2140039854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:45:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-525d952c-485d-4b0e-b4c4-25f3d2ae52dc tempest-SnapshotsActionsTest-2140039854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:45:24 devstack sudo[99473]: pam_unix(sudo:session): session closed for user root Jun 17 05:45:24 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-525d952c-485d-4b0e-b4c4-25f3d2ae52dc tempest-SnapshotsActionsTest-2140039854 None] Creating offline snapshot e401b0b8-a67e-45d0-af67-95c583edc62f of volume 35d4c519-6d52-4aab-9423-f29c54fcc9ef {{(pid=92083) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 17 05:45:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0bd0f0db-57ea-4c44-ab73-bd56ba6500c3 tempest-VolumesSnapshotTestJSON-145827129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.884s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:45:24 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-0bd0f0db-57ea-4c44-ab73-bd56ba6500c3 tempest-VolumesSnapshotTestJSON-145827129 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:45:24 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-0bd0f0db-57ea-4c44-ab73-bd56ba6500c3 tempest-VolumesSnapshotTestJSON-145827129 None] Deleted volume successfully. Jun 17 05:45:24 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed20332-0c39-4a59-bc32-080be33f878f]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:45:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-525d952c-485d-4b0e-b4c4-25f3d2ae52dc tempest-SnapshotsActionsTest-2140039854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:45:24 devstack sudo[99549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-32c260c5-65d3-4292-be07-5296ac8138fe Jun 17 05:45:24 devstack sudo[99549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:45:24 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-0bd0f0db-57ea-4c44-ab73-bd56ba6500c3 tempest-VolumesSnapshotTestJSON-145827129 None] Lock "cinder-a9066415-1a82-491f-9439-79daedc3911a-delete_volume" released by "delete_volume" :: held 2.758s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:45:24 devstack sudo[99865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd Jun 17 05:45:24 devstack sudo[99865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:45:25 devstack sudo[99549]: pam_unix(sudo:session): session closed for user root Jun 17 05:45:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f4b77db9-04a4-439d-828d-e975d3b5e704 tempest-VolumesSnapshotTestJSON-145827129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-32c260c5-65d3-4292-be07-5296ac8138fe" returned: 0 in 0.936s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:45:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f4b77db9-04a4-439d-828d-e975d3b5e704 tempest-VolumesSnapshotTestJSON-145827129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-32c260c5-65d3-4292-be07-5296ac8138fe {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:45:25 devstack sudo[99906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-32c260c5-65d3-4292-be07-5296ac8138fe Jun 17 05:45:25 devstack sudo[99906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:45:25 devstack sudo[99865]: pam_unix(sudo:session): session closed for user root Jun 17 05:45:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-525d952c-485d-4b0e-b4c4-25f3d2ae52dc tempest-SnapshotsActionsTest-2140039854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd" returned: 0 in 1.086s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:45:25 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-525d952c-485d-4b0e-b4c4-25f3d2ae52dc tempest-SnapshotsActionsTest-2140039854 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92083) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 05:45:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-525d952c-485d-4b0e-b4c4-25f3d2ae52dc tempest-SnapshotsActionsTest-2140039854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.e401b0b8-a67e-45d0-af67-95c583edc62f 1G {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:45:25 devstack sudo[99913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.e401b0b8-a67e-45d0-af67-95c583edc62f 1G Jun 17 05:45:25 devstack sudo[99913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:45:25 devstack sudo[99906]: pam_unix(sudo:session): session closed for user root Jun 17 05:45:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f4b77db9-04a4-439d-828d-e975d3b5e704 tempest-VolumesSnapshotTestJSON-145827129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-32c260c5-65d3-4292-be07-5296ac8138fe" returned: 0 in 0.738s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:45:25 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-f4b77db9-04a4-439d-828d-e975d3b5e704 tempest-VolumesSnapshotTestJSON-145827129 None] Lock "cinder-quobyte-32c260c5-65d3-4292-be07-5296ac8138fe" released by "delete_volume" :: held 1.792s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:45:25 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-f4b77db9-04a4-439d-828d-e975d3b5e704 tempest-VolumesSnapshotTestJSON-145827129 None] Created reservations ['33e005c7-4256-4a37-83a1-77025affe2c7', 'a51bab44-6ac0-4664-9a69-334b4d8597bc', 'b4fe9dc3-fddf-43ba-819e-ea2921214c19', 'a12a1e16-f64c-431c-8db7-a7ba87aa151d'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:45:26 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-f4b77db9-04a4-439d-828d-e975d3b5e704 tempest-VolumesSnapshotTestJSON-145827129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:45:26 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-f4b77db9-04a4-439d-828d-e975d3b5e704 tempest-VolumesSnapshotTestJSON-145827129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:45:26 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-f4b77db9-04a4-439d-828d-e975d3b5e704 tempest-VolumesSnapshotTestJSON-145827129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:45:26 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-f4b77db9-04a4-439d-828d-e975d3b5e704 tempest-VolumesSnapshotTestJSON-145827129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:45:26 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-f4b77db9-04a4-439d-828d-e975d3b5e704 tempest-VolumesSnapshotTestJSON-145827129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:45:26 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f4b77db9-04a4-439d-828d-e975d3b5e704 tempest-VolumesSnapshotTestJSON-145827129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:45:26 devstack sudo[99920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:45:26 devstack sudo[99920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:45:26 devstack sudo[99913]: pam_unix(sudo:session): session closed for user root Jun 17 05:45:26 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-525d952c-485d-4b0e-b4c4-25f3d2ae52dc tempest-SnapshotsActionsTest-2140039854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.e401b0b8-a67e-45d0-af67-95c583edc62f 1G" returned: 0 in 0.839s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:45:26 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-525d952c-485d-4b0e-b4c4-25f3d2ae52dc tempest-SnapshotsActionsTest-2140039854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.e401b0b8-a67e-45d0-af67-95c583edc62f {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:45:26 devstack sudo[99922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.e401b0b8-a67e-45d0-af67-95c583edc62f Jun 17 05:45:26 devstack sudo[99922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:45:26 devstack sudo[99920]: pam_unix(sudo:session): session closed for user root Jun 17 05:45:26 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f4b77db9-04a4-439d-828d-e975d3b5e704 tempest-VolumesSnapshotTestJSON-145827129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.695s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:45:26 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-f4b77db9-04a4-439d-828d-e975d3b5e704 tempest-VolumesSnapshotTestJSON-145827129 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:45:26 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-f4b77db9-04a4-439d-828d-e975d3b5e704 tempest-VolumesSnapshotTestJSON-145827129 None] Deleted volume successfully. Jun 17 05:45:26 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-f4b77db9-04a4-439d-828d-e975d3b5e704 tempest-VolumesSnapshotTestJSON-145827129 None] Lock "cinder-32c260c5-65d3-4292-be07-5296ac8138fe-delete_volume" released by "delete_volume" :: held 2.776s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:45:27 devstack sudo[99922]: pam_unix(sudo:session): session closed for user root Jun 17 05:45:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-525d952c-485d-4b0e-b4c4-25f3d2ae52dc tempest-SnapshotsActionsTest-2140039854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.e401b0b8-a67e-45d0-af67-95c583edc62f" returned: 0 in 0.753s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:45:27 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [None req-525d952c-485d-4b0e-b4c4-25f3d2ae52dc tempest-SnapshotsActionsTest-2140039854 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.e401b0b8-a67e-45d0-af67-95c583edc62f is being set with open permissions: ugo+rw Jun 17 05:45:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-525d952c-485d-4b0e-b4c4-25f3d2ae52dc tempest-SnapshotsActionsTest-2140039854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.e401b0b8-a67e-45d0-af67-95c583edc62f {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:45:27 devstack sudo[99933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.e401b0b8-a67e-45d0-af67-95c583edc62f Jun 17 05:45:27 devstack sudo[99933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:45:27 devstack cinder-volume[92083]: DEBUG oslo_service.periodic_task [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92083) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 05:45:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:45:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:45:27 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:45:27 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:45:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:45:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:45:27 devstack sudo[99936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:45:27 devstack sudo[99936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:45:27 devstack sudo[99933]: pam_unix(sudo:session): session closed for user root Jun 17 05:45:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-525d952c-485d-4b0e-b4c4-25f3d2ae52dc tempest-SnapshotsActionsTest-2140039854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.e401b0b8-a67e-45d0-af67-95c583edc62f" returned: 0 in 0.673s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:45:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-525d952c-485d-4b0e-b4c4-25f3d2ae52dc tempest-SnapshotsActionsTest-2140039854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.498s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:45:27 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-525d952c-485d-4b0e-b4c4-25f3d2ae52dc tempest-SnapshotsActionsTest-2140039854 None] Create snapshot completed successfully Jun 17 05:45:28 devstack sudo[99936]: pam_unix(sudo:session): session closed for user root Jun 17 05:45:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.732s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:45:28 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:45:28 devstack cinder-volume[92083]: DEBUG oslo_service.periodic_task [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running periodic task VolumeManager._thread_info {{(pid=92083) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 05:45:28 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] thread count: 8 {{(pid=92083) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 17 05:45:28 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] thread info: [<_MainThread(MainThread, started 133483869905024)>, , , , , , , ] {{(pid=92083) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 17 05:45:28 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-e4227f35-831e-4743-822c-c9f1ef3c7ace tempest-SnapshotsActionsTest-1752299106 None] Acquiring lock "cinder-e401b0b8-a67e-45d0-af67-95c583edc62f-delete_snapshot" by "delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:45:28 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-e4227f35-831e-4743-822c-c9f1ef3c7ace tempest-SnapshotsActionsTest-1752299106 None] Lock "cinder-e401b0b8-a67e-45d0-af67-95c583edc62f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:45:28 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-e4227f35-831e-4743-822c-c9f1ef3c7ace tempest-SnapshotsActionsTest-1752299106 None] Acquiring lock "cinder-quobyte-35d4c519-6d52-4aab-9423-f29c54fcc9ef" by "delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:45:28 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-e4227f35-831e-4743-822c-c9f1ef3c7ace tempest-SnapshotsActionsTest-1752299106 None] Lock "cinder-quobyte-35d4c519-6d52-4aab-9423-f29c54fcc9ef" acquired by "delete_snapshot" :: waited 0.026s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:45:28 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-e4227f35-831e-4743-822c-c9f1ef3c7ace tempest-SnapshotsActionsTest-1752299106 None] Acquiring lock "cinder-quobyte-e401b0b8-a67e-45d0-af67-95c583edc62f" by "_delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:45:28 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-e4227f35-831e-4743-822c-c9f1ef3c7ace tempest-SnapshotsActionsTest-1752299106 None] Lock "cinder-quobyte-e401b0b8-a67e-45d0-af67-95c583edc62f" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:45:28 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-e4227f35-831e-4743-822c-c9f1ef3c7ace tempest-SnapshotsActionsTest-1752299106 None] Deleting offline snapshot e401b0b8-a67e-45d0-af67-95c583edc62f of volume 35d4c519-6d52-4aab-9423-f29c54fcc9ef {{(pid=92083) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 17 05:45:28 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-e4227f35-831e-4743-822c-c9f1ef3c7ace tempest-SnapshotsActionsTest-1752299106 None] snapshot_file for this snap is: volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.e401b0b8-a67e-45d0-af67-95c583edc62f {{(pid=92083) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 17 05:45:28 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[996d6110-1b20-4bed-88f4-3555d3bf900d]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:45:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e4227f35-831e-4743-822c-c9f1ef3c7ace tempest-SnapshotsActionsTest-1752299106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.e401b0b8-a67e-45d0-af67-95c583edc62f {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:45:29 devstack sudo[99990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.e401b0b8-a67e-45d0-af67-95c583edc62f Jun 17 05:45:29 devstack sudo[99990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:45:30 devstack sudo[99990]: pam_unix(sudo:session): session closed for user root Jun 17 05:45:30 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e4227f35-831e-4743-822c-c9f1ef3c7ace tempest-SnapshotsActionsTest-1752299106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.e401b0b8-a67e-45d0-af67-95c583edc62f" returned: 0 in 1.482s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:45:30 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-e4227f35-831e-4743-822c-c9f1ef3c7ace tempest-SnapshotsActionsTest-1752299106 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92083) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 05:45:30 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[310577e4-f4ec-4b64-94ee-d79644a8455e]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:45:30 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e4227f35-831e-4743-822c-c9f1ef3c7ace tempest-SnapshotsActionsTest-1752299106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:45:30 devstack sudo[100011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd Jun 17 05:45:30 devstack sudo[100011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:45:31 devstack sudo[100011]: pam_unix(sudo:session): session closed for user root Jun 17 05:45:31 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e4227f35-831e-4743-822c-c9f1ef3c7ace tempest-SnapshotsActionsTest-1752299106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd" returned: 0 in 1.195s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:45:31 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-e4227f35-831e-4743-822c-c9f1ef3c7ace tempest-SnapshotsActionsTest-1752299106 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92083) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 05:45:31 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e4227f35-831e-4743-822c-c9f1ef3c7ace tempest-SnapshotsActionsTest-1752299106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.e401b0b8-a67e-45d0-af67-95c583edc62f {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:45:31 devstack sudo[100018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.e401b0b8-a67e-45d0-af67-95c583edc62f Jun 17 05:45:31 devstack sudo[100018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:45:32 devstack sudo[100018]: pam_unix(sudo:session): session closed for user root Jun 17 05:45:32 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e4227f35-831e-4743-822c-c9f1ef3c7ace tempest-SnapshotsActionsTest-1752299106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.e401b0b8-a67e-45d0-af67-95c583edc62f" returned: 0 in 1.329s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:45:32 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e4227f35-831e-4743-822c-c9f1ef3c7ace tempest-SnapshotsActionsTest-1752299106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.e401b0b8-a67e-45d0-af67-95c583edc62f {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:45:33 devstack sudo[100027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.e401b0b8-a67e-45d0-af67-95c583edc62f Jun 17 05:45:33 devstack sudo[100027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:45:33 devstack sudo[100027]: pam_unix(sudo:session): session closed for user root Jun 17 05:45:33 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e4227f35-831e-4743-822c-c9f1ef3c7ace tempest-SnapshotsActionsTest-1752299106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.e401b0b8-a67e-45d0-af67-95c583edc62f" returned: 0 in 0.743s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:45:33 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-e4227f35-831e-4743-822c-c9f1ef3c7ace tempest-SnapshotsActionsTest-1752299106 None] Lock "cinder-quobyte-e401b0b8-a67e-45d0-af67-95c583edc62f" released by "_delete_snapshot" :: held 4.907s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:45:33 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-e4227f35-831e-4743-822c-c9f1ef3c7ace tempest-SnapshotsActionsTest-1752299106 None] Lock "cinder-quobyte-35d4c519-6d52-4aab-9423-f29c54fcc9ef" released by "delete_snapshot" :: held 4.950s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:45:33 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-e4227f35-831e-4743-822c-c9f1ef3c7ace tempest-SnapshotsActionsTest-1752299106 None] Created reservations ['1ed68071-6923-45c2-83bb-999a98f0cf4e', '4f021db1-5ddc-4ead-a93c-ece803ee7113', '113b6016-fbda-46a5-b661-4c5e7fc0dfd4', 'c6914229-6c81-45d1-bdee-95d40726cfcd'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:45:33 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-e4227f35-831e-4743-822c-c9f1ef3c7ace tempest-SnapshotsActionsTest-1752299106 None] Delete snapshot completed successfully. Jun 17 05:45:33 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-e4227f35-831e-4743-822c-c9f1ef3c7ace tempest-SnapshotsActionsTest-1752299106 None] Lock "cinder-e401b0b8-a67e-45d0-af67-95c583edc62f-delete_snapshot" released by "delete_snapshot" :: held 5.115s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:45:34 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-a490b854-bac9-4b79-a7e1-7e08553c46d1 tempest-SnapshotsActionsTest-2140039854 None] Acquiring lock "cinder-2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd-delete_snapshot" by "delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:45:34 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-a490b854-bac9-4b79-a7e1-7e08553c46d1 tempest-SnapshotsActionsTest-2140039854 None] Lock "cinder-2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:45:34 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-a490b854-bac9-4b79-a7e1-7e08553c46d1 tempest-SnapshotsActionsTest-2140039854 None] Acquiring lock "cinder-quobyte-35d4c519-6d52-4aab-9423-f29c54fcc9ef" by "delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:45:34 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-a490b854-bac9-4b79-a7e1-7e08553c46d1 tempest-SnapshotsActionsTest-2140039854 None] Lock "cinder-quobyte-35d4c519-6d52-4aab-9423-f29c54fcc9ef" acquired by "delete_snapshot" :: waited 0.023s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:45:34 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-a490b854-bac9-4b79-a7e1-7e08553c46d1 tempest-SnapshotsActionsTest-2140039854 None] Acquiring lock "cinder-quobyte-2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd" by "_delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:45:34 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-a490b854-bac9-4b79-a7e1-7e08553c46d1 tempest-SnapshotsActionsTest-2140039854 None] Lock "cinder-quobyte-2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:45:34 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-a490b854-bac9-4b79-a7e1-7e08553c46d1 tempest-SnapshotsActionsTest-2140039854 None] Deleting offline snapshot 2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd of volume 35d4c519-6d52-4aab-9423-f29c54fcc9ef {{(pid=92083) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 17 05:45:34 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-a490b854-bac9-4b79-a7e1-7e08553c46d1 tempest-SnapshotsActionsTest-2140039854 None] snapshot_file for this snap is: volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd {{(pid=92083) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 17 05:45:34 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[9564a8e4-3437-4dc0-936e-df547462c729]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:45:34 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a490b854-bac9-4b79-a7e1-7e08553c46d1 tempest-SnapshotsActionsTest-2140039854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:45:34 devstack sudo[100030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd Jun 17 05:45:34 devstack sudo[100030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:45:35 devstack sudo[100030]: pam_unix(sudo:session): session closed for user root Jun 17 05:45:35 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a490b854-bac9-4b79-a7e1-7e08553c46d1 tempest-SnapshotsActionsTest-2140039854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd" returned: 0 in 0.923s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:45:35 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-a490b854-bac9-4b79-a7e1-7e08553c46d1 tempest-SnapshotsActionsTest-2140039854 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92083) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 05:45:35 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[848305d5-67f8-447a-a49d-59fa4c4fb259]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:45:35 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a490b854-bac9-4b79-a7e1-7e08553c46d1 tempest-SnapshotsActionsTest-2140039854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:45:36 devstack sudo[100036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef Jun 17 05:45:36 devstack sudo[100036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:45:36 devstack sudo[100036]: pam_unix(sudo:session): session closed for user root Jun 17 05:45:36 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a490b854-bac9-4b79-a7e1-7e08553c46d1 tempest-SnapshotsActionsTest-2140039854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef" returned: 0 in 0.878s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:45:36 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a490b854-bac9-4b79-a7e1-7e08553c46d1 tempest-SnapshotsActionsTest-2140039854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:45:36 devstack sudo[100041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd Jun 17 05:45:36 devstack sudo[100041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:45:37 devstack sudo[100041]: pam_unix(sudo:session): session closed for user root Jun 17 05:45:37 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a490b854-bac9-4b79-a7e1-7e08553c46d1 tempest-SnapshotsActionsTest-2140039854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd" returned: 0 in 0.825s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:45:37 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a490b854-bac9-4b79-a7e1-7e08553c46d1 tempest-SnapshotsActionsTest-2140039854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:45:37 devstack sudo[100048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd Jun 17 05:45:37 devstack sudo[100048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:45:38 devstack sudo[100048]: pam_unix(sudo:session): session closed for user root Jun 17 05:45:38 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a490b854-bac9-4b79-a7e1-7e08553c46d1 tempest-SnapshotsActionsTest-2140039854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef.2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd" returned: 0 in 0.723s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:45:38 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-a490b854-bac9-4b79-a7e1-7e08553c46d1 tempest-SnapshotsActionsTest-2140039854 None] Lock "cinder-quobyte-2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd" released by "_delete_snapshot" :: held 3.525s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:45:38 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-a490b854-bac9-4b79-a7e1-7e08553c46d1 tempest-SnapshotsActionsTest-2140039854 None] Lock "cinder-quobyte-35d4c519-6d52-4aab-9423-f29c54fcc9ef" released by "delete_snapshot" :: held 3.557s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:45:38 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-a490b854-bac9-4b79-a7e1-7e08553c46d1 tempest-SnapshotsActionsTest-2140039854 None] Created reservations ['01125845-ccf9-40f1-b903-2b5fe69a2198', '90d01b2d-90a1-40e2-92d8-52813118a224', '7d69dcbb-ac1c-41c6-bfdb-a145869db21f', '9eafadb8-484e-4d39-be18-9c8ce97ec8a8'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:45:38 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-a490b854-bac9-4b79-a7e1-7e08553c46d1 tempest-SnapshotsActionsTest-2140039854 None] Delete snapshot completed successfully. Jun 17 05:45:38 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-a490b854-bac9-4b79-a7e1-7e08553c46d1 tempest-SnapshotsActionsTest-2140039854 None] Lock "cinder-2da21b67-8f23-4c6e-ae1d-227c9ce3b5dd-delete_snapshot" released by "delete_snapshot" :: held 3.905s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:45:39 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-aaadeda8-641a-4d85-b817-afb178f0fcdf tempest-SnapshotsActionsTest-2140039854 None] Acquiring lock "cinder-35d4c519-6d52-4aab-9423-f29c54fcc9ef-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:45:39 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-aaadeda8-641a-4d85-b817-afb178f0fcdf tempest-SnapshotsActionsTest-2140039854 None] Lock "cinder-35d4c519-6d52-4aab-9423-f29c54fcc9ef-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:45:39 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-aaadeda8-641a-4d85-b817-afb178f0fcdf tempest-SnapshotsActionsTest-2140039854 None] Acquiring lock "cinder-quobyte-35d4c519-6d52-4aab-9423-f29c54fcc9ef" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:45:39 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-aaadeda8-641a-4d85-b817-afb178f0fcdf tempest-SnapshotsActionsTest-2140039854 None] Lock "cinder-quobyte-35d4c519-6d52-4aab-9423-f29c54fcc9ef" acquired by "delete_volume" :: waited 0.034s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:45:39 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[b460a07d-6033-41f6-baa9-3d8dffa339a6]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:45:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-aaadeda8-641a-4d85-b817-afb178f0fcdf tempest-SnapshotsActionsTest-2140039854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:45:39 devstack sudo[100052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef Jun 17 05:45:39 devstack sudo[100052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:45:40 devstack sudo[100052]: pam_unix(sudo:session): session closed for user root Jun 17 05:45:40 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-aaadeda8-641a-4d85-b817-afb178f0fcdf tempest-SnapshotsActionsTest-2140039854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef" returned: 0 in 1.267s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:45:40 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-aaadeda8-641a-4d85-b817-afb178f0fcdf tempest-SnapshotsActionsTest-2140039854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:45:40 devstack sudo[100074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef Jun 17 05:45:40 devstack sudo[100074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:45:41 devstack sudo[100074]: pam_unix(sudo:session): session closed for user root Jun 17 05:45:41 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-aaadeda8-641a-4d85-b817-afb178f0fcdf tempest-SnapshotsActionsTest-2140039854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-35d4c519-6d52-4aab-9423-f29c54fcc9ef" returned: 0 in 0.798s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:45:41 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-aaadeda8-641a-4d85-b817-afb178f0fcdf tempest-SnapshotsActionsTest-2140039854 None] Lock "cinder-quobyte-35d4c519-6d52-4aab-9423-f29c54fcc9ef" released by "delete_volume" :: held 2.168s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:45:41 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-aaadeda8-641a-4d85-b817-afb178f0fcdf tempest-SnapshotsActionsTest-2140039854 None] Created reservations ['0abded64-b35e-457a-8c21-a126afe2bcfe', 'c7a28578-6d81-4a07-a43a-2541a0959e71', 'b6d60ba1-7568-4f7d-ae90-08506a13167c', 'c8cb47ff-9e3f-4b82-b999-1f14f6a20f23'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:45:41 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-aaadeda8-641a-4d85-b817-afb178f0fcdf tempest-SnapshotsActionsTest-2140039854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:45:41 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-aaadeda8-641a-4d85-b817-afb178f0fcdf tempest-SnapshotsActionsTest-2140039854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:45:41 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-aaadeda8-641a-4d85-b817-afb178f0fcdf tempest-SnapshotsActionsTest-2140039854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:45:41 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-aaadeda8-641a-4d85-b817-afb178f0fcdf tempest-SnapshotsActionsTest-2140039854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:45:41 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-aaadeda8-641a-4d85-b817-afb178f0fcdf tempest-SnapshotsActionsTest-2140039854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:45:41 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-aaadeda8-641a-4d85-b817-afb178f0fcdf tempest-SnapshotsActionsTest-2140039854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:45:41 devstack sudo[100077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:45:41 devstack sudo[100077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:45:42 devstack sudo[100077]: pam_unix(sudo:session): session closed for user root Jun 17 05:45:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-aaadeda8-641a-4d85-b817-afb178f0fcdf tempest-SnapshotsActionsTest-2140039854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.720s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:45:42 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-aaadeda8-641a-4d85-b817-afb178f0fcdf tempest-SnapshotsActionsTest-2140039854 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:45:42 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-aaadeda8-641a-4d85-b817-afb178f0fcdf tempest-SnapshotsActionsTest-2140039854 None] Deleted volume successfully. Jun 17 05:45:42 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-aaadeda8-641a-4d85-b817-afb178f0fcdf tempest-SnapshotsActionsTest-2140039854 None] Lock "cinder-35d4c519-6d52-4aab-9423-f29c54fcc9ef-delete_volume" released by "delete_volume" :: held 3.200s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:45:51 devstack cinder-volume[92083]: DEBUG dbcounter [-] [92083] Writing DB stats cinder:SELECT=64,cinder:INSERT=19,cinder:UPDATE=62,cinder:DELETE=4 {{(pid=92083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:45:52 devstack cinder-volume[92083]: DEBUG dbcounter [-] [92083] Writing DB stats cinder:UPDATE=73,cinder:SELECT=51,cinder:INSERT=18,cinder:DELETE=4 {{(pid=92083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:46:03 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-2ab23f2a-eae3-416a-9262-d9b6e0c9f4c6 tempest-AttachVolumeShelveTestJSON-18917466 None] Acquiring lock "cinder-4578d47f-5034-4726-bf92-cd551c4b7ee0-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:46:03 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-2ab23f2a-eae3-416a-9262-d9b6e0c9f4c6 tempest-AttachVolumeShelveTestJSON-18917466 None] Lock "cinder-4578d47f-5034-4726-bf92-cd551c4b7ee0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:46:03 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-2ab23f2a-eae3-416a-9262-d9b6e0c9f4c6 tempest-AttachVolumeShelveTestJSON-18917466 None] Acquiring lock "cinder-quobyte-4578d47f-5034-4726-bf92-cd551c4b7ee0" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:46:03 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-2ab23f2a-eae3-416a-9262-d9b6e0c9f4c6 tempest-AttachVolumeShelveTestJSON-18917466 None] Lock "cinder-quobyte-4578d47f-5034-4726-bf92-cd551c4b7ee0" acquired by "delete_volume" :: waited 0.018s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:46:03 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c82e7f-678f-41dc-aaa4-d8a542469586]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:46:03 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-2ab23f2a-eae3-416a-9262-d9b6e0c9f4c6 tempest-AttachVolumeShelveTestJSON-18917466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4578d47f-5034-4726-bf92-cd551c4b7ee0 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:46:03 devstack sudo[100236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4578d47f-5034-4726-bf92-cd551c4b7ee0 Jun 17 05:46:03 devstack sudo[100236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:46:04 devstack sudo[100236]: pam_unix(sudo:session): session closed for user root Jun 17 05:46:04 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-2ab23f2a-eae3-416a-9262-d9b6e0c9f4c6 tempest-AttachVolumeShelveTestJSON-18917466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4578d47f-5034-4726-bf92-cd551c4b7ee0" returned: 0 in 0.731s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:46:04 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-2ab23f2a-eae3-416a-9262-d9b6e0c9f4c6 tempest-AttachVolumeShelveTestJSON-18917466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4578d47f-5034-4726-bf92-cd551c4b7ee0 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:46:04 devstack sudo[100241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4578d47f-5034-4726-bf92-cd551c4b7ee0 Jun 17 05:46:04 devstack sudo[100241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:46:04 devstack sudo[100241]: pam_unix(sudo:session): session closed for user root Jun 17 05:46:04 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-2ab23f2a-eae3-416a-9262-d9b6e0c9f4c6 tempest-AttachVolumeShelveTestJSON-18917466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4578d47f-5034-4726-bf92-cd551c4b7ee0" returned: 0 in 0.706s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:46:04 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-2ab23f2a-eae3-416a-9262-d9b6e0c9f4c6 tempest-AttachVolumeShelveTestJSON-18917466 None] Lock "cinder-quobyte-4578d47f-5034-4726-bf92-cd551c4b7ee0" released by "delete_volume" :: held 1.490s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:46:04 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-2ab23f2a-eae3-416a-9262-d9b6e0c9f4c6 tempest-AttachVolumeShelveTestJSON-18917466 None] Created reservations ['a221bcb7-d520-4a29-bfbc-cd4715fb616a', '353e3598-1153-428e-a098-c5263f830905', '9a056971-b480-4208-b152-1d3a35bc6e0a', '03e94e29-f7b1-4bf2-9bdc-93c83faf35fb'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:46:04 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-2ab23f2a-eae3-416a-9262-d9b6e0c9f4c6 tempest-AttachVolumeShelveTestJSON-18917466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:46:04 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-2ab23f2a-eae3-416a-9262-d9b6e0c9f4c6 tempest-AttachVolumeShelveTestJSON-18917466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:46:04 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-2ab23f2a-eae3-416a-9262-d9b6e0c9f4c6 tempest-AttachVolumeShelveTestJSON-18917466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:46:04 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-2ab23f2a-eae3-416a-9262-d9b6e0c9f4c6 tempest-AttachVolumeShelveTestJSON-18917466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:46:04 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-2ab23f2a-eae3-416a-9262-d9b6e0c9f4c6 tempest-AttachVolumeShelveTestJSON-18917466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:46:04 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-2ab23f2a-eae3-416a-9262-d9b6e0c9f4c6 tempest-AttachVolumeShelveTestJSON-18917466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:46:04 devstack sudo[100244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:46:04 devstack sudo[100244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:46:05 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-bc41f10a-870e-4191-acad-868624754871 tempest-AttachVolumeShelveTestJSON-18917466 None] Acquiring lock "cinder-4bc4ff05-fc19-4d1e-bab3-dba182bab2c1-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:46:05 devstack sudo[100244]: pam_unix(sudo:session): session closed for user root Jun 17 05:46:05 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-bc41f10a-870e-4191-acad-868624754871 tempest-AttachVolumeShelveTestJSON-18917466 None] Lock "cinder-4bc4ff05-fc19-4d1e-bab3-dba182bab2c1-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:46:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-2ab23f2a-eae3-416a-9262-d9b6e0c9f4c6 tempest-AttachVolumeShelveTestJSON-18917466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.711s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:46:05 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-2ab23f2a-eae3-416a-9262-d9b6e0c9f4c6 tempest-AttachVolumeShelveTestJSON-18917466 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:46:05 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-2ab23f2a-eae3-416a-9262-d9b6e0c9f4c6 tempest-AttachVolumeShelveTestJSON-18917466 None] Deleted volume successfully. Jun 17 05:46:05 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-bc41f10a-870e-4191-acad-868624754871 tempest-AttachVolumeShelveTestJSON-18917466 None] Acquiring lock "cinder-quobyte-4bc4ff05-fc19-4d1e-bab3-dba182bab2c1" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:46:05 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-2ab23f2a-eae3-416a-9262-d9b6e0c9f4c6 tempest-AttachVolumeShelveTestJSON-18917466 None] Lock "cinder-4578d47f-5034-4726-bf92-cd551c4b7ee0-delete_volume" released by "delete_volume" :: held 2.474s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:46:05 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-bc41f10a-870e-4191-acad-868624754871 tempest-AttachVolumeShelveTestJSON-18917466 None] Lock "cinder-quobyte-4bc4ff05-fc19-4d1e-bab3-dba182bab2c1" acquired by "delete_volume" :: waited 0.027s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:46:05 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[54126a62-0dd6-4d9c-aeeb-914fb1858bd1]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:46:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-bc41f10a-870e-4191-acad-868624754871 tempest-AttachVolumeShelveTestJSON-18917466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4bc4ff05-fc19-4d1e-bab3-dba182bab2c1 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:46:05 devstack sudo[100247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4bc4ff05-fc19-4d1e-bab3-dba182bab2c1 Jun 17 05:46:05 devstack sudo[100247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:46:06 devstack sudo[100247]: pam_unix(sudo:session): session closed for user root Jun 17 05:46:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-bc41f10a-870e-4191-acad-868624754871 tempest-AttachVolumeShelveTestJSON-18917466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4bc4ff05-fc19-4d1e-bab3-dba182bab2c1" returned: 0 in 0.808s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:46:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-bc41f10a-870e-4191-acad-868624754871 tempest-AttachVolumeShelveTestJSON-18917466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4bc4ff05-fc19-4d1e-bab3-dba182bab2c1 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:46:06 devstack sudo[100266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4bc4ff05-fc19-4d1e-bab3-dba182bab2c1 Jun 17 05:46:06 devstack sudo[100266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:46:07 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdf5b064-693e-4f9d-9ce6-061f6cf50805 tempest-TestInstancesWithCinderVolumes-461180917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:46:07 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-cdf5b064-693e-4f9d-9ce6-061f6cf50805 tempest-TestInstancesWithCinderVolumes-461180917 None] Flow 'volume_create_manager' (e86421fa-8c0d-43f1-8f59-cd85f170b834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:46:07 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-cdf5b064-693e-4f9d-9ce6-061f6cf50805 tempest-TestInstancesWithCinderVolumes-461180917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4273d287-52ec-44a8-ace7-500a4f6d25ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:46:07 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-cdf5b064-693e-4f9d-9ce6-061f6cf50805 tempest-TestInstancesWithCinderVolumes-461180917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4273d287-52ec-44a8-ace7-500a4f6d25ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:46:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-594216455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eccf11ea-9b27-4d82-a92e-16647136f4fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4deb9b0135d4468aa03a3a94436c9ce1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:46:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:46:07Z,use_quota=True,user_id='8ceae2daa74c4e25bfeef4c43364da0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f08f4c2-b13e-4890-802b-58b25938d30b),volume_type_id=7f08f4c2-b13e-4890-802b-58b25938d30b)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:46:07 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-cdf5b064-693e-4f9d-9ce6-061f6cf50805 tempest-TestInstancesWithCinderVolumes-461180917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (605a34da-345d-4bc6-a5dc-4fc1a3440c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:46:07 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-cdf5b064-693e-4f9d-9ce6-061f6cf50805 tempest-TestInstancesWithCinderVolumes-461180917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (605a34da-345d-4bc6-a5dc-4fc1a3440c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:46:07 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-cdf5b064-693e-4f9d-9ce6-061f6cf50805 tempest-TestInstancesWithCinderVolumes-461180917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6a223e7-bde7-439f-a2ae-6e003dfa6df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:46:07 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-cdf5b064-693e-4f9d-9ce6-061f6cf50805 tempest-TestInstancesWithCinderVolumes-461180917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6a223e7-bde7-439f-a2ae-6e003dfa6df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eccf11ea-9b27-4d82-a92e-16647136f4fc', 'volume_name': 'volume-eccf11ea-9b27-4d82-a92e-16647136f4fc', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:46:07 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-cdf5b064-693e-4f9d-9ce6-061f6cf50805 tempest-TestInstancesWithCinderVolumes-461180917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1cc4de0-e0f9-4184-ba40-57d19862c8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:46:07 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-cdf5b064-693e-4f9d-9ce6-061f6cf50805 tempest-TestInstancesWithCinderVolumes-461180917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1cc4de0-e0f9-4184-ba40-57d19862c8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:46:07 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-cdf5b064-693e-4f9d-9ce6-061f6cf50805 tempest-TestInstancesWithCinderVolumes-461180917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a4b9263-d5ea-46d2-9382-77ec42e48b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:46:07 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-cdf5b064-693e-4f9d-9ce6-061f6cf50805 tempest-TestInstancesWithCinderVolumes-461180917 None] Volume eccf11ea-9b27-4d82-a92e-16647136f4fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eccf11ea-9b27-4d82-a92e-16647136f4fc', 'volume_size': 1} Jun 17 05:46:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-cdf5b064-693e-4f9d-9ce6-061f6cf50805 tempest-TestInstancesWithCinderVolumes-461180917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:46:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-cdf5b064-693e-4f9d-9ce6-061f6cf50805 tempest-TestInstancesWithCinderVolumes-461180917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:46:07 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-cdf5b064-693e-4f9d-9ce6-061f6cf50805 tempest-TestInstancesWithCinderVolumes-461180917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:46:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-594216455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eccf11ea-9b27-4d82-a92e-16647136f4fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4deb9b0135d4468aa03a3a94436c9ce1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:46:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:46:07Z,use_quota=True,user_id='8ceae2daa74c4e25bfeef4c43364da0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f08f4c2-b13e-4890-802b-58b25938d30b),volume_type_id=7f08f4c2-b13e-4890-802b-58b25938d30b)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:46:07 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-cdf5b064-693e-4f9d-9ce6-061f6cf50805 tempest-TestInstancesWithCinderVolumes-461180917 None] Creating volume eccf11ea-9b27-4d82-a92e-16647136f4fc {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:46:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-cdf5b064-693e-4f9d-9ce6-061f6cf50805 tempest-TestInstancesWithCinderVolumes-461180917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:46:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-cdf5b064-693e-4f9d-9ce6-061f6cf50805 tempest-TestInstancesWithCinderVolumes-461180917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:46:07 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-cdf5b064-693e-4f9d-9ce6-061f6cf50805 tempest-TestInstancesWithCinderVolumes-461180917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:46:07 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-cdf5b064-693e-4f9d-9ce6-061f6cf50805 tempest-TestInstancesWithCinderVolumes-461180917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:46:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-cdf5b064-693e-4f9d-9ce6-061f6cf50805 tempest-TestInstancesWithCinderVolumes-461180917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:46:07 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-cdf5b064-693e-4f9d-9ce6-061f6cf50805 tempest-TestInstancesWithCinderVolumes-461180917 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:46:07 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-cdf5b064-693e-4f9d-9ce6-061f6cf50805 tempest-TestInstancesWithCinderVolumes-461180917 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:46:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-cdf5b064-693e-4f9d-9ce6-061f6cf50805 tempest-TestInstancesWithCinderVolumes-461180917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-eccf11ea-9b27-4d82-a92e-16647136f4fc 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:46:07 devstack sudo[100266]: pam_unix(sudo:session): session closed for user root Jun 17 05:46:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-bc41f10a-870e-4191-acad-868624754871 tempest-AttachVolumeShelveTestJSON-18917466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4bc4ff05-fc19-4d1e-bab3-dba182bab2c1" returned: 0 in 0.876s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:46:07 devstack sudo[100269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-eccf11ea-9b27-4d82-a92e-16647136f4fc 1073741824 Jun 17 05:46:07 devstack sudo[100269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:46:07 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-bc41f10a-870e-4191-acad-868624754871 tempest-AttachVolumeShelveTestJSON-18917466 None] Lock "cinder-quobyte-4bc4ff05-fc19-4d1e-bab3-dba182bab2c1" released by "delete_volume" :: held 1.739s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:46:07 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-bc41f10a-870e-4191-acad-868624754871 tempest-AttachVolumeShelveTestJSON-18917466 None] Created reservations ['a16c5d99-ec82-4ac1-b3d3-d1c27d8fbfc6', 'f8e6ce41-666c-4116-a9c0-f347f38cd25b', '59da5381-00b3-4e2f-9ae5-57317cdf94f4', 'fd377e12-14a7-401a-b4da-b98968d084e7'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:46:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-bc41f10a-870e-4191-acad-868624754871 tempest-AttachVolumeShelveTestJSON-18917466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:46:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-bc41f10a-870e-4191-acad-868624754871 tempest-AttachVolumeShelveTestJSON-18917466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:46:07 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-bc41f10a-870e-4191-acad-868624754871 tempest-AttachVolumeShelveTestJSON-18917466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:46:07 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-bc41f10a-870e-4191-acad-868624754871 tempest-AttachVolumeShelveTestJSON-18917466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:46:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-bc41f10a-870e-4191-acad-868624754871 tempest-AttachVolumeShelveTestJSON-18917466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:46:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-bc41f10a-870e-4191-acad-868624754871 tempest-AttachVolumeShelveTestJSON-18917466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:46:07 devstack sudo[100271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:46:07 devstack sudo[100271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:46:07 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b74868f-7276-4744-b895-6490b07b739f tempest-TestInstancesWithCinderVolumes-461180917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:46:07 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8b74868f-7276-4744-b895-6490b07b739f tempest-TestInstancesWithCinderVolumes-461180917 None] Flow 'volume_create_manager' (41ff0ba1-af49-4d61-ad30-6ac7ea092946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:46:07 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8b74868f-7276-4744-b895-6490b07b739f tempest-TestInstancesWithCinderVolumes-461180917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca66b1fe-b422-44e7-bbd2-db50f04abfe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:46:07 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8b74868f-7276-4744-b895-6490b07b739f tempest-TestInstancesWithCinderVolumes-461180917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca66b1fe-b422-44e7-bbd2-db50f04abfe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:46:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1063663747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac1d52c8-46fe-45cc-a400-3acfb34dde06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4deb9b0135d4468aa03a3a94436c9ce1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:46:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:46:08Z,use_quota=True,user_id='8ceae2daa74c4e25bfeef4c43364da0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(160e2bb6-1e76-4bd5-837c-3c56fb4f3edc),volume_type_id=160e2bb6-1e76-4bd5-837c-3c56fb4f3edc)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:46:07 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8b74868f-7276-4744-b895-6490b07b739f tempest-TestInstancesWithCinderVolumes-461180917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (079d67d8-8d88-49ac-b9ef-83aaa5f9bc95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:46:07 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8b74868f-7276-4744-b895-6490b07b739f tempest-TestInstancesWithCinderVolumes-461180917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (079d67d8-8d88-49ac-b9ef-83aaa5f9bc95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:46:07 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8b74868f-7276-4744-b895-6490b07b739f tempest-TestInstancesWithCinderVolumes-461180917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5a4c878-c6ea-480a-b968-b742c012d68e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:46:07 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8b74868f-7276-4744-b895-6490b07b739f tempest-TestInstancesWithCinderVolumes-461180917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5a4c878-c6ea-480a-b968-b742c012d68e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac1d52c8-46fe-45cc-a400-3acfb34dde06', 'volume_name': 'volume-ac1d52c8-46fe-45cc-a400-3acfb34dde06', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:46:07 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8b74868f-7276-4744-b895-6490b07b739f tempest-TestInstancesWithCinderVolumes-461180917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de9a34f7-a9a8-4543-b245-6a98034a7547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:46:07 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8b74868f-7276-4744-b895-6490b07b739f tempest-TestInstancesWithCinderVolumes-461180917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de9a34f7-a9a8-4543-b245-6a98034a7547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:46:07 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8b74868f-7276-4744-b895-6490b07b739f tempest-TestInstancesWithCinderVolumes-461180917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76e33bdf-b517-4d5c-9135-1374b04ffd53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:46:07 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-8b74868f-7276-4744-b895-6490b07b739f tempest-TestInstancesWithCinderVolumes-461180917 None] Volume ac1d52c8-46fe-45cc-a400-3acfb34dde06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac1d52c8-46fe-45cc-a400-3acfb34dde06', 'volume_size': 1} Jun 17 05:46:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-8b74868f-7276-4744-b895-6490b07b739f tempest-TestInstancesWithCinderVolumes-461180917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:46:08 devstack sudo[100271]: pam_unix(sudo:session): session closed for user root Jun 17 05:46:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-bc41f10a-870e-4191-acad-868624754871 tempest-AttachVolumeShelveTestJSON-18917466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 1.208s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:46:08 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-bc41f10a-870e-4191-acad-868624754871 tempest-AttachVolumeShelveTestJSON-18917466 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:46:08 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-bc41f10a-870e-4191-acad-868624754871 tempest-AttachVolumeShelveTestJSON-18917466 None] Deleted volume successfully. Jun 17 05:46:08 devstack sudo[100269]: pam_unix(sudo:session): session closed for user root Jun 17 05:46:08 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-bc41f10a-870e-4191-acad-868624754871 tempest-AttachVolumeShelveTestJSON-18917466 None] Lock "cinder-4bc4ff05-fc19-4d1e-bab3-dba182bab2c1-delete_volume" released by "delete_volume" :: held 3.312s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:46:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-cdf5b064-693e-4f9d-9ce6-061f6cf50805 tempest-TestInstancesWithCinderVolumes-461180917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-eccf11ea-9b27-4d82-a92e-16647136f4fc 1073741824" returned: 0 in 1.541s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:46:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-cdf5b064-693e-4f9d-9ce6-061f6cf50805 tempest-TestInstancesWithCinderVolumes-461180917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-eccf11ea-9b27-4d82-a92e-16647136f4fc {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:46:09 devstack sudo[100279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-eccf11ea-9b27-4d82-a92e-16647136f4fc Jun 17 05:46:09 devstack sudo[100279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:46:09 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-b28fce85-3f05-42b9-9c70-f0ef96ad7034 tempest-TestInstancesWithCinderVolumes-461180917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:46:09 devstack sudo[100279]: pam_unix(sudo:session): session closed for user root Jun 17 05:46:09 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b28fce85-3f05-42b9-9c70-f0ef96ad7034 tempest-TestInstancesWithCinderVolumes-461180917 None] Flow 'volume_create_manager' (debef55a-3803-4c60-a1e2-8a4a6a3e83dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:46:09 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b28fce85-3f05-42b9-9c70-f0ef96ad7034 tempest-TestInstancesWithCinderVolumes-461180917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04cd46b7-89f3-4378-8699-5397ce4c2d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:46:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-cdf5b064-693e-4f9d-9ce6-061f6cf50805 tempest-TestInstancesWithCinderVolumes-461180917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-eccf11ea-9b27-4d82-a92e-16647136f4fc" returned: 0 in 0.980s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:46:09 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-cdf5b064-693e-4f9d-9ce6-061f6cf50805 tempest-TestInstancesWithCinderVolumes-461180917 None] <== create_volume: return (2594ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:46:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-cdf5b064-693e-4f9d-9ce6-061f6cf50805 tempest-TestInstancesWithCinderVolumes-461180917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.597s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:46:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-8b74868f-7276-4744-b895-6490b07b739f tempest-TestInstancesWithCinderVolumes-461180917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.020s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:46:09 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-8b74868f-7276-4744-b895-6490b07b739f tempest-TestInstancesWithCinderVolumes-461180917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:46:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1063663747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac1d52c8-46fe-45cc-a400-3acfb34dde06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4deb9b0135d4468aa03a3a94436c9ce1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:46:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:46:08Z,use_quota=True,user_id='8ceae2daa74c4e25bfeef4c43364da0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(160e2bb6-1e76-4bd5-837c-3c56fb4f3edc),volume_type_id=160e2bb6-1e76-4bd5-837c-3c56fb4f3edc)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:46:09 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-8b74868f-7276-4744-b895-6490b07b739f tempest-TestInstancesWithCinderVolumes-461180917 None] Creating volume ac1d52c8-46fe-45cc-a400-3acfb34dde06 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:46:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-8b74868f-7276-4744-b895-6490b07b739f tempest-TestInstancesWithCinderVolumes-461180917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:46:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-8b74868f-7276-4744-b895-6490b07b739f tempest-TestInstancesWithCinderVolumes-461180917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:46:09 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-8b74868f-7276-4744-b895-6490b07b739f tempest-TestInstancesWithCinderVolumes-461180917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:46:09 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-8b74868f-7276-4744-b895-6490b07b739f tempest-TestInstancesWithCinderVolumes-461180917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:46:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-8b74868f-7276-4744-b895-6490b07b739f tempest-TestInstancesWithCinderVolumes-461180917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:46:09 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-8b74868f-7276-4744-b895-6490b07b739f tempest-TestInstancesWithCinderVolumes-461180917 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:46:09 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-8b74868f-7276-4744-b895-6490b07b739f tempest-TestInstancesWithCinderVolumes-461180917 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:46:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8b74868f-7276-4744-b895-6490b07b739f tempest-TestInstancesWithCinderVolumes-461180917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ac1d52c8-46fe-45cc-a400-3acfb34dde06 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:46:10 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b28fce85-3f05-42b9-9c70-f0ef96ad7034 tempest-TestInstancesWithCinderVolumes-461180917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04cd46b7-89f3-4378-8699-5397ce4c2d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:46:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-313440914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a563a600-24a6-4a5a-ba89-efb07fb4fada,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4deb9b0135d4468aa03a3a94436c9ce1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:46:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:46:10Z,use_quota=True,user_id='8ceae2daa74c4e25bfeef4c43364da0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5a4c3093-d2ad-4a3d-b418-b23781c1714d),volume_type_id=5a4c3093-d2ad-4a3d-b418-b23781c1714d)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:46:10 devstack sudo[100282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ac1d52c8-46fe-45cc-a400-3acfb34dde06 1073741824 Jun 17 05:46:10 devstack sudo[100282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:46:10 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b28fce85-3f05-42b9-9c70-f0ef96ad7034 tempest-TestInstancesWithCinderVolumes-461180917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04daea84-82b3-45db-8b8e-7f684eff73fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:46:10 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b28fce85-3f05-42b9-9c70-f0ef96ad7034 tempest-TestInstancesWithCinderVolumes-461180917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04daea84-82b3-45db-8b8e-7f684eff73fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:46:10 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b28fce85-3f05-42b9-9c70-f0ef96ad7034 tempest-TestInstancesWithCinderVolumes-461180917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3ed4ce3-5b14-47c0-88af-26534d769c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:46:10 devstack cinder-volume[92083]: DEBUG cinder.image.glance [None req-b28fce85-3f05-42b9-9c70-f0ef96ad7034 tempest-TestInstancesWithCinderVolumes-461180917 None] Creating Keystone auth plugin from conf {{(pid=92083) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 17 05:46:10 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-cdf5b064-693e-4f9d-9ce6-061f6cf50805 tempest-TestInstancesWithCinderVolumes-461180917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a4b9263-d5ea-46d2-9382-77ec42e48b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eccf11ea-9b27-4d82-a92e-16647136f4fc', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:46:10 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-cdf5b064-693e-4f9d-9ce6-061f6cf50805 tempest-TestInstancesWithCinderVolumes-461180917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1b5e37d-a447-4836-86fc-d71f464d747f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:46:10 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-cdf5b064-693e-4f9d-9ce6-061f6cf50805 tempest-TestInstancesWithCinderVolumes-461180917 None] Volume volume-eccf11ea-9b27-4d82-a92e-16647136f4fc (eccf11ea-9b27-4d82-a92e-16647136f4fc): created successfully Jun 17 05:46:10 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-cdf5b064-693e-4f9d-9ce6-061f6cf50805 tempest-TestInstancesWithCinderVolumes-461180917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1b5e37d-a447-4836-86fc-d71f464d747f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:46:10 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-cdf5b064-693e-4f9d-9ce6-061f6cf50805 tempest-TestInstancesWithCinderVolumes-461180917 None] Flow 'volume_create_manager' (e86421fa-8c0d-43f1-8f59-cd85f170b834) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:46:10 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-cdf5b064-693e-4f9d-9ce6-061f6cf50805 tempest-TestInstancesWithCinderVolumes-461180917 None] Created volume successfully. Jun 17 05:46:10 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3c269dc-6715-43c5-9760-0841d912c80e tempest-VolumeQuotasNegativeTestJSON-1135439138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:46:10 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a3c269dc-6715-43c5-9760-0841d912c80e tempest-VolumeQuotasNegativeTestJSON-1135439138 None] Flow 'volume_create_manager' (7fa718c1-4d7e-4514-b8ca-344bfe4d2ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:46:10 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a3c269dc-6715-43c5-9760-0841d912c80e tempest-VolumeQuotasNegativeTestJSON-1135439138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (247745a2-b233-4229-bd3d-9702b72cd5db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:46:10 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a3c269dc-6715-43c5-9760-0841d912c80e tempest-VolumeQuotasNegativeTestJSON-1135439138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (247745a2-b233-4229-bd3d-9702b72cd5db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:46:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-50992461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a7797c9-f2fb-4dd1-afe0-6325ffe05396,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccc5f7f9ace94d69b7bb4d86a4184203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:46:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:46:10Z,use_quota=True,user_id='ae62f6506f6d468f86ce0a3b0fa26935',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:46:10 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a3c269dc-6715-43c5-9760-0841d912c80e tempest-VolumeQuotasNegativeTestJSON-1135439138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (404eeaeb-8df5-41fe-a5ba-cdb3d872cd03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:46:10 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a3c269dc-6715-43c5-9760-0841d912c80e tempest-VolumeQuotasNegativeTestJSON-1135439138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (404eeaeb-8df5-41fe-a5ba-cdb3d872cd03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:46:10 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a3c269dc-6715-43c5-9760-0841d912c80e tempest-VolumeQuotasNegativeTestJSON-1135439138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0053324-1eaa-417b-a487-91cb4ef4944c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:46:10 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a3c269dc-6715-43c5-9760-0841d912c80e tempest-VolumeQuotasNegativeTestJSON-1135439138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0053324-1eaa-417b-a487-91cb4ef4944c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a7797c9-f2fb-4dd1-afe0-6325ffe05396', 'volume_name': 'volume-7a7797c9-f2fb-4dd1-afe0-6325ffe05396', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:46:10 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a3c269dc-6715-43c5-9760-0841d912c80e tempest-VolumeQuotasNegativeTestJSON-1135439138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7027b563-48b2-40ff-b946-8c60ee5ccc9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:46:10 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a3c269dc-6715-43c5-9760-0841d912c80e tempest-VolumeQuotasNegativeTestJSON-1135439138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7027b563-48b2-40ff-b946-8c60ee5ccc9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:46:10 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a3c269dc-6715-43c5-9760-0841d912c80e tempest-VolumeQuotasNegativeTestJSON-1135439138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daaa3ba6-186f-4063-9904-71861fdff44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:46:10 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-a3c269dc-6715-43c5-9760-0841d912c80e tempest-VolumeQuotasNegativeTestJSON-1135439138 None] Volume 7a7797c9-f2fb-4dd1-afe0-6325ffe05396: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a7797c9-f2fb-4dd1-afe0-6325ffe05396', 'volume_size': 1} Jun 17 05:46:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-a3c269dc-6715-43c5-9760-0841d912c80e tempest-VolumeQuotasNegativeTestJSON-1135439138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:46:10 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b28fce85-3f05-42b9-9c70-f0ef96ad7034 tempest-TestInstancesWithCinderVolumes-461180917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3ed4ce3-5b14-47c0-88af-26534d769c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a563a600-24a6-4a5a-ba89-efb07fb4fada', 'volume_name': 'volume-a563a600-24a6-4a5a-ba89-efb07fb4fada', 'volume_size': 1, 'image_id': '02ab3431-8ef2-41ce-9847-951d9eaf4f39', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/02ab3431-8ef2-41ce-9847-951d9eaf4f39', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1865676723', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4deb9b0135d4468aa03a3a94436c9ce1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '02ab3431-8ef2-41ce-9847-951d9eaf4f39', 'created_at': datetime.datetime(2026, 6, 17, 3, 46, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 3, 46, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/02ab3431-8ef2-41ce-9847-951d9eaf4f39/file', 'properties': {}}, 'image_service': }' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:46:10 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b28fce85-3f05-42b9-9c70-f0ef96ad7034 tempest-TestInstancesWithCinderVolumes-461180917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d439861f-341d-4006-8ed2-3bbf6b5443c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:46:10 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b28fce85-3f05-42b9-9c70-f0ef96ad7034 tempest-TestInstancesWithCinderVolumes-461180917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d439861f-341d-4006-8ed2-3bbf6b5443c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:46:10 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b28fce85-3f05-42b9-9c70-f0ef96ad7034 tempest-TestInstancesWithCinderVolumes-461180917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3982012f-6cd6-4f26-8153-2998ad16ead6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:46:10 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-b28fce85-3f05-42b9-9c70-f0ef96ad7034 tempest-TestInstancesWithCinderVolumes-461180917 None] Volume a563a600-24a6-4a5a-ba89-efb07fb4fada: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a563a600-24a6-4a5a-ba89-efb07fb4fada', 'volume_size': 1, 'image_id': '02ab3431-8ef2-41ce-9847-951d9eaf4f39', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/02ab3431-8ef2-41ce-9847-951d9eaf4f39', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1865676723', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4deb9b0135d4468aa03a3a94436c9ce1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '02ab3431-8ef2-41ce-9847-951d9eaf4f39', 'created_at': datetime.datetime(2026, 6, 17, 3, 46, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 3, 46, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/02ab3431-8ef2-41ce-9847-951d9eaf4f39/file', 'properties': {}}, 'image_service': } Jun 17 05:46:10 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-b28fce85-3f05-42b9-9c70-f0ef96ad7034 tempest-TestInstancesWithCinderVolumes-461180917 None] Trying to clone a563a600-24a6-4a5a-ba89-efb07fb4fada from image 02ab3431-8ef2-41ce-9847-951d9eaf4f39 at location (None, [{'url': 'file:///opt/stack/data/glance/images/02ab3431-8ef2-41ce-9847-951d9eaf4f39', 'metadata': {}}]). {{(pid=92083) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 17 05:46:10 devstack sudo[100282]: pam_unix(sudo:session): session closed for user root Jun 17 05:46:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8b74868f-7276-4744-b895-6490b07b739f tempest-TestInstancesWithCinderVolumes-461180917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ac1d52c8-46fe-45cc-a400-3acfb34dde06 1073741824" returned: 0 in 0.937s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:46:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8b74868f-7276-4744-b895-6490b07b739f tempest-TestInstancesWithCinderVolumes-461180917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ac1d52c8-46fe-45cc-a400-3acfb34dde06 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:46:10 devstack sudo[100309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ac1d52c8-46fe-45cc-a400-3acfb34dde06 Jun 17 05:46:10 devstack sudo[100309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:46:11 devstack sudo[100309]: pam_unix(sudo:session): session closed for user root Jun 17 05:46:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8b74868f-7276-4744-b895-6490b07b739f tempest-TestInstancesWithCinderVolumes-461180917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ac1d52c8-46fe-45cc-a400-3acfb34dde06" returned: 0 in 0.643s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:46:11 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-8b74868f-7276-4744-b895-6490b07b739f tempest-TestInstancesWithCinderVolumes-461180917 None] <== create_volume: return (1629ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:46:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-8b74868f-7276-4744-b895-6490b07b739f tempest-TestInstancesWithCinderVolumes-461180917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.633s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:46:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-a3c269dc-6715-43c5-9760-0841d912c80e tempest-VolumeQuotasNegativeTestJSON-1135439138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.378s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:46:11 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-a3c269dc-6715-43c5-9760-0841d912c80e tempest-VolumeQuotasNegativeTestJSON-1135439138 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:46:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-50992461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a7797c9-f2fb-4dd1-afe0-6325ffe05396,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccc5f7f9ace94d69b7bb4d86a4184203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:46:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:46:10Z,use_quota=True,user_id='ae62f6506f6d468f86ce0a3b0fa26935',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:46:11 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-a3c269dc-6715-43c5-9760-0841d912c80e tempest-VolumeQuotasNegativeTestJSON-1135439138 None] Creating volume 7a7797c9-f2fb-4dd1-afe0-6325ffe05396 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:46:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-a3c269dc-6715-43c5-9760-0841d912c80e tempest-VolumeQuotasNegativeTestJSON-1135439138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:46:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-a3c269dc-6715-43c5-9760-0841d912c80e tempest-VolumeQuotasNegativeTestJSON-1135439138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:46:11 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-a3c269dc-6715-43c5-9760-0841d912c80e tempest-VolumeQuotasNegativeTestJSON-1135439138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:46:11 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-a3c269dc-6715-43c5-9760-0841d912c80e tempest-VolumeQuotasNegativeTestJSON-1135439138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:46:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-a3c269dc-6715-43c5-9760-0841d912c80e tempest-VolumeQuotasNegativeTestJSON-1135439138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:46:11 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-a3c269dc-6715-43c5-9760-0841d912c80e tempest-VolumeQuotasNegativeTestJSON-1135439138 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:46:11 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-a3c269dc-6715-43c5-9760-0841d912c80e tempest-VolumeQuotasNegativeTestJSON-1135439138 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:46:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a3c269dc-6715-43c5-9760-0841d912c80e tempest-VolumeQuotasNegativeTestJSON-1135439138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7a7797c9-f2fb-4dd1-afe0-6325ffe05396 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:46:11 devstack sudo[100312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7a7797c9-f2fb-4dd1-afe0-6325ffe05396 1073741824 Jun 17 05:46:11 devstack sudo[100312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:46:11 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8b74868f-7276-4744-b895-6490b07b739f tempest-TestInstancesWithCinderVolumes-461180917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76e33bdf-b517-4d5c-9135-1374b04ffd53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac1d52c8-46fe-45cc-a400-3acfb34dde06', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:46:11 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8b74868f-7276-4744-b895-6490b07b739f tempest-TestInstancesWithCinderVolumes-461180917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18a19b90-f1c0-4c0d-98fb-4bf0a84e0054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:46:11 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-8b74868f-7276-4744-b895-6490b07b739f tempest-TestInstancesWithCinderVolumes-461180917 None] Volume volume-ac1d52c8-46fe-45cc-a400-3acfb34dde06 (ac1d52c8-46fe-45cc-a400-3acfb34dde06): created successfully Jun 17 05:46:11 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8b74868f-7276-4744-b895-6490b07b739f tempest-TestInstancesWithCinderVolumes-461180917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18a19b90-f1c0-4c0d-98fb-4bf0a84e0054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:46:11 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8b74868f-7276-4744-b895-6490b07b739f tempest-TestInstancesWithCinderVolumes-461180917 None] Flow 'volume_create_manager' (41ff0ba1-af49-4d61-ad30-6ac7ea092946) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:46:11 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-8b74868f-7276-4744-b895-6490b07b739f tempest-TestInstancesWithCinderVolumes-461180917 None] Created volume successfully. Jun 17 05:46:12 devstack sudo[100312]: pam_unix(sudo:session): session closed for user root Jun 17 05:46:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a3c269dc-6715-43c5-9760-0841d912c80e tempest-VolumeQuotasNegativeTestJSON-1135439138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7a7797c9-f2fb-4dd1-afe0-6325ffe05396 1073741824" returned: 0 in 1.004s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:46:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a3c269dc-6715-43c5-9760-0841d912c80e tempest-VolumeQuotasNegativeTestJSON-1135439138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7a7797c9-f2fb-4dd1-afe0-6325ffe05396 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:46:12 devstack sudo[100320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7a7797c9-f2fb-4dd1-afe0-6325ffe05396 Jun 17 05:46:12 devstack sudo[100320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:46:13 devstack sudo[100320]: pam_unix(sudo:session): session closed for user root Jun 17 05:46:13 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a3c269dc-6715-43c5-9760-0841d912c80e tempest-VolumeQuotasNegativeTestJSON-1135439138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7a7797c9-f2fb-4dd1-afe0-6325ffe05396" returned: 0 in 0.760s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:46:13 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-a3c269dc-6715-43c5-9760-0841d912c80e tempest-VolumeQuotasNegativeTestJSON-1135439138 None] <== create_volume: return (1829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:46:13 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-a3c269dc-6715-43c5-9760-0841d912c80e tempest-VolumeQuotasNegativeTestJSON-1135439138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.834s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:46:13 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a3c269dc-6715-43c5-9760-0841d912c80e tempest-VolumeQuotasNegativeTestJSON-1135439138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daaa3ba6-186f-4063-9904-71861fdff44a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a7797c9-f2fb-4dd1-afe0-6325ffe05396', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:46:13 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a3c269dc-6715-43c5-9760-0841d912c80e tempest-VolumeQuotasNegativeTestJSON-1135439138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f46779e-8a3a-42a6-9220-da9bb98395d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:46:13 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-a3c269dc-6715-43c5-9760-0841d912c80e tempest-VolumeQuotasNegativeTestJSON-1135439138 None] Volume volume-7a7797c9-f2fb-4dd1-afe0-6325ffe05396 (7a7797c9-f2fb-4dd1-afe0-6325ffe05396): created successfully Jun 17 05:46:13 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a3c269dc-6715-43c5-9760-0841d912c80e tempest-VolumeQuotasNegativeTestJSON-1135439138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f46779e-8a3a-42a6-9220-da9bb98395d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:46:13 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a3c269dc-6715-43c5-9760-0841d912c80e tempest-VolumeQuotasNegativeTestJSON-1135439138 None] Flow 'volume_create_manager' (7fa718c1-4d7e-4514-b8ca-344bfe4d2ea3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:46:13 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-a3c269dc-6715-43c5-9760-0841d912c80e tempest-VolumeQuotasNegativeTestJSON-1135439138 None] Created volume successfully. Jun 17 05:46:15 devstack cinder-volume[92083]: DEBUG cinder.image.image_utils [None req-b28fce85-3f05-42b9-9c70-f0ef96ad7034 tempest-TestInstancesWithCinderVolumes-461180917 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_02ab3431-8ef2-41ce-9847-951d9eaf4f39_z9j659fjdevstack@QuobyteHD, size 20.69 MB, duration 4.39 sec {{(pid=92083) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 17 05:46:15 devstack cinder-volume[92083]: INFO cinder.image.image_utils [None req-b28fce85-3f05-42b9-9c70-f0ef96ad7034 tempest-TestInstancesWithCinderVolumes-461180917 None] Image download 20.69 MB at 4.71 MB/s Jun 17 05:46:15 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ea5303-f97f-4bcd-b0b6-0f7842fd2a80]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:46:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b28fce85-3f05-42b9-9c70-f0ef96ad7034 tempest-TestInstancesWithCinderVolumes-461180917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02ab3431-8ef2-41ce-9847-951d9eaf4f39_z9j659fjdevstack@QuobyteHD {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:46:15 devstack sudo[100363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02ab3431-8ef2-41ce-9847-951d9eaf4f39_z9j659fjdevstack@QuobyteHD Jun 17 05:46:15 devstack sudo[100363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:46:15 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-3f4df950-5e30-46bf-9ab9-c6d6e6e28773 tempest-VolumeQuotasNegativeTestJSON-1135439138 None] Acquiring lock "cinder-7a7797c9-f2fb-4dd1-afe0-6325ffe05396-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:46:15 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-3f4df950-5e30-46bf-9ab9-c6d6e6e28773 tempest-VolumeQuotasNegativeTestJSON-1135439138 None] Lock "cinder-7a7797c9-f2fb-4dd1-afe0-6325ffe05396-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:46:15 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-3f4df950-5e30-46bf-9ab9-c6d6e6e28773 tempest-VolumeQuotasNegativeTestJSON-1135439138 None] Acquiring lock "cinder-quobyte-7a7797c9-f2fb-4dd1-afe0-6325ffe05396" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:46:15 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-3f4df950-5e30-46bf-9ab9-c6d6e6e28773 tempest-VolumeQuotasNegativeTestJSON-1135439138 None] Lock "cinder-quobyte-7a7797c9-f2fb-4dd1-afe0-6325ffe05396" acquired by "delete_volume" :: waited 0.022s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:46:15 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f140635-42c9-43d1-a030-e69368db39f1]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:46:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-3f4df950-5e30-46bf-9ab9-c6d6e6e28773 tempest-VolumeQuotasNegativeTestJSON-1135439138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7a7797c9-f2fb-4dd1-afe0-6325ffe05396 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:46:15 devstack sudo[100365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7a7797c9-f2fb-4dd1-afe0-6325ffe05396 Jun 17 05:46:15 devstack sudo[100365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:46:16 devstack sudo[100363]: pam_unix(sudo:session): session closed for user root Jun 17 05:46:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b28fce85-3f05-42b9-9c70-f0ef96ad7034 tempest-TestInstancesWithCinderVolumes-461180917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02ab3431-8ef2-41ce-9847-951d9eaf4f39_z9j659fjdevstack@QuobyteHD" returned: 0 in 0.955s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:46:16 devstack cinder-volume[92083]: DEBUG cinder.image.image_utils [None req-b28fce85-3f05-42b9-9c70-f0ef96ad7034 tempest-TestInstancesWithCinderVolumes-461180917 None] Temporary image 02ab3431-8ef2-41ce-9847-951d9eaf4f39 is fetched for user 8ceae2daa74c4e25bfeef4c43364da0b. {{(pid=92083) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 17 05:46:16 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1939edf-d2ca-4ab7-aad6-de382c79dda7]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:46:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b28fce85-3f05-42b9-9c70-f0ef96ad7034 tempest-TestInstancesWithCinderVolumes-461180917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02ab3431-8ef2-41ce-9847-951d9eaf4f39_z9j659fjdevstack@QuobyteHD {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:46:16 devstack sudo[100371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02ab3431-8ef2-41ce-9847-951d9eaf4f39_z9j659fjdevstack@QuobyteHD Jun 17 05:46:16 devstack sudo[100371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:46:16 devstack sudo[100365]: pam_unix(sudo:session): session closed for user root Jun 17 05:46:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-3f4df950-5e30-46bf-9ab9-c6d6e6e28773 tempest-VolumeQuotasNegativeTestJSON-1135439138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7a7797c9-f2fb-4dd1-afe0-6325ffe05396" returned: 0 in 0.973s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:46:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-3f4df950-5e30-46bf-9ab9-c6d6e6e28773 tempest-VolumeQuotasNegativeTestJSON-1135439138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7a7797c9-f2fb-4dd1-afe0-6325ffe05396 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:46:16 devstack sudo[100377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7a7797c9-f2fb-4dd1-afe0-6325ffe05396 Jun 17 05:46:16 devstack sudo[100377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:46:16 devstack sudo[100371]: pam_unix(sudo:session): session closed for user root Jun 17 05:46:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b28fce85-3f05-42b9-9c70-f0ef96ad7034 tempest-TestInstancesWithCinderVolumes-461180917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02ab3431-8ef2-41ce-9847-951d9eaf4f39_z9j659fjdevstack@QuobyteHD" returned: 0 in 0.849s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:46:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-b28fce85-3f05-42b9-9c70-f0ef96ad7034 tempest-TestInstancesWithCinderVolumes-461180917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:46:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-b28fce85-3f05-42b9-9c70-f0ef96ad7034 tempest-TestInstancesWithCinderVolumes-461180917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:46:16 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-b28fce85-3f05-42b9-9c70-f0ef96ad7034 tempest-TestInstancesWithCinderVolumes-461180917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:46:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-313440914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a563a600-24a6-4a5a-ba89-efb07fb4fada,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4deb9b0135d4468aa03a3a94436c9ce1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:46:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:46:10Z,use_quota=True,user_id='8ceae2daa74c4e25bfeef4c43364da0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5a4c3093-d2ad-4a3d-b418-b23781c1714d),volume_type_id=5a4c3093-d2ad-4a3d-b418-b23781c1714d)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:46:16 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-b28fce85-3f05-42b9-9c70-f0ef96ad7034 tempest-TestInstancesWithCinderVolumes-461180917 None] Creating volume a563a600-24a6-4a5a-ba89-efb07fb4fada {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:46:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-b28fce85-3f05-42b9-9c70-f0ef96ad7034 tempest-TestInstancesWithCinderVolumes-461180917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:46:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-b28fce85-3f05-42b9-9c70-f0ef96ad7034 tempest-TestInstancesWithCinderVolumes-461180917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:46:16 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-b28fce85-3f05-42b9-9c70-f0ef96ad7034 tempest-TestInstancesWithCinderVolumes-461180917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:46:16 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-b28fce85-3f05-42b9-9c70-f0ef96ad7034 tempest-TestInstancesWithCinderVolumes-461180917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:46:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-b28fce85-3f05-42b9-9c70-f0ef96ad7034 tempest-TestInstancesWithCinderVolumes-461180917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:46:16 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-b28fce85-3f05-42b9-9c70-f0ef96ad7034 tempest-TestInstancesWithCinderVolumes-461180917 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:46:16 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-b28fce85-3f05-42b9-9c70-f0ef96ad7034 tempest-TestInstancesWithCinderVolumes-461180917 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:46:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b28fce85-3f05-42b9-9c70-f0ef96ad7034 tempest-TestInstancesWithCinderVolumes-461180917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a563a600-24a6-4a5a-ba89-efb07fb4fada 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:46:17 devstack sudo[100382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a563a600-24a6-4a5a-ba89-efb07fb4fada 1073741824 Jun 17 05:46:17 devstack sudo[100382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:46:17 devstack sudo[100377]: pam_unix(sudo:session): session closed for user root Jun 17 05:46:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-3f4df950-5e30-46bf-9ab9-c6d6e6e28773 tempest-VolumeQuotasNegativeTestJSON-1135439138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7a7797c9-f2fb-4dd1-afe0-6325ffe05396" returned: 0 in 0.623s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:46:17 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-3f4df950-5e30-46bf-9ab9-c6d6e6e28773 tempest-VolumeQuotasNegativeTestJSON-1135439138 None] Lock "cinder-quobyte-7a7797c9-f2fb-4dd1-afe0-6325ffe05396" released by "delete_volume" :: held 1.655s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:46:17 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-3f4df950-5e30-46bf-9ab9-c6d6e6e28773 tempest-VolumeQuotasNegativeTestJSON-1135439138 None] Created reservations ['51587631-f57f-4814-bde0-3c215d76ce10', '4014d76b-4f65-43a0-98aa-29f0cbb89fb8', '646afc2c-2cb5-429d-9892-33a94cfbe5b8', '6463c5b3-6efb-48be-ac41-bcd09b9033de'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:46:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-3f4df950-5e30-46bf-9ab9-c6d6e6e28773 tempest-VolumeQuotasNegativeTestJSON-1135439138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:46:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-3f4df950-5e30-46bf-9ab9-c6d6e6e28773 tempest-VolumeQuotasNegativeTestJSON-1135439138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:46:17 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-3f4df950-5e30-46bf-9ab9-c6d6e6e28773 tempest-VolumeQuotasNegativeTestJSON-1135439138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:46:17 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-3f4df950-5e30-46bf-9ab9-c6d6e6e28773 tempest-VolumeQuotasNegativeTestJSON-1135439138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:46:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-3f4df950-5e30-46bf-9ab9-c6d6e6e28773 tempest-VolumeQuotasNegativeTestJSON-1135439138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:46:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-3f4df950-5e30-46bf-9ab9-c6d6e6e28773 tempest-VolumeQuotasNegativeTestJSON-1135439138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:46:17 devstack sudo[100385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:46:17 devstack sudo[100385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:46:17 devstack sudo[100382]: pam_unix(sudo:session): session closed for user root Jun 17 05:46:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b28fce85-3f05-42b9-9c70-f0ef96ad7034 tempest-TestInstancesWithCinderVolumes-461180917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a563a600-24a6-4a5a-ba89-efb07fb4fada 1073741824" returned: 0 in 0.922s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:46:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b28fce85-3f05-42b9-9c70-f0ef96ad7034 tempest-TestInstancesWithCinderVolumes-461180917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a563a600-24a6-4a5a-ba89-efb07fb4fada {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:46:18 devstack sudo[100392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a563a600-24a6-4a5a-ba89-efb07fb4fada Jun 17 05:46:18 devstack sudo[100392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:46:18 devstack sudo[100385]: pam_unix(sudo:session): session closed for user root Jun 17 05:46:18 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-3f4df950-5e30-46bf-9ab9-c6d6e6e28773 tempest-VolumeQuotasNegativeTestJSON-1135439138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.937s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:46:18 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-3f4df950-5e30-46bf-9ab9-c6d6e6e28773 tempest-VolumeQuotasNegativeTestJSON-1135439138 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:46:18 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-3f4df950-5e30-46bf-9ab9-c6d6e6e28773 tempest-VolumeQuotasNegativeTestJSON-1135439138 None] Deleted volume successfully. Jun 17 05:46:18 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-3f4df950-5e30-46bf-9ab9-c6d6e6e28773 tempest-VolumeQuotasNegativeTestJSON-1135439138 None] Lock "cinder-7a7797c9-f2fb-4dd1-afe0-6325ffe05396-delete_volume" released by "delete_volume" :: held 2.857s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:46:18 devstack sudo[100392]: pam_unix(sudo:session): session closed for user root Jun 17 05:46:18 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b28fce85-3f05-42b9-9c70-f0ef96ad7034 tempest-TestInstancesWithCinderVolumes-461180917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a563a600-24a6-4a5a-ba89-efb07fb4fada" returned: 0 in 0.772s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:46:18 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-b28fce85-3f05-42b9-9c70-f0ef96ad7034 tempest-TestInstancesWithCinderVolumes-461180917 None] <== create_volume: return (1766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:46:18 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-b28fce85-3f05-42b9-9c70-f0ef96ad7034 tempest-TestInstancesWithCinderVolumes-461180917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.769s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:46:18 devstack cinder-volume[92083]: DEBUG cinder.volume.volume_utils [None req-b28fce85-3f05-42b9-9c70-f0ef96ad7034 tempest-TestInstancesWithCinderVolumes-461180917 None] Attempting download of 02ab3431-8ef2-41ce-9847-951d9eaf4f39 ((None, [{'url': 'file:///opt/stack/data/glance/images/02ab3431-8ef2-41ce-9847-951d9eaf4f39', 'metadata': {}}])) to volume a563a600-24a6-4a5a-ba89-efb07fb4fada. {{(pid=92083) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 17 05:46:18 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[05967d50-cc2f-4e4b-b328-068e314e6318]: (4, 'raw') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:46:18 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b28fce85-3f05-42b9-9c70-f0ef96ad7034 tempest-TestInstancesWithCinderVolumes-461180917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_02ab3431-8ef2-41ce-9847-951d9eaf4f39_7zxrxpla {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:46:18 devstack sudo[100397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_02ab3431-8ef2-41ce-9847-951d9eaf4f39_7zxrxpla Jun 17 05:46:18 devstack sudo[100397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:46:19 devstack sudo[100397]: pam_unix(sudo:session): session closed for user root Jun 17 05:46:19 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b28fce85-3f05-42b9-9c70-f0ef96ad7034 tempest-TestInstancesWithCinderVolumes-461180917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_02ab3431-8ef2-41ce-9847-951d9eaf4f39_7zxrxpla" returned: 0 in 0.791s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:46:19 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b28fce85-3f05-42b9-9c70-f0ef96ad7034 tempest-TestInstancesWithCinderVolumes-461180917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02ab3431-8ef2-41ce-9847-951d9eaf4f39_7zxrxpla {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:46:19 devstack sudo[100401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02ab3431-8ef2-41ce-9847-951d9eaf4f39_7zxrxpla Jun 17 05:46:19 devstack sudo[100401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:46:20 devstack sudo[100401]: pam_unix(sudo:session): session closed for user root Jun 17 05:46:20 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b28fce85-3f05-42b9-9c70-f0ef96ad7034 tempest-TestInstancesWithCinderVolumes-461180917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02ab3431-8ef2-41ce-9847-951d9eaf4f39_7zxrxpla" returned: 1 in 0.713s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:46:20 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b28fce85-3f05-42b9-9c70-f0ef96ad7034 tempest-TestInstancesWithCinderVolumes-461180917 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02ab3431-8ef2-41ce-9847-951d9eaf4f39_7zxrxpla' failed. Not Retrying. {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 05:46:20 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b27a948-e3f0-4617-8670-f09443d390e7]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:46:20 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b28fce85-3f05-42b9-9c70-f0ef96ad7034 tempest-TestInstancesWithCinderVolumes-461180917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02ab3431-8ef2-41ce-9847-951d9eaf4f39_z9j659fjdevstack@QuobyteHD {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:46:20 devstack sudo[100405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02ab3431-8ef2-41ce-9847-951d9eaf4f39_z9j659fjdevstack@QuobyteHD Jun 17 05:46:20 devstack sudo[100405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:46:21 devstack sudo[100405]: pam_unix(sudo:session): session closed for user root Jun 17 05:46:21 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b28fce85-3f05-42b9-9c70-f0ef96ad7034 tempest-TestInstancesWithCinderVolumes-461180917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02ab3431-8ef2-41ce-9847-951d9eaf4f39_z9j659fjdevstack@QuobyteHD" returned: 0 in 0.845s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:46:21 devstack cinder-volume[92083]: DEBUG cinder.image.image_utils [None req-b28fce85-3f05-42b9-9c70-f0ef96ad7034 tempest-TestInstancesWithCinderVolumes-461180917 None] 02ab3431-8ef2-41ce-9847-951d9eaf4f39 was qcow2, converting to raw {{(pid=92083) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 17 05:46:21 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b28fce85-3f05-42b9-9c70-f0ef96ad7034 tempest-TestInstancesWithCinderVolumes-461180917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_02ab3431-8ef2-41ce-9847-951d9eaf4f39_z9j659fjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a563a600-24a6-4a5a-ba89-efb07fb4fada {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:46:21 devstack sudo[100410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_02ab3431-8ef2-41ce-9847-951d9eaf4f39_z9j659fjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a563a600-24a6-4a5a-ba89-efb07fb4fada Jun 17 05:46:21 devstack sudo[100410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:46:23 devstack cinder-volume[92083]: INFO cinder.volume.manager [req-81e91740-a051-4d13-ad65-acc49a87c3b5 req-52627ae6-35ea-458c-990d-d59d3327e8c4 tempest-AttachVolumeNegativeTest-1827868215 None] Terminate volume connection completed successfully. Jun 17 05:46:23 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [req-81e91740-a051-4d13-ad65-acc49a87c3b5 req-52627ae6-35ea-458c-990d-d59d3327e8c4 tempest-AttachVolumeNegativeTest-1827868215 None] Deleting attachment 83423784-b9c0-4b49-9f00-59064213950f. {{(pid=92083) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 17 05:46:23 devstack sudo[100410]: pam_unix(sudo:session): session closed for user root Jun 17 05:46:23 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b28fce85-3f05-42b9-9c70-f0ef96ad7034 tempest-TestInstancesWithCinderVolumes-461180917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_02ab3431-8ef2-41ce-9847-951d9eaf4f39_z9j659fjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a563a600-24a6-4a5a-ba89-efb07fb4fada" returned: 0 in 2.388s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:46:23 devstack cinder-volume[92083]: DEBUG cinder.image.image_utils [None req-b28fce85-3f05-42b9-9c70-f0ef96ad7034 tempest-TestInstancesWithCinderVolumes-461180917 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_02ab3431-8ef2-41ce-9847-951d9eaf4f39_z9j659fjdevstack@QuobyteHD, size 112.00 MB, duration 2.39 sec, destination /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a563a600-24a6-4a5a-ba89-efb07fb4fada {{(pid=92083) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 17 05:46:23 devstack cinder-volume[92083]: INFO cinder.image.image_utils [None req-b28fce85-3f05-42b9-9c70-f0ef96ad7034 tempest-TestInstancesWithCinderVolumes-461180917 None] Converted 112.00 MB image at 46.88 MB/s Jun 17 05:46:23 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b28fce85-3f05-42b9-9c70-f0ef96ad7034 tempest-TestInstancesWithCinderVolumes-461180917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a563a600-24a6-4a5a-ba89-efb07fb4fada 1G {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:46:23 devstack sudo[100420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a563a600-24a6-4a5a-ba89-efb07fb4fada 1G Jun 17 05:46:23 devstack sudo[100420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:46:24 devstack sudo[100420]: pam_unix(sudo:session): session closed for user root Jun 17 05:46:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b28fce85-3f05-42b9-9c70-f0ef96ad7034 tempest-TestInstancesWithCinderVolumes-461180917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a563a600-24a6-4a5a-ba89-efb07fb4fada 1G" returned: 0 in 0.723s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:46:24 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f6f1c3-22e0-4d22-8e04-33cd50857dc3]: (4, 'raw') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:46:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b28fce85-3f05-42b9-9c70-f0ef96ad7034 tempest-TestInstancesWithCinderVolumes-461180917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a563a600-24a6-4a5a-ba89-efb07fb4fada {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:46:24 devstack sudo[100425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a563a600-24a6-4a5a-ba89-efb07fb4fada Jun 17 05:46:24 devstack sudo[100425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:46:25 devstack sudo[100425]: pam_unix(sudo:session): session closed for user root Jun 17 05:46:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b28fce85-3f05-42b9-9c70-f0ef96ad7034 tempest-TestInstancesWithCinderVolumes-461180917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a563a600-24a6-4a5a-ba89-efb07fb4fada" returned: 0 in 0.768s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:46:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b28fce85-3f05-42b9-9c70-f0ef96ad7034 tempest-TestInstancesWithCinderVolumes-461180917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a563a600-24a6-4a5a-ba89-efb07fb4fada {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:46:25 devstack sudo[100429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a563a600-24a6-4a5a-ba89-efb07fb4fada Jun 17 05:46:25 devstack sudo[100429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:46:26 devstack sudo[100429]: pam_unix(sudo:session): session closed for user root Jun 17 05:46:26 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b28fce85-3f05-42b9-9c70-f0ef96ad7034 tempest-TestInstancesWithCinderVolumes-461180917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a563a600-24a6-4a5a-ba89-efb07fb4fada" returned: 1 in 0.966s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:46:26 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b28fce85-3f05-42b9-9c70-f0ef96ad7034 tempest-TestInstancesWithCinderVolumes-461180917 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a563a600-24a6-4a5a-ba89-efb07fb4fada' failed. Not Retrying. {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 05:46:26 devstack cinder-volume[92083]: DEBUG cinder.volume.volume_utils [None req-b28fce85-3f05-42b9-9c70-f0ef96ad7034 tempest-TestInstancesWithCinderVolumes-461180917 None] Downloaded image 02ab3431-8ef2-41ce-9847-951d9eaf4f39 ((None, [{'url': 'file:///opt/stack/data/glance/images/02ab3431-8ef2-41ce-9847-951d9eaf4f39', 'metadata': {}}])) to volume a563a600-24a6-4a5a-ba89-efb07fb4fada successfully. {{(pid=92083) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 17 05:46:26 devstack cinder-volume[92083]: DEBUG cinder.image.image_utils [None req-b28fce85-3f05-42b9-9c70-f0ef96ad7034 tempest-TestInstancesWithCinderVolumes-461180917 None] Temporary image 02ab3431-8ef2-41ce-9847-951d9eaf4f39 for user 8ceae2daa74c4e25bfeef4c43364da0b is deleted. {{(pid=92083) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 17 05:46:26 devstack cinder-volume[92083]: DEBUG cinder.volume.volume_utils [None req-b28fce85-3f05-42b9-9c70-f0ef96ad7034 tempest-TestInstancesWithCinderVolumes-461180917 None] Marking volume a563a600-24a6-4a5a-ba89-efb07fb4fada as bootable. {{(pid=92083) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 17 05:46:26 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-b28fce85-3f05-42b9-9c70-f0ef96ad7034 tempest-TestInstancesWithCinderVolumes-461180917 None] Copying metadata from image 02ab3431-8ef2-41ce-9847-951d9eaf4f39 to a563a600-24a6-4a5a-ba89-efb07fb4fada. {{(pid=92083) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 17 05:46:26 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-b28fce85-3f05-42b9-9c70-f0ef96ad7034 tempest-TestInstancesWithCinderVolumes-461180917 None] Creating volume glance metadata for volume a563a600-24a6-4a5a-ba89-efb07fb4fada backed by image 02ab3431-8ef2-41ce-9847-951d9eaf4f39 with: {'image_id': '02ab3431-8ef2-41ce-9847-951d9eaf4f39', 'image_name': 'tempest-scenario-img--1865676723', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=92083) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 17 05:46:26 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b28fce85-3f05-42b9-9c70-f0ef96ad7034 tempest-TestInstancesWithCinderVolumes-461180917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3982012f-6cd6-4f26-8153-2998ad16ead6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a563a600-24a6-4a5a-ba89-efb07fb4fada', 'volume_size': 1, 'image_id': '02ab3431-8ef2-41ce-9847-951d9eaf4f39', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/02ab3431-8ef2-41ce-9847-951d9eaf4f39', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1865676723', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4deb9b0135d4468aa03a3a94436c9ce1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '02ab3431-8ef2-41ce-9847-951d9eaf4f39', 'created_at': datetime.datetime(2026, 6, 17, 3, 46, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 3, 46, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/02ab3431-8ef2-41ce-9847-951d9eaf4f39/file', 'properties': {}}, 'image_service': }' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:46:26 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b28fce85-3f05-42b9-9c70-f0ef96ad7034 tempest-TestInstancesWithCinderVolumes-461180917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39a6dcfa-3a6d-4ae9-9e24-35ed0a24e779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:46:26 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-b28fce85-3f05-42b9-9c70-f0ef96ad7034 tempest-TestInstancesWithCinderVolumes-461180917 None] Volume volume-a563a600-24a6-4a5a-ba89-efb07fb4fada (a563a600-24a6-4a5a-ba89-efb07fb4fada): created successfully Jun 17 05:46:26 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b28fce85-3f05-42b9-9c70-f0ef96ad7034 tempest-TestInstancesWithCinderVolumes-461180917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39a6dcfa-3a6d-4ae9-9e24-35ed0a24e779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:46:26 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b28fce85-3f05-42b9-9c70-f0ef96ad7034 tempest-TestInstancesWithCinderVolumes-461180917 None] Flow 'volume_create_manager' (debef55a-3803-4c60-a1e2-8a4a6a3e83dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:46:26 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-b28fce85-3f05-42b9-9c70-f0ef96ad7034 tempest-TestInstancesWithCinderVolumes-461180917 None] Created volume successfully. Jun 17 05:46:27 devstack cinder-volume[92083]: DEBUG oslo_service.periodic_task [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92083) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 05:46:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:46:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:46:27 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:46:27 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:46:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:46:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:46:27 devstack sudo[100511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:46:27 devstack sudo[100511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:46:28 devstack sudo[100511]: pam_unix(sudo:session): session closed for user root Jun 17 05:46:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.917s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:46:28 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:46:28 devstack cinder-volume[92083]: DEBUG oslo_service.periodic_task [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running periodic task VolumeManager._thread_info {{(pid=92083) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 05:46:28 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] thread count: 28 {{(pid=92083) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 17 05:46:28 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] thread info: [<_MainThread(MainThread, started 133483869905024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92083) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 17 05:46:31 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-06ddc9bf-8462-46d9-b246-17e4a41ffcfb tempest-VolumesImageMetadata-2020034901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:46:31 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-06ddc9bf-8462-46d9-b246-17e4a41ffcfb tempest-VolumesImageMetadata-2020034901 None] Flow 'volume_create_manager' (104aa10c-9596-4f1e-8286-29c527f8dd0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:46:31 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-06ddc9bf-8462-46d9-b246-17e4a41ffcfb tempest-VolumesImageMetadata-2020034901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f71a00b2-f4a3-4c63-9731-3b4edfc0a4bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:46:31 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-06ddc9bf-8462-46d9-b246-17e4a41ffcfb tempest-VolumesImageMetadata-2020034901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f71a00b2-f4a3-4c63-9731-3b4edfc0a4bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:46:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-579573250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21a32d10-4550-4ef3-a21d-92195dce75fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2f6e4c79398482d8c4ceef8e33d0273',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:46:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:46:32Z,use_quota=True,user_id='63fa35a0c5f848b0986c4c95a46b547b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:46:31 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-06ddc9bf-8462-46d9-b246-17e4a41ffcfb tempest-VolumesImageMetadata-2020034901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e19a9cd0-4a08-4c5b-a7ac-14b9a39086d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:46:31 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-06ddc9bf-8462-46d9-b246-17e4a41ffcfb tempest-VolumesImageMetadata-2020034901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e19a9cd0-4a08-4c5b-a7ac-14b9a39086d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:46:31 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-06ddc9bf-8462-46d9-b246-17e4a41ffcfb tempest-VolumesImageMetadata-2020034901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aceec9a-b7cb-4559-aa46-68410c2b0597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:46:31 devstack cinder-volume[92083]: DEBUG cinder.image.glance [None req-06ddc9bf-8462-46d9-b246-17e4a41ffcfb tempest-VolumesImageMetadata-2020034901 None] Creating Keystone auth plugin from conf {{(pid=92083) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 17 05:46:32 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-06ddc9bf-8462-46d9-b246-17e4a41ffcfb tempest-VolumesImageMetadata-2020034901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aceec9a-b7cb-4559-aa46-68410c2b0597) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '21a32d10-4550-4ef3-a21d-92195dce75fe', 'volume_name': 'volume-21a32d10-4550-4ef3-a21d-92195dce75fe', 'volume_size': 1, 'image_id': '3a392502-bf92-4019-8ad1-5b48db42b20f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3a392502-bf92-4019-8ad1-5b48db42b20f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd68ea14f86c14b8aac202e298736b075', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3a392502-bf92-4019-8ad1-5b48db42b20f', 'created_at': datetime.datetime(2026, 6, 17, 3, 31, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 3, 31, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3a392502-bf92-4019-8ad1-5b48db42b20f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:46:32 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-06ddc9bf-8462-46d9-b246-17e4a41ffcfb tempest-VolumesImageMetadata-2020034901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da85a17d-6047-477b-9ce8-7626f0b58f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:46:32 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-06ddc9bf-8462-46d9-b246-17e4a41ffcfb tempest-VolumesImageMetadata-2020034901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da85a17d-6047-477b-9ce8-7626f0b58f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:46:32 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-06ddc9bf-8462-46d9-b246-17e4a41ffcfb tempest-VolumesImageMetadata-2020034901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5383702-0331-449c-8584-7f8c5ace732c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:46:32 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-06ddc9bf-8462-46d9-b246-17e4a41ffcfb tempest-VolumesImageMetadata-2020034901 None] Volume 21a32d10-4550-4ef3-a21d-92195dce75fe: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-21a32d10-4550-4ef3-a21d-92195dce75fe', 'volume_size': 1, 'image_id': '3a392502-bf92-4019-8ad1-5b48db42b20f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3a392502-bf92-4019-8ad1-5b48db42b20f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd68ea14f86c14b8aac202e298736b075', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3a392502-bf92-4019-8ad1-5b48db42b20f', 'created_at': datetime.datetime(2026, 6, 17, 3, 31, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 3, 31, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3a392502-bf92-4019-8ad1-5b48db42b20f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 17 05:46:32 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-06ddc9bf-8462-46d9-b246-17e4a41ffcfb tempest-VolumesImageMetadata-2020034901 None] Trying to clone 21a32d10-4550-4ef3-a21d-92195dce75fe from image 3a392502-bf92-4019-8ad1-5b48db42b20f at location (None, [{'url': 'file:///opt/stack/data/glance/images/3a392502-bf92-4019-8ad1-5b48db42b20f', 'metadata': {}}]). {{(pid=92083) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 17 05:46:32 devstack cinder-volume[92083]: DEBUG cinder.image.image_utils [None req-06ddc9bf-8462-46d9-b246-17e4a41ffcfb tempest-VolumesImageMetadata-2020034901 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3a392502-bf92-4019-8ad1-5b48db42b20f_c0v6qxpodevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=92083) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 17 05:46:32 devstack cinder-volume[92083]: INFO cinder.image.image_utils [None req-06ddc9bf-8462-46d9-b246-17e4a41ffcfb tempest-VolumesImageMetadata-2020034901 None] Image download 20.69 MB at 20.69 MB/s Jun 17 05:46:32 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[9495770d-f72b-480c-85e5-55857c1a9277]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:46:32 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-06ddc9bf-8462-46d9-b246-17e4a41ffcfb tempest-VolumesImageMetadata-2020034901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a392502-bf92-4019-8ad1-5b48db42b20f_c0v6qxpodevstack@QuobyteHD {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:46:32 devstack sudo[100525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a392502-bf92-4019-8ad1-5b48db42b20f_c0v6qxpodevstack@QuobyteHD Jun 17 05:46:32 devstack sudo[100525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:46:33 devstack sudo[100525]: pam_unix(sudo:session): session closed for user root Jun 17 05:46:33 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-06ddc9bf-8462-46d9-b246-17e4a41ffcfb tempest-VolumesImageMetadata-2020034901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a392502-bf92-4019-8ad1-5b48db42b20f_c0v6qxpodevstack@QuobyteHD" returned: 0 in 0.762s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:46:33 devstack cinder-volume[92083]: DEBUG cinder.image.image_utils [None req-06ddc9bf-8462-46d9-b246-17e4a41ffcfb tempest-VolumesImageMetadata-2020034901 None] Temporary image 3a392502-bf92-4019-8ad1-5b48db42b20f is fetched for user 63fa35a0c5f848b0986c4c95a46b547b. {{(pid=92083) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 17 05:46:33 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[a00f528a-1aa9-41c8-885a-a1eb7fc22ab0]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:46:33 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-06ddc9bf-8462-46d9-b246-17e4a41ffcfb tempest-VolumesImageMetadata-2020034901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a392502-bf92-4019-8ad1-5b48db42b20f_c0v6qxpodevstack@QuobyteHD {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:46:33 devstack sudo[100530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a392502-bf92-4019-8ad1-5b48db42b20f_c0v6qxpodevstack@QuobyteHD Jun 17 05:46:33 devstack sudo[100530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:46:34 devstack sudo[100530]: pam_unix(sudo:session): session closed for user root Jun 17 05:46:34 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-06ddc9bf-8462-46d9-b246-17e4a41ffcfb tempest-VolumesImageMetadata-2020034901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a392502-bf92-4019-8ad1-5b48db42b20f_c0v6qxpodevstack@QuobyteHD" returned: 0 in 0.832s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:46:34 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-06ddc9bf-8462-46d9-b246-17e4a41ffcfb tempest-VolumesImageMetadata-2020034901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:46:34 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-06ddc9bf-8462-46d9-b246-17e4a41ffcfb tempest-VolumesImageMetadata-2020034901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:46:34 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-06ddc9bf-8462-46d9-b246-17e4a41ffcfb tempest-VolumesImageMetadata-2020034901 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:46:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-579573250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21a32d10-4550-4ef3-a21d-92195dce75fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2f6e4c79398482d8c4ceef8e33d0273',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:46:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:46:32Z,use_quota=True,user_id='63fa35a0c5f848b0986c4c95a46b547b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:46:34 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-06ddc9bf-8462-46d9-b246-17e4a41ffcfb tempest-VolumesImageMetadata-2020034901 None] Creating volume 21a32d10-4550-4ef3-a21d-92195dce75fe {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:46:34 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-06ddc9bf-8462-46d9-b246-17e4a41ffcfb tempest-VolumesImageMetadata-2020034901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:46:34 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-06ddc9bf-8462-46d9-b246-17e4a41ffcfb tempest-VolumesImageMetadata-2020034901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:46:34 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-06ddc9bf-8462-46d9-b246-17e4a41ffcfb tempest-VolumesImageMetadata-2020034901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:46:34 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-06ddc9bf-8462-46d9-b246-17e4a41ffcfb tempest-VolumesImageMetadata-2020034901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:46:34 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-06ddc9bf-8462-46d9-b246-17e4a41ffcfb tempest-VolumesImageMetadata-2020034901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:46:34 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-06ddc9bf-8462-46d9-b246-17e4a41ffcfb tempest-VolumesImageMetadata-2020034901 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:46:34 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-06ddc9bf-8462-46d9-b246-17e4a41ffcfb tempest-VolumesImageMetadata-2020034901 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:46:34 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-06ddc9bf-8462-46d9-b246-17e4a41ffcfb tempest-VolumesImageMetadata-2020034901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-21a32d10-4550-4ef3-a21d-92195dce75fe 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:46:34 devstack sudo[100535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-21a32d10-4550-4ef3-a21d-92195dce75fe 1073741824 Jun 17 05:46:34 devstack sudo[100535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:46:34 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-48a723f5-ddf6-440c-88d3-54e175e4041d tempest-SnapshotMetadataTestJSON-1886618429 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:46:34 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-48a723f5-ddf6-440c-88d3-54e175e4041d tempest-SnapshotMetadataTestJSON-1886618429 None] Flow 'volume_create_manager' (fa47cad0-7003-4f94-8168-283a19894241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:46:34 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-48a723f5-ddf6-440c-88d3-54e175e4041d tempest-SnapshotMetadataTestJSON-1886618429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85d4e3ed-3e4a-44c6-ab37-86ffbb5eacc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:46:34 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-48a723f5-ddf6-440c-88d3-54e175e4041d tempest-SnapshotMetadataTestJSON-1886618429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85d4e3ed-3e4a-44c6-ab37-86ffbb5eacc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:46:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-946477332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=830cd216-9492-4486-9fd0-15370cca80a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7796ff65617a43ff9945eb638f54d15f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:46:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:46:34Z,use_quota=True,user_id='c5c5d46152054a759eb2fd295d6ac4bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:46:34 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-48a723f5-ddf6-440c-88d3-54e175e4041d tempest-SnapshotMetadataTestJSON-1886618429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22c84b1d-bcca-476d-802f-742804112a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:46:34 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-48a723f5-ddf6-440c-88d3-54e175e4041d tempest-SnapshotMetadataTestJSON-1886618429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22c84b1d-bcca-476d-802f-742804112a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:46:34 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-48a723f5-ddf6-440c-88d3-54e175e4041d tempest-SnapshotMetadataTestJSON-1886618429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (433a5b45-4843-458e-845e-0218e4486117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:46:34 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-48a723f5-ddf6-440c-88d3-54e175e4041d tempest-SnapshotMetadataTestJSON-1886618429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (433a5b45-4843-458e-845e-0218e4486117) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '830cd216-9492-4486-9fd0-15370cca80a4', 'volume_name': 'volume-830cd216-9492-4486-9fd0-15370cca80a4', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:46:34 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-48a723f5-ddf6-440c-88d3-54e175e4041d tempest-SnapshotMetadataTestJSON-1886618429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04123d3e-805f-4d42-9cb6-b452f97812f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:46:34 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-48a723f5-ddf6-440c-88d3-54e175e4041d tempest-SnapshotMetadataTestJSON-1886618429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04123d3e-805f-4d42-9cb6-b452f97812f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:46:34 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-48a723f5-ddf6-440c-88d3-54e175e4041d tempest-SnapshotMetadataTestJSON-1886618429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3f2abf9-3d0c-4705-ac52-f689b7c4fd23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:46:34 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-48a723f5-ddf6-440c-88d3-54e175e4041d tempest-SnapshotMetadataTestJSON-1886618429 None] Volume 830cd216-9492-4486-9fd0-15370cca80a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-830cd216-9492-4486-9fd0-15370cca80a4', 'volume_size': 1} Jun 17 05:46:34 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-48a723f5-ddf6-440c-88d3-54e175e4041d tempest-SnapshotMetadataTestJSON-1886618429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:46:35 devstack sudo[100535]: pam_unix(sudo:session): session closed for user root Jun 17 05:46:35 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-06ddc9bf-8462-46d9-b246-17e4a41ffcfb tempest-VolumesImageMetadata-2020034901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-21a32d10-4550-4ef3-a21d-92195dce75fe 1073741824" returned: 0 in 1.052s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:46:35 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-06ddc9bf-8462-46d9-b246-17e4a41ffcfb tempest-VolumesImageMetadata-2020034901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-21a32d10-4550-4ef3-a21d-92195dce75fe {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:46:35 devstack sudo[100541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-21a32d10-4550-4ef3-a21d-92195dce75fe Jun 17 05:46:35 devstack sudo[100541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:46:35 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-4df24ec7-ff74-4b23-8f96-4fbbd588d829 req-942b2836-d882-42ba-ab91-76f45acf1388 tempest-TestInstancesWithCinderVolumes-461180917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:46:36 devstack sudo[100541]: pam_unix(sudo:session): session closed for user root Jun 17 05:46:36 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-06ddc9bf-8462-46d9-b246-17e4a41ffcfb tempest-VolumesImageMetadata-2020034901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-21a32d10-4550-4ef3-a21d-92195dce75fe" returned: 0 in 0.812s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:46:36 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-06ddc9bf-8462-46d9-b246-17e4a41ffcfb tempest-VolumesImageMetadata-2020034901 None] <== create_volume: return (1929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:46:36 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-06ddc9bf-8462-46d9-b246-17e4a41ffcfb tempest-VolumesImageMetadata-2020034901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.932s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:46:36 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-48a723f5-ddf6-440c-88d3-54e175e4041d tempest-SnapshotMetadataTestJSON-1886618429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.456s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:46:36 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-48a723f5-ddf6-440c-88d3-54e175e4041d tempest-SnapshotMetadataTestJSON-1886618429 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:46:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-946477332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=830cd216-9492-4486-9fd0-15370cca80a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7796ff65617a43ff9945eb638f54d15f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:46:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:46:34Z,use_quota=True,user_id='c5c5d46152054a759eb2fd295d6ac4bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:46:36 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-48a723f5-ddf6-440c-88d3-54e175e4041d tempest-SnapshotMetadataTestJSON-1886618429 None] Creating volume 830cd216-9492-4486-9fd0-15370cca80a4 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:46:36 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-48a723f5-ddf6-440c-88d3-54e175e4041d tempest-SnapshotMetadataTestJSON-1886618429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:46:36 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-48a723f5-ddf6-440c-88d3-54e175e4041d tempest-SnapshotMetadataTestJSON-1886618429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:46:36 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-48a723f5-ddf6-440c-88d3-54e175e4041d tempest-SnapshotMetadataTestJSON-1886618429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:46:36 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-48a723f5-ddf6-440c-88d3-54e175e4041d tempest-SnapshotMetadataTestJSON-1886618429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:46:36 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-48a723f5-ddf6-440c-88d3-54e175e4041d tempest-SnapshotMetadataTestJSON-1886618429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:46:36 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-48a723f5-ddf6-440c-88d3-54e175e4041d tempest-SnapshotMetadataTestJSON-1886618429 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:46:36 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-48a723f5-ddf6-440c-88d3-54e175e4041d tempest-SnapshotMetadataTestJSON-1886618429 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:46:36 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-48a723f5-ddf6-440c-88d3-54e175e4041d tempest-SnapshotMetadataTestJSON-1886618429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-830cd216-9492-4486-9fd0-15370cca80a4 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:46:36 devstack sudo[100553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-830cd216-9492-4486-9fd0-15370cca80a4 1073741824 Jun 17 05:46:36 devstack sudo[100553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:46:36 devstack cinder-volume[92083]: DEBUG cinder.volume.volume_utils [None req-06ddc9bf-8462-46d9-b246-17e4a41ffcfb tempest-VolumesImageMetadata-2020034901 None] Attempting download of 3a392502-bf92-4019-8ad1-5b48db42b20f ((None, [{'url': 'file:///opt/stack/data/glance/images/3a392502-bf92-4019-8ad1-5b48db42b20f', 'metadata': {}}])) to volume 21a32d10-4550-4ef3-a21d-92195dce75fe. {{(pid=92083) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 17 05:46:36 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ffe1d5b-a194-43a8-aae5-8d3b948ca503]: (4, 'raw') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:46:36 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-06ddc9bf-8462-46d9-b246-17e4a41ffcfb tempest-VolumesImageMetadata-2020034901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3a392502-bf92-4019-8ad1-5b48db42b20f_6trcc2z3 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:46:36 devstack sudo[100555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3a392502-bf92-4019-8ad1-5b48db42b20f_6trcc2z3 Jun 17 05:46:36 devstack sudo[100555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:46:36 devstack sudo[100555]: pam_unix(sudo:session): session closed for user root Jun 17 05:46:36 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-06ddc9bf-8462-46d9-b246-17e4a41ffcfb tempest-VolumesImageMetadata-2020034901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3a392502-bf92-4019-8ad1-5b48db42b20f_6trcc2z3" returned: 0 in 0.784s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:46:36 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-06ddc9bf-8462-46d9-b246-17e4a41ffcfb tempest-VolumesImageMetadata-2020034901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3a392502-bf92-4019-8ad1-5b48db42b20f_6trcc2z3 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:46:37 devstack sudo[100553]: pam_unix(sudo:session): session closed for user root Jun 17 05:46:37 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-48a723f5-ddf6-440c-88d3-54e175e4041d tempest-SnapshotMetadataTestJSON-1886618429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-830cd216-9492-4486-9fd0-15370cca80a4 1073741824" returned: 0 in 0.969s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:46:37 devstack sudo[100566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3a392502-bf92-4019-8ad1-5b48db42b20f_6trcc2z3 Jun 17 05:46:37 devstack sudo[100566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:46:37 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-48a723f5-ddf6-440c-88d3-54e175e4041d tempest-SnapshotMetadataTestJSON-1886618429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-830cd216-9492-4486-9fd0-15370cca80a4 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:46:37 devstack sudo[100568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-830cd216-9492-4486-9fd0-15370cca80a4 Jun 17 05:46:37 devstack sudo[100568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:46:37 devstack sudo[100566]: pam_unix(sudo:session): session closed for user root Jun 17 05:46:37 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-06ddc9bf-8462-46d9-b246-17e4a41ffcfb tempest-VolumesImageMetadata-2020034901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3a392502-bf92-4019-8ad1-5b48db42b20f_6trcc2z3" returned: 1 in 0.692s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:46:37 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-06ddc9bf-8462-46d9-b246-17e4a41ffcfb tempest-VolumesImageMetadata-2020034901 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3a392502-bf92-4019-8ad1-5b48db42b20f_6trcc2z3' failed. Not Retrying. {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 05:46:37 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[6535f448-4f49-47d1-9e49-634d204b1275]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:46:37 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-06ddc9bf-8462-46d9-b246-17e4a41ffcfb tempest-VolumesImageMetadata-2020034901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a392502-bf92-4019-8ad1-5b48db42b20f_c0v6qxpodevstack@QuobyteHD {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:46:37 devstack sudo[100568]: pam_unix(sudo:session): session closed for user root Jun 17 05:46:37 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-48a723f5-ddf6-440c-88d3-54e175e4041d tempest-SnapshotMetadataTestJSON-1886618429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-830cd216-9492-4486-9fd0-15370cca80a4" returned: 0 in 0.622s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:46:37 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-48a723f5-ddf6-440c-88d3-54e175e4041d tempest-SnapshotMetadataTestJSON-1886618429 None] <== create_volume: return (1635ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:46:37 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-48a723f5-ddf6-440c-88d3-54e175e4041d tempest-SnapshotMetadataTestJSON-1886618429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.638s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:46:37 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-4df24ec7-ff74-4b23-8f96-4fbbd588d829 req-942b2836-d882-42ba-ab91-76f45acf1388 tempest-TestInstancesWithCinderVolumes-461180917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.058s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:46:37 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-48a723f5-ddf6-440c-88d3-54e175e4041d tempest-SnapshotMetadataTestJSON-1886618429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3f2abf9-3d0c-4705-ac52-f689b7c4fd23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-830cd216-9492-4486-9fd0-15370cca80a4', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:46:37 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-48a723f5-ddf6-440c-88d3-54e175e4041d tempest-SnapshotMetadataTestJSON-1886618429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed28f354-d7cd-4018-b446-b851272d52e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:46:37 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[44899cf9-b35c-469b-822c-3e71d1b508ba]: (4, 'raw') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:46:37 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-4df24ec7-ff74-4b23-8f96-4fbbd588d829 req-942b2836-d882-42ba-ab91-76f45acf1388 tempest-TestInstancesWithCinderVolumes-461180917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a563a600-24a6-4a5a-ba89-efb07fb4fada {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:46:37 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-48a723f5-ddf6-440c-88d3-54e175e4041d tempest-SnapshotMetadataTestJSON-1886618429 None] Volume volume-830cd216-9492-4486-9fd0-15370cca80a4 (830cd216-9492-4486-9fd0-15370cca80a4): created successfully Jun 17 05:46:37 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-48a723f5-ddf6-440c-88d3-54e175e4041d tempest-SnapshotMetadataTestJSON-1886618429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed28f354-d7cd-4018-b446-b851272d52e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:46:37 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-48a723f5-ddf6-440c-88d3-54e175e4041d tempest-SnapshotMetadataTestJSON-1886618429 None] Flow 'volume_create_manager' (fa47cad0-7003-4f94-8168-283a19894241) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:46:37 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-48a723f5-ddf6-440c-88d3-54e175e4041d tempest-SnapshotMetadataTestJSON-1886618429 None] Created volume successfully. Jun 17 05:46:37 devstack sudo[100573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a392502-bf92-4019-8ad1-5b48db42b20f_c0v6qxpodevstack@QuobyteHD Jun 17 05:46:37 devstack sudo[100573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:46:37 devstack sudo[100574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a563a600-24a6-4a5a-ba89-efb07fb4fada Jun 17 05:46:37 devstack sudo[100574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:46:38 devstack sudo[100573]: pam_unix(sudo:session): session closed for user root Jun 17 05:46:38 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-06ddc9bf-8462-46d9-b246-17e4a41ffcfb tempest-VolumesImageMetadata-2020034901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a392502-bf92-4019-8ad1-5b48db42b20f_c0v6qxpodevstack@QuobyteHD" returned: 0 in 0.847s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:46:38 devstack cinder-volume[92083]: DEBUG cinder.image.image_utils [None req-06ddc9bf-8462-46d9-b246-17e4a41ffcfb tempest-VolumesImageMetadata-2020034901 None] 3a392502-bf92-4019-8ad1-5b48db42b20f was qcow2, converting to raw {{(pid=92083) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 17 05:46:38 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-06ddc9bf-8462-46d9-b246-17e4a41ffcfb tempest-VolumesImageMetadata-2020034901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3a392502-bf92-4019-8ad1-5b48db42b20f_c0v6qxpodevstack@QuobyteHD /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-21a32d10-4550-4ef3-a21d-92195dce75fe {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:46:38 devstack sudo[100574]: pam_unix(sudo:session): session closed for user root Jun 17 05:46:38 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-4df24ec7-ff74-4b23-8f96-4fbbd588d829 req-942b2836-d882-42ba-ab91-76f45acf1388 tempest-TestInstancesWithCinderVolumes-461180917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a563a600-24a6-4a5a-ba89-efb07fb4fada" returned: 0 in 0.780s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:46:38 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-4df24ec7-ff74-4b23-8f96-4fbbd588d829 req-942b2836-d882-42ba-ab91-76f45acf1388 tempest-TestInstancesWithCinderVolumes-461180917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a563a600-24a6-4a5a-ba89-efb07fb4fada {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:46:38 devstack sudo[100582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3a392502-bf92-4019-8ad1-5b48db42b20f_c0v6qxpodevstack@QuobyteHD /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-21a32d10-4550-4ef3-a21d-92195dce75fe Jun 17 05:46:38 devstack sudo[100582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:46:38 devstack sudo[100584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a563a600-24a6-4a5a-ba89-efb07fb4fada Jun 17 05:46:38 devstack sudo[100584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:46:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e687282c-8d7a-40a2-91ab-ead57f521c38 tempest-SnapshotMetadataTestJSON-1886618429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:46:39 devstack sudo[100584]: pam_unix(sudo:session): session closed for user root Jun 17 05:46:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-4df24ec7-ff74-4b23-8f96-4fbbd588d829 req-942b2836-d882-42ba-ab91-76f45acf1388 tempest-TestInstancesWithCinderVolumes-461180917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a563a600-24a6-4a5a-ba89-efb07fb4fada" returned: 1 in 0.840s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:46:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-4df24ec7-ff74-4b23-8f96-4fbbd588d829 req-942b2836-d882-42ba-ab91-76f45acf1388 tempest-TestInstancesWithCinderVolumes-461180917 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a563a600-24a6-4a5a-ba89-efb07fb4fada' failed. Not Retrying. {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 05:46:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-4df24ec7-ff74-4b23-8f96-4fbbd588d829 req-942b2836-d882-42ba-ab91-76f45acf1388 tempest-TestInstancesWithCinderVolumes-461180917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.671s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:46:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e687282c-8d7a-40a2-91ab-ead57f521c38 tempest-SnapshotMetadataTestJSON-1886618429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.272s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:46:39 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-e687282c-8d7a-40a2-91ab-ead57f521c38 tempest-SnapshotMetadataTestJSON-1886618429 None] Creating offline snapshot d38b62fe-2642-45f1-aaae-a757fe3453a6 of volume 830cd216-9492-4486-9fd0-15370cca80a4 {{(pid=92083) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 17 05:46:39 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d928a41-6714-412b-b5d9-2320a61be4da]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:46:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e687282c-8d7a-40a2-91ab-ead57f521c38 tempest-SnapshotMetadataTestJSON-1886618429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-830cd216-9492-4486-9fd0-15370cca80a4 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:46:39 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [req-4df24ec7-ff74-4b23-8f96-4fbbd588d829 req-942b2836-d882-42ba-ab91-76f45acf1388 tempest-TestInstancesWithCinderVolumes-461180917 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f', 'name': 'volume-a563a600-24a6-4a5a-ba89-efb07fb4fada', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '50d5933a-4b36-4b39-bb36-4dc550333bee', 'enforce_multipath': True} {{(pid=92083) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 17 05:46:39 devstack cinder-volume[92083]: INFO cinder.volume.manager [req-4df24ec7-ff74-4b23-8f96-4fbbd588d829 req-942b2836-d882-42ba-ab91-76f45acf1388 tempest-TestInstancesWithCinderVolumes-461180917 None] attachment_update completed successfully. Jun 17 05:46:39 devstack sudo[100595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-830cd216-9492-4486-9fd0-15370cca80a4 Jun 17 05:46:39 devstack sudo[100595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:46:40 devstack sudo[100595]: pam_unix(sudo:session): session closed for user root Jun 17 05:46:40 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e687282c-8d7a-40a2-91ab-ead57f521c38 tempest-SnapshotMetadataTestJSON-1886618429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-830cd216-9492-4486-9fd0-15370cca80a4" returned: 0 in 0.873s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:46:40 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e687282c-8d7a-40a2-91ab-ead57f521c38 tempest-SnapshotMetadataTestJSON-1886618429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-830cd216-9492-4486-9fd0-15370cca80a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-830cd216-9492-4486-9fd0-15370cca80a4.d38b62fe-2642-45f1-aaae-a757fe3453a6 1G {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:46:40 devstack sudo[100603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-830cd216-9492-4486-9fd0-15370cca80a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-830cd216-9492-4486-9fd0-15370cca80a4.d38b62fe-2642-45f1-aaae-a757fe3453a6 1G Jun 17 05:46:40 devstack sudo[100603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:46:40 devstack sudo[100582]: pam_unix(sudo:session): session closed for user root Jun 17 05:46:40 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-06ddc9bf-8462-46d9-b246-17e4a41ffcfb tempest-VolumesImageMetadata-2020034901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3a392502-bf92-4019-8ad1-5b48db42b20f_c0v6qxpodevstack@QuobyteHD /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-21a32d10-4550-4ef3-a21d-92195dce75fe" returned: 0 in 2.113s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:46:40 devstack cinder-volume[92083]: DEBUG cinder.image.image_utils [None req-06ddc9bf-8462-46d9-b246-17e4a41ffcfb tempest-VolumesImageMetadata-2020034901 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3a392502-bf92-4019-8ad1-5b48db42b20f_c0v6qxpodevstack@QuobyteHD, size 112.00 MB, duration 2.11 sec, destination /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-21a32d10-4550-4ef3-a21d-92195dce75fe {{(pid=92083) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 17 05:46:40 devstack cinder-volume[92083]: INFO cinder.image.image_utils [None req-06ddc9bf-8462-46d9-b246-17e4a41ffcfb tempest-VolumesImageMetadata-2020034901 None] Converted 112.00 MB image at 52.97 MB/s Jun 17 05:46:40 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-06ddc9bf-8462-46d9-b246-17e4a41ffcfb tempest-VolumesImageMetadata-2020034901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-21a32d10-4550-4ef3-a21d-92195dce75fe 1G {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:46:40 devstack sudo[100605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-21a32d10-4550-4ef3-a21d-92195dce75fe 1G Jun 17 05:46:40 devstack sudo[100605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:46:41 devstack sudo[100603]: pam_unix(sudo:session): session closed for user root Jun 17 05:46:41 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e687282c-8d7a-40a2-91ab-ead57f521c38 tempest-SnapshotMetadataTestJSON-1886618429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-830cd216-9492-4486-9fd0-15370cca80a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-830cd216-9492-4486-9fd0-15370cca80a4.d38b62fe-2642-45f1-aaae-a757fe3453a6 1G" returned: 0 in 0.798s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:46:41 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e687282c-8d7a-40a2-91ab-ead57f521c38 tempest-SnapshotMetadataTestJSON-1886618429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-830cd216-9492-4486-9fd0-15370cca80a4 -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-830cd216-9492-4486-9fd0-15370cca80a4.d38b62fe-2642-45f1-aaae-a757fe3453a6 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:46:41 devstack sudo[100613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-830cd216-9492-4486-9fd0-15370cca80a4 -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-830cd216-9492-4486-9fd0-15370cca80a4.d38b62fe-2642-45f1-aaae-a757fe3453a6 Jun 17 05:46:41 devstack sudo[100613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:46:41 devstack sudo[100605]: pam_unix(sudo:session): session closed for user root Jun 17 05:46:41 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-06ddc9bf-8462-46d9-b246-17e4a41ffcfb tempest-VolumesImageMetadata-2020034901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-21a32d10-4550-4ef3-a21d-92195dce75fe 1G" returned: 0 in 0.636s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:46:41 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8c2cbb-e662-4ff8-a04c-1d2d36e42bb7]: (4, 'raw') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:46:41 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-06ddc9bf-8462-46d9-b246-17e4a41ffcfb tempest-VolumesImageMetadata-2020034901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-21a32d10-4550-4ef3-a21d-92195dce75fe {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:46:41 devstack sudo[100617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-21a32d10-4550-4ef3-a21d-92195dce75fe Jun 17 05:46:41 devstack sudo[100617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:46:41 devstack sudo[100613]: pam_unix(sudo:session): session closed for user root Jun 17 05:46:41 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e687282c-8d7a-40a2-91ab-ead57f521c38 tempest-SnapshotMetadataTestJSON-1886618429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-830cd216-9492-4486-9fd0-15370cca80a4 -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-830cd216-9492-4486-9fd0-15370cca80a4.d38b62fe-2642-45f1-aaae-a757fe3453a6" returned: 0 in 0.714s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:46:41 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [None req-e687282c-8d7a-40a2-91ab-ead57f521c38 tempest-SnapshotMetadataTestJSON-1886618429 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-830cd216-9492-4486-9fd0-15370cca80a4.d38b62fe-2642-45f1-aaae-a757fe3453a6 is being set with open permissions: ugo+rw Jun 17 05:46:41 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e687282c-8d7a-40a2-91ab-ead57f521c38 tempest-SnapshotMetadataTestJSON-1886618429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-830cd216-9492-4486-9fd0-15370cca80a4.d38b62fe-2642-45f1-aaae-a757fe3453a6 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:46:41 devstack sudo[100689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-830cd216-9492-4486-9fd0-15370cca80a4.d38b62fe-2642-45f1-aaae-a757fe3453a6 Jun 17 05:46:41 devstack sudo[100689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:46:42 devstack sudo[100617]: pam_unix(sudo:session): session closed for user root Jun 17 05:46:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-06ddc9bf-8462-46d9-b246-17e4a41ffcfb tempest-VolumesImageMetadata-2020034901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-21a32d10-4550-4ef3-a21d-92195dce75fe" returned: 0 in 0.810s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:46:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-06ddc9bf-8462-46d9-b246-17e4a41ffcfb tempest-VolumesImageMetadata-2020034901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-21a32d10-4550-4ef3-a21d-92195dce75fe {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:46:42 devstack sudo[100693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-21a32d10-4550-4ef3-a21d-92195dce75fe Jun 17 05:46:42 devstack sudo[100693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:46:42 devstack sudo[100689]: pam_unix(sudo:session): session closed for user root Jun 17 05:46:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e687282c-8d7a-40a2-91ab-ead57f521c38 tempest-SnapshotMetadataTestJSON-1886618429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-830cd216-9492-4486-9fd0-15370cca80a4.d38b62fe-2642-45f1-aaae-a757fe3453a6" returned: 0 in 0.632s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:46:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e687282c-8d7a-40a2-91ab-ead57f521c38 tempest-SnapshotMetadataTestJSON-1886618429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-830cd216-9492-4486-9fd0-15370cca80a4.info {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:46:42 devstack sudo[100696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-830cd216-9492-4486-9fd0-15370cca80a4.info Jun 17 05:46:42 devstack sudo[100696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:46:42 devstack sudo[100693]: pam_unix(sudo:session): session closed for user root Jun 17 05:46:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-06ddc9bf-8462-46d9-b246-17e4a41ffcfb tempest-VolumesImageMetadata-2020034901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-21a32d10-4550-4ef3-a21d-92195dce75fe" returned: 1 in 0.753s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:46:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-06ddc9bf-8462-46d9-b246-17e4a41ffcfb tempest-VolumesImageMetadata-2020034901 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-21a32d10-4550-4ef3-a21d-92195dce75fe' failed. Not Retrying. {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 05:46:42 devstack cinder-volume[92083]: DEBUG cinder.volume.volume_utils [None req-06ddc9bf-8462-46d9-b246-17e4a41ffcfb tempest-VolumesImageMetadata-2020034901 None] Downloaded image 3a392502-bf92-4019-8ad1-5b48db42b20f ((None, [{'url': 'file:///opt/stack/data/glance/images/3a392502-bf92-4019-8ad1-5b48db42b20f', 'metadata': {}}])) to volume 21a32d10-4550-4ef3-a21d-92195dce75fe successfully. {{(pid=92083) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 17 05:46:42 devstack cinder-volume[92083]: DEBUG cinder.image.image_utils [None req-06ddc9bf-8462-46d9-b246-17e4a41ffcfb tempest-VolumesImageMetadata-2020034901 None] Temporary image 3a392502-bf92-4019-8ad1-5b48db42b20f for user 63fa35a0c5f848b0986c4c95a46b547b is deleted. {{(pid=92083) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 17 05:46:42 devstack cinder-volume[92083]: DEBUG cinder.volume.volume_utils [None req-06ddc9bf-8462-46d9-b246-17e4a41ffcfb tempest-VolumesImageMetadata-2020034901 None] Marking volume 21a32d10-4550-4ef3-a21d-92195dce75fe as bootable. {{(pid=92083) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 17 05:46:42 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-06ddc9bf-8462-46d9-b246-17e4a41ffcfb tempest-VolumesImageMetadata-2020034901 None] Copying metadata from image 3a392502-bf92-4019-8ad1-5b48db42b20f to 21a32d10-4550-4ef3-a21d-92195dce75fe. {{(pid=92083) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 17 05:46:42 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-06ddc9bf-8462-46d9-b246-17e4a41ffcfb tempest-VolumesImageMetadata-2020034901 None] Creating volume glance metadata for volume 21a32d10-4550-4ef3-a21d-92195dce75fe backed by image 3a392502-bf92-4019-8ad1-5b48db42b20f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3a392502-bf92-4019-8ad1-5b48db42b20f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=92083) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 17 05:46:43 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-06ddc9bf-8462-46d9-b246-17e4a41ffcfb tempest-VolumesImageMetadata-2020034901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5383702-0331-449c-8584-7f8c5ace732c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21a32d10-4550-4ef3-a21d-92195dce75fe', 'volume_size': 1, 'image_id': '3a392502-bf92-4019-8ad1-5b48db42b20f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3a392502-bf92-4019-8ad1-5b48db42b20f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd68ea14f86c14b8aac202e298736b075', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3a392502-bf92-4019-8ad1-5b48db42b20f', 'created_at': datetime.datetime(2026, 6, 17, 3, 31, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 3, 31, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3a392502-bf92-4019-8ad1-5b48db42b20f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:46:43 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-06ddc9bf-8462-46d9-b246-17e4a41ffcfb tempest-VolumesImageMetadata-2020034901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3700d4d0-b3af-4ca8-b2da-a29d0bff7072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:46:43 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-06ddc9bf-8462-46d9-b246-17e4a41ffcfb tempest-VolumesImageMetadata-2020034901 None] Volume volume-21a32d10-4550-4ef3-a21d-92195dce75fe (21a32d10-4550-4ef3-a21d-92195dce75fe): created successfully Jun 17 05:46:43 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-06ddc9bf-8462-46d9-b246-17e4a41ffcfb tempest-VolumesImageMetadata-2020034901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3700d4d0-b3af-4ca8-b2da-a29d0bff7072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:46:43 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-06ddc9bf-8462-46d9-b246-17e4a41ffcfb tempest-VolumesImageMetadata-2020034901 None] Flow 'volume_create_manager' (104aa10c-9596-4f1e-8286-29c527f8dd0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:46:43 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-06ddc9bf-8462-46d9-b246-17e4a41ffcfb tempest-VolumesImageMetadata-2020034901 None] Created volume successfully. Jun 17 05:46:43 devstack sudo[100696]: pam_unix(sudo:session): session closed for user root Jun 17 05:46:43 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e687282c-8d7a-40a2-91ab-ead57f521c38 tempest-SnapshotMetadataTestJSON-1886618429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-830cd216-9492-4486-9fd0-15370cca80a4.info" returned: 0 in 0.694s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:46:43 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [None req-e687282c-8d7a-40a2-91ab-ead57f521c38 tempest-SnapshotMetadataTestJSON-1886618429 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-830cd216-9492-4486-9fd0-15370cca80a4.info is being set with open permissions: ugo+rw Jun 17 05:46:43 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e687282c-8d7a-40a2-91ab-ead57f521c38 tempest-SnapshotMetadataTestJSON-1886618429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-830cd216-9492-4486-9fd0-15370cca80a4.info {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:46:43 devstack sudo[100706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-830cd216-9492-4486-9fd0-15370cca80a4.info Jun 17 05:46:43 devstack sudo[100706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:46:43 devstack sudo[100706]: pam_unix(sudo:session): session closed for user root Jun 17 05:46:43 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e687282c-8d7a-40a2-91ab-ead57f521c38 tempest-SnapshotMetadataTestJSON-1886618429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-830cd216-9492-4486-9fd0-15370cca80a4.info" returned: 0 in 0.616s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:46:43 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e687282c-8d7a-40a2-91ab-ead57f521c38 tempest-SnapshotMetadataTestJSON-1886618429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.482s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:46:43 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-e5c0e8fb-61fb-4bc1-a83f-8c71a7dc631b tempest-VolumesImageMetadata-2020034901 None] Acquiring lock "cinder-21a32d10-4550-4ef3-a21d-92195dce75fe-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:46:43 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-e5c0e8fb-61fb-4bc1-a83f-8c71a7dc631b tempest-VolumesImageMetadata-2020034901 None] Lock "cinder-21a32d10-4550-4ef3-a21d-92195dce75fe-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:46:43 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-e687282c-8d7a-40a2-91ab-ead57f521c38 tempest-SnapshotMetadataTestJSON-1886618429 None] Create snapshot completed successfully Jun 17 05:46:43 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-e5c0e8fb-61fb-4bc1-a83f-8c71a7dc631b tempest-VolumesImageMetadata-2020034901 None] Acquiring lock "cinder-quobyte-21a32d10-4550-4ef3-a21d-92195dce75fe" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:46:43 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-e5c0e8fb-61fb-4bc1-a83f-8c71a7dc631b tempest-VolumesImageMetadata-2020034901 None] Lock "cinder-quobyte-21a32d10-4550-4ef3-a21d-92195dce75fe" acquired by "delete_volume" :: waited 0.018s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:46:44 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[5523e912-fc10-4c82-b2d3-b284ae4c1d87]: (4, 'raw') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:46:44 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e5c0e8fb-61fb-4bc1-a83f-8c71a7dc631b tempest-VolumesImageMetadata-2020034901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-21a32d10-4550-4ef3-a21d-92195dce75fe {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:46:44 devstack sudo[100709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-21a32d10-4550-4ef3-a21d-92195dce75fe Jun 17 05:46:44 devstack sudo[100709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:46:45 devstack sudo[100709]: pam_unix(sudo:session): session closed for user root Jun 17 05:46:45 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e5c0e8fb-61fb-4bc1-a83f-8c71a7dc631b tempest-VolumesImageMetadata-2020034901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-21a32d10-4550-4ef3-a21d-92195dce75fe" returned: 0 in 1.264s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:46:45 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e5c0e8fb-61fb-4bc1-a83f-8c71a7dc631b tempest-VolumesImageMetadata-2020034901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-21a32d10-4550-4ef3-a21d-92195dce75fe {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:46:45 devstack sudo[101081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-21a32d10-4550-4ef3-a21d-92195dce75fe Jun 17 05:46:45 devstack sudo[101081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:46:45 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-a024f98c-c2c2-45bb-9d8b-a24f686089e0 tempest-SnapshotMetadataTestJSON-1886618429 None] Acquiring lock "cinder-d38b62fe-2642-45f1-aaae-a757fe3453a6-delete_snapshot" by "delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:46:45 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-a024f98c-c2c2-45bb-9d8b-a24f686089e0 tempest-SnapshotMetadataTestJSON-1886618429 None] Lock "cinder-d38b62fe-2642-45f1-aaae-a757fe3453a6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:46:45 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-a024f98c-c2c2-45bb-9d8b-a24f686089e0 tempest-SnapshotMetadataTestJSON-1886618429 None] Acquiring lock "cinder-quobyte-830cd216-9492-4486-9fd0-15370cca80a4" by "delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:46:45 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-a024f98c-c2c2-45bb-9d8b-a24f686089e0 tempest-SnapshotMetadataTestJSON-1886618429 None] Lock "cinder-quobyte-830cd216-9492-4486-9fd0-15370cca80a4" acquired by "delete_snapshot" :: waited 0.032s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:46:45 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-a024f98c-c2c2-45bb-9d8b-a24f686089e0 tempest-SnapshotMetadataTestJSON-1886618429 None] Acquiring lock "cinder-quobyte-d38b62fe-2642-45f1-aaae-a757fe3453a6" by "_delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:46:46 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-a024f98c-c2c2-45bb-9d8b-a24f686089e0 tempest-SnapshotMetadataTestJSON-1886618429 None] Lock "cinder-quobyte-d38b62fe-2642-45f1-aaae-a757fe3453a6" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:46:46 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-a024f98c-c2c2-45bb-9d8b-a24f686089e0 tempest-SnapshotMetadataTestJSON-1886618429 None] Deleting offline snapshot d38b62fe-2642-45f1-aaae-a757fe3453a6 of volume 830cd216-9492-4486-9fd0-15370cca80a4 {{(pid=92083) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 17 05:46:46 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-a024f98c-c2c2-45bb-9d8b-a24f686089e0 tempest-SnapshotMetadataTestJSON-1886618429 None] snapshot_file for this snap is: volume-830cd216-9492-4486-9fd0-15370cca80a4.d38b62fe-2642-45f1-aaae-a757fe3453a6 {{(pid=92083) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 17 05:46:46 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f62955-ba66-4061-a904-6100e09d415f]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:46:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a024f98c-c2c2-45bb-9d8b-a24f686089e0 tempest-SnapshotMetadataTestJSON-1886618429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-830cd216-9492-4486-9fd0-15370cca80a4.d38b62fe-2642-45f1-aaae-a757fe3453a6 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:46:46 devstack sudo[101087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-830cd216-9492-4486-9fd0-15370cca80a4.d38b62fe-2642-45f1-aaae-a757fe3453a6 Jun 17 05:46:46 devstack sudo[101087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:46:46 devstack sudo[101081]: pam_unix(sudo:session): session closed for user root Jun 17 05:46:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e5c0e8fb-61fb-4bc1-a83f-8c71a7dc631b tempest-VolumesImageMetadata-2020034901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-21a32d10-4550-4ef3-a21d-92195dce75fe" returned: 1 in 1.339s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:46:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e5c0e8fb-61fb-4bc1-a83f-8c71a7dc631b tempest-VolumesImageMetadata-2020034901 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-21a32d10-4550-4ef3-a21d-92195dce75fe' failed. Not Retrying. {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 05:46:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e5c0e8fb-61fb-4bc1-a83f-8c71a7dc631b tempest-VolumesImageMetadata-2020034901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-21a32d10-4550-4ef3-a21d-92195dce75fe {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:46:46 devstack sudo[101099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-21a32d10-4550-4ef3-a21d-92195dce75fe Jun 17 05:46:46 devstack sudo[101099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:46:47 devstack sudo[101087]: pam_unix(sudo:session): session closed for user root Jun 17 05:46:47 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a024f98c-c2c2-45bb-9d8b-a24f686089e0 tempest-SnapshotMetadataTestJSON-1886618429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-830cd216-9492-4486-9fd0-15370cca80a4.d38b62fe-2642-45f1-aaae-a757fe3453a6" returned: 0 in 1.589s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:46:47 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-a024f98c-c2c2-45bb-9d8b-a24f686089e0 tempest-SnapshotMetadataTestJSON-1886618429 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-830cd216-9492-4486-9fd0-15370cca80a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92083) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 05:46:47 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd01882-c043-4fc2-ac16-9dbba4ab12d1]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:46:47 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a024f98c-c2c2-45bb-9d8b-a24f686089e0 tempest-SnapshotMetadataTestJSON-1886618429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-830cd216-9492-4486-9fd0-15370cca80a4 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:46:47 devstack sudo[101099]: pam_unix(sudo:session): session closed for user root Jun 17 05:46:47 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e5c0e8fb-61fb-4bc1-a83f-8c71a7dc631b tempest-VolumesImageMetadata-2020034901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-21a32d10-4550-4ef3-a21d-92195dce75fe" returned: 0 in 1.220s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:46:47 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-e5c0e8fb-61fb-4bc1-a83f-8c71a7dc631b tempest-VolumesImageMetadata-2020034901 None] Lock "cinder-quobyte-21a32d10-4550-4ef3-a21d-92195dce75fe" released by "delete_volume" :: held 3.908s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:46:48 devstack sudo[101116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-830cd216-9492-4486-9fd0-15370cca80a4 Jun 17 05:46:48 devstack sudo[101116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:46:48 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-e5c0e8fb-61fb-4bc1-a83f-8c71a7dc631b tempest-VolumesImageMetadata-2020034901 None] Created reservations ['53fc6d9c-6d74-48f4-91f9-2da6da2f5f4f', '54bf5220-53d4-4a61-923c-8d48371f6069', 'f44aa692-3c58-4b7f-884a-eb6892e62d2c', '33a631f3-057a-41d3-9e19-e13d7ce4b4c5'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:46:48 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e5c0e8fb-61fb-4bc1-a83f-8c71a7dc631b tempest-VolumesImageMetadata-2020034901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:46:48 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e5c0e8fb-61fb-4bc1-a83f-8c71a7dc631b tempest-VolumesImageMetadata-2020034901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:46:48 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-e5c0e8fb-61fb-4bc1-a83f-8c71a7dc631b tempest-VolumesImageMetadata-2020034901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:46:48 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-e5c0e8fb-61fb-4bc1-a83f-8c71a7dc631b tempest-VolumesImageMetadata-2020034901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:46:48 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e5c0e8fb-61fb-4bc1-a83f-8c71a7dc631b tempest-VolumesImageMetadata-2020034901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:46:48 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e5c0e8fb-61fb-4bc1-a83f-8c71a7dc631b tempest-VolumesImageMetadata-2020034901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:46:48 devstack sudo[101120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:46:48 devstack sudo[101120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:46:49 devstack sudo[101120]: pam_unix(sudo:session): session closed for user root Jun 17 05:46:49 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e5c0e8fb-61fb-4bc1-a83f-8c71a7dc631b tempest-VolumesImageMetadata-2020034901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 1.016s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:46:49 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-e5c0e8fb-61fb-4bc1-a83f-8c71a7dc631b tempest-VolumesImageMetadata-2020034901 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:46:49 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-e5c0e8fb-61fb-4bc1-a83f-8c71a7dc631b tempest-VolumesImageMetadata-2020034901 None] Deleted volume successfully. Jun 17 05:46:49 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-e5c0e8fb-61fb-4bc1-a83f-8c71a7dc631b tempest-VolumesImageMetadata-2020034901 None] Lock "cinder-21a32d10-4550-4ef3-a21d-92195dce75fe-delete_volume" released by "delete_volume" :: held 5.404s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:46:49 devstack sudo[101116]: pam_unix(sudo:session): session closed for user root Jun 17 05:46:49 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a024f98c-c2c2-45bb-9d8b-a24f686089e0 tempest-SnapshotMetadataTestJSON-1886618429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-830cd216-9492-4486-9fd0-15370cca80a4" returned: 0 in 1.631s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:46:49 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a024f98c-c2c2-45bb-9d8b-a24f686089e0 tempest-SnapshotMetadataTestJSON-1886618429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-830cd216-9492-4486-9fd0-15370cca80a4.d38b62fe-2642-45f1-aaae-a757fe3453a6 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:46:49 devstack sudo[101127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-830cd216-9492-4486-9fd0-15370cca80a4.d38b62fe-2642-45f1-aaae-a757fe3453a6 Jun 17 05:46:49 devstack sudo[101127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:46:50 devstack sudo[101127]: pam_unix(sudo:session): session closed for user root Jun 17 05:46:50 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a024f98c-c2c2-45bb-9d8b-a24f686089e0 tempest-SnapshotMetadataTestJSON-1886618429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-830cd216-9492-4486-9fd0-15370cca80a4.d38b62fe-2642-45f1-aaae-a757fe3453a6" returned: 0 in 1.210s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:46:50 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a024f98c-c2c2-45bb-9d8b-a24f686089e0 tempest-SnapshotMetadataTestJSON-1886618429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-830cd216-9492-4486-9fd0-15370cca80a4.d38b62fe-2642-45f1-aaae-a757fe3453a6 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:46:50 devstack sudo[101132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-830cd216-9492-4486-9fd0-15370cca80a4.d38b62fe-2642-45f1-aaae-a757fe3453a6 Jun 17 05:46:50 devstack sudo[101132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:46:51 devstack sudo[101132]: pam_unix(sudo:session): session closed for user root Jun 17 05:46:51 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a024f98c-c2c2-45bb-9d8b-a24f686089e0 tempest-SnapshotMetadataTestJSON-1886618429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-830cd216-9492-4486-9fd0-15370cca80a4.d38b62fe-2642-45f1-aaae-a757fe3453a6" returned: 0 in 1.092s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:46:51 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-a024f98c-c2c2-45bb-9d8b-a24f686089e0 tempest-SnapshotMetadataTestJSON-1886618429 None] Lock "cinder-quobyte-d38b62fe-2642-45f1-aaae-a757fe3453a6" released by "_delete_snapshot" :: held 5.796s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:46:51 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-a024f98c-c2c2-45bb-9d8b-a24f686089e0 tempest-SnapshotMetadataTestJSON-1886618429 None] Lock "cinder-quobyte-830cd216-9492-4486-9fd0-15370cca80a4" released by "delete_snapshot" :: held 5.844s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:46:51 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-a024f98c-c2c2-45bb-9d8b-a24f686089e0 tempest-SnapshotMetadataTestJSON-1886618429 None] Created reservations ['5d733d13-0a9b-4118-8f57-0b1c0eb311e8', 'e1fe2db9-45fc-4c2f-a931-c9af81809fe5', '3750599c-6701-42e9-bd38-5a2a2a1eb2de', '1336d2a2-fb39-4756-bc94-c5e7447bb884'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:46:52 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-a024f98c-c2c2-45bb-9d8b-a24f686089e0 tempest-SnapshotMetadataTestJSON-1886618429 None] Delete snapshot completed successfully. Jun 17 05:46:52 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-a024f98c-c2c2-45bb-9d8b-a24f686089e0 tempest-SnapshotMetadataTestJSON-1886618429 None] Lock "cinder-d38b62fe-2642-45f1-aaae-a757fe3453a6-delete_snapshot" released by "delete_snapshot" :: held 6.104s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:46:52 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-e018dbc5-9390-4b6b-9a5c-20e102025561 tempest-SnapshotMetadataTestJSON-1886618429 None] Acquiring lock "cinder-830cd216-9492-4486-9fd0-15370cca80a4-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:46:52 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-e018dbc5-9390-4b6b-9a5c-20e102025561 tempest-SnapshotMetadataTestJSON-1886618429 None] Lock "cinder-830cd216-9492-4486-9fd0-15370cca80a4-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:46:52 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-e018dbc5-9390-4b6b-9a5c-20e102025561 tempest-SnapshotMetadataTestJSON-1886618429 None] Acquiring lock "cinder-quobyte-830cd216-9492-4486-9fd0-15370cca80a4" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:46:52 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-e018dbc5-9390-4b6b-9a5c-20e102025561 tempest-SnapshotMetadataTestJSON-1886618429 None] Lock "cinder-quobyte-830cd216-9492-4486-9fd0-15370cca80a4" acquired by "delete_volume" :: waited 0.041s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:46:53 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c73b13e-7208-48e0-9b39-eaf4fe8216b7]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:46:53 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e018dbc5-9390-4b6b-9a5c-20e102025561 tempest-SnapshotMetadataTestJSON-1886618429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-830cd216-9492-4486-9fd0-15370cca80a4 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:46:53 devstack sudo[101140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-830cd216-9492-4486-9fd0-15370cca80a4 Jun 17 05:46:53 devstack sudo[101140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:46:53 devstack sudo[101140]: pam_unix(sudo:session): session closed for user root Jun 17 05:46:53 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e018dbc5-9390-4b6b-9a5c-20e102025561 tempest-SnapshotMetadataTestJSON-1886618429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-830cd216-9492-4486-9fd0-15370cca80a4" returned: 0 in 0.888s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:46:53 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e018dbc5-9390-4b6b-9a5c-20e102025561 tempest-SnapshotMetadataTestJSON-1886618429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-830cd216-9492-4486-9fd0-15370cca80a4 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:46:54 devstack sudo[101146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-830cd216-9492-4486-9fd0-15370cca80a4 Jun 17 05:46:54 devstack sudo[101146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:46:54 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-79689dc2-82ff-458b-9e43-1143477466d0 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:46:54 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-79689dc2-82ff-458b-9e43-1143477466d0 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] Flow 'volume_create_manager' (101f5328-8ad5-4671-829f-780be9503580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:46:54 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-79689dc2-82ff-458b-9e43-1143477466d0 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fedb4fe5-2354-403d-a779-b3fb3ce99936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:46:54 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-79689dc2-82ff-458b-9e43-1143477466d0 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fedb4fe5-2354-403d-a779-b3fb3ce99936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:46:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1748543970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=675c6fe8-2f2d-4d31-b537-d80c89f34810,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f416ae5dd3b42ae9f77714e26c099a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:46:54Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:46:54Z,use_quota=True,user_id='a92fd53e01d94b0b8fe7966095fbf946',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:46:54 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-79689dc2-82ff-458b-9e43-1143477466d0 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8a6a651-d361-4c31-8436-49d222a1b0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:46:54 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-79689dc2-82ff-458b-9e43-1143477466d0 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8a6a651-d361-4c31-8436-49d222a1b0fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:46:54 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-79689dc2-82ff-458b-9e43-1143477466d0 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0b3e7ef-c018-48c5-a130-6d8950aba706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:46:54 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-79689dc2-82ff-458b-9e43-1143477466d0 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0b3e7ef-c018-48c5-a130-6d8950aba706) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '675c6fe8-2f2d-4d31-b537-d80c89f34810', 'volume_name': 'volume-675c6fe8-2f2d-4d31-b537-d80c89f34810', 'volume_size': 2}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:46:54 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-79689dc2-82ff-458b-9e43-1143477466d0 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96c2eddc-96b3-4f0a-8ecd-14b89e9aab59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:46:54 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-79689dc2-82ff-458b-9e43-1143477466d0 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96c2eddc-96b3-4f0a-8ecd-14b89e9aab59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:46:54 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-79689dc2-82ff-458b-9e43-1143477466d0 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13cf6dd7-04c9-4013-b965-32754fae761c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:46:54 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-79689dc2-82ff-458b-9e43-1143477466d0 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] Volume 675c6fe8-2f2d-4d31-b537-d80c89f34810: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-675c6fe8-2f2d-4d31-b537-d80c89f34810', 'volume_size': 2} Jun 17 05:46:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-79689dc2-82ff-458b-9e43-1143477466d0 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:46:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-79689dc2-82ff-458b-9e43-1143477466d0 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:46:54 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-79689dc2-82ff-458b-9e43-1143477466d0 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:46:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1748543970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=675c6fe8-2f2d-4d31-b537-d80c89f34810,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f416ae5dd3b42ae9f77714e26c099a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:46:54Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:46:54Z,use_quota=True,user_id='a92fd53e01d94b0b8fe7966095fbf946',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:46:54 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-79689dc2-82ff-458b-9e43-1143477466d0 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] Creating volume 675c6fe8-2f2d-4d31-b537-d80c89f34810 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:46:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-79689dc2-82ff-458b-9e43-1143477466d0 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:46:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-79689dc2-82ff-458b-9e43-1143477466d0 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:46:54 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-79689dc2-82ff-458b-9e43-1143477466d0 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:46:54 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-79689dc2-82ff-458b-9e43-1143477466d0 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:46:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-79689dc2-82ff-458b-9e43-1143477466d0 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:46:54 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-79689dc2-82ff-458b-9e43-1143477466d0 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:46:54 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-79689dc2-82ff-458b-9e43-1143477466d0 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:46:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-79689dc2-82ff-458b-9e43-1143477466d0 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-675c6fe8-2f2d-4d31-b537-d80c89f34810 2147483648 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:46:54 devstack sudo[101148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-675c6fe8-2f2d-4d31-b537-d80c89f34810 2147483648 Jun 17 05:46:54 devstack sudo[101148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:46:55 devstack sudo[101146]: pam_unix(sudo:session): session closed for user root Jun 17 05:46:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e018dbc5-9390-4b6b-9a5c-20e102025561 tempest-SnapshotMetadataTestJSON-1886618429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-830cd216-9492-4486-9fd0-15370cca80a4" returned: 0 in 1.439s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:46:55 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-e018dbc5-9390-4b6b-9a5c-20e102025561 tempest-SnapshotMetadataTestJSON-1886618429 None] Lock "cinder-quobyte-830cd216-9492-4486-9fd0-15370cca80a4" released by "delete_volume" :: held 2.490s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:46:55 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-e018dbc5-9390-4b6b-9a5c-20e102025561 tempest-SnapshotMetadataTestJSON-1886618429 None] Created reservations ['b86a1716-6e3a-4e68-81be-988f92c75d0d', '2feb44b4-f6dd-4a68-8261-c6d75412b35d', '3cf57f74-6ce0-40eb-99a1-42c77952e439', 'fa0bd6d7-749d-4a40-8d04-4605d90b8c64'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:46:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e018dbc5-9390-4b6b-9a5c-20e102025561 tempest-SnapshotMetadataTestJSON-1886618429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:46:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e018dbc5-9390-4b6b-9a5c-20e102025561 tempest-SnapshotMetadataTestJSON-1886618429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:46:55 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-e018dbc5-9390-4b6b-9a5c-20e102025561 tempest-SnapshotMetadataTestJSON-1886618429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:46:55 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-e018dbc5-9390-4b6b-9a5c-20e102025561 tempest-SnapshotMetadataTestJSON-1886618429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:46:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e018dbc5-9390-4b6b-9a5c-20e102025561 tempest-SnapshotMetadataTestJSON-1886618429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:46:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e018dbc5-9390-4b6b-9a5c-20e102025561 tempest-SnapshotMetadataTestJSON-1886618429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:46:56 devstack sudo[101206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:46:56 devstack sudo[101206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:46:56 devstack sudo[101148]: pam_unix(sudo:session): session closed for user root Jun 17 05:46:56 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-79689dc2-82ff-458b-9e43-1143477466d0 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-675c6fe8-2f2d-4d31-b537-d80c89f34810 2147483648" returned: 0 in 2.360s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:46:56 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-79689dc2-82ff-458b-9e43-1143477466d0 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-675c6fe8-2f2d-4d31-b537-d80c89f34810 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:46:56 devstack sudo[101219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-675c6fe8-2f2d-4d31-b537-d80c89f34810 Jun 17 05:46:56 devstack sudo[101219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:46:57 devstack sudo[101206]: pam_unix(sudo:session): session closed for user root Jun 17 05:46:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e018dbc5-9390-4b6b-9a5c-20e102025561 tempest-SnapshotMetadataTestJSON-1886618429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 2.083s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:46:57 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-e018dbc5-9390-4b6b-9a5c-20e102025561 tempest-SnapshotMetadataTestJSON-1886618429 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:46:58 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-e018dbc5-9390-4b6b-9a5c-20e102025561 tempest-SnapshotMetadataTestJSON-1886618429 None] Deleted volume successfully. Jun 17 05:46:58 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-e018dbc5-9390-4b6b-9a5c-20e102025561 tempest-SnapshotMetadataTestJSON-1886618429 None] Lock "cinder-830cd216-9492-4486-9fd0-15370cca80a4-delete_volume" released by "delete_volume" :: held 5.304s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:46:58 devstack sudo[101219]: pam_unix(sudo:session): session closed for user root Jun 17 05:46:58 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-79689dc2-82ff-458b-9e43-1143477466d0 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-675c6fe8-2f2d-4d31-b537-d80c89f34810" returned: 0 in 1.216s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:46:58 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-79689dc2-82ff-458b-9e43-1143477466d0 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] <== create_volume: return (3704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:46:58 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-79689dc2-82ff-458b-9e43-1143477466d0 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.712s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:46:58 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-79689dc2-82ff-458b-9e43-1143477466d0 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13cf6dd7-04c9-4013-b965-32754fae761c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-675c6fe8-2f2d-4d31-b537-d80c89f34810', 'volume_size': 2}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:46:58 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-79689dc2-82ff-458b-9e43-1143477466d0 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c81a25f4-1eba-44e2-b939-4f1c7c6aafa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:46:58 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-79689dc2-82ff-458b-9e43-1143477466d0 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] Volume volume-675c6fe8-2f2d-4d31-b537-d80c89f34810 (675c6fe8-2f2d-4d31-b537-d80c89f34810): created successfully Jun 17 05:46:58 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-79689dc2-82ff-458b-9e43-1143477466d0 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c81a25f4-1eba-44e2-b939-4f1c7c6aafa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:46:58 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-79689dc2-82ff-458b-9e43-1143477466d0 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] Flow 'volume_create_manager' (101f5328-8ad5-4671-829f-780be9503580) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:46:58 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-79689dc2-82ff-458b-9e43-1143477466d0 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] Created volume successfully. Jun 17 05:46:59 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-0a527ca3-a760-400a-b1c8-3ec304f1e4a2 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:46:59 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-0a527ca3-a760-400a-b1c8-3ec304f1e4a2 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:46:59 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-0a527ca3-a760-400a-b1c8-3ec304f1e4a2 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] Creating offline snapshot f733b34d-9ba6-4583-b612-e8ac0f84bd7b of volume 675c6fe8-2f2d-4d31-b537-d80c89f34810 {{(pid=92083) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 17 05:46:59 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c05723-20d4-431e-98d7-814a6be419e1]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:46:59 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0a527ca3-a760-400a-b1c8-3ec304f1e4a2 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-675c6fe8-2f2d-4d31-b537-d80c89f34810 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:46:59 devstack sudo[101225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-675c6fe8-2f2d-4d31-b537-d80c89f34810 Jun 17 05:46:59 devstack sudo[101225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:47:01 devstack sudo[101225]: pam_unix(sudo:session): session closed for user root Jun 17 05:47:01 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0a527ca3-a760-400a-b1c8-3ec304f1e4a2 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-675c6fe8-2f2d-4d31-b537-d80c89f34810" returned: 0 in 1.403s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:47:01 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0a527ca3-a760-400a-b1c8-3ec304f1e4a2 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-675c6fe8-2f2d-4d31-b537-d80c89f34810,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-675c6fe8-2f2d-4d31-b537-d80c89f34810.f733b34d-9ba6-4583-b612-e8ac0f84bd7b 2G {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:47:01 devstack sudo[101231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-675c6fe8-2f2d-4d31-b537-d80c89f34810,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-675c6fe8-2f2d-4d31-b537-d80c89f34810.f733b34d-9ba6-4583-b612-e8ac0f84bd7b 2G Jun 17 05:47:01 devstack sudo[101231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:47:02 devstack sudo[101231]: pam_unix(sudo:session): session closed for user root Jun 17 05:47:02 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0a527ca3-a760-400a-b1c8-3ec304f1e4a2 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-675c6fe8-2f2d-4d31-b537-d80c89f34810,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-675c6fe8-2f2d-4d31-b537-d80c89f34810.f733b34d-9ba6-4583-b612-e8ac0f84bd7b 2G" returned: 0 in 1.540s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:47:02 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0a527ca3-a760-400a-b1c8-3ec304f1e4a2 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-675c6fe8-2f2d-4d31-b537-d80c89f34810 -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-675c6fe8-2f2d-4d31-b537-d80c89f34810.f733b34d-9ba6-4583-b612-e8ac0f84bd7b {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:47:02 devstack sudo[101260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-675c6fe8-2f2d-4d31-b537-d80c89f34810 -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-675c6fe8-2f2d-4d31-b537-d80c89f34810.f733b34d-9ba6-4583-b612-e8ac0f84bd7b Jun 17 05:47:02 devstack sudo[101260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:47:03 devstack sudo[101260]: pam_unix(sudo:session): session closed for user root Jun 17 05:47:03 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0a527ca3-a760-400a-b1c8-3ec304f1e4a2 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-675c6fe8-2f2d-4d31-b537-d80c89f34810 -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-675c6fe8-2f2d-4d31-b537-d80c89f34810.f733b34d-9ba6-4583-b612-e8ac0f84bd7b" returned: 0 in 1.241s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:47:03 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [None req-0a527ca3-a760-400a-b1c8-3ec304f1e4a2 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-675c6fe8-2f2d-4d31-b537-d80c89f34810.f733b34d-9ba6-4583-b612-e8ac0f84bd7b is being set with open permissions: ugo+rw Jun 17 05:47:03 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0a527ca3-a760-400a-b1c8-3ec304f1e4a2 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-675c6fe8-2f2d-4d31-b537-d80c89f34810.f733b34d-9ba6-4583-b612-e8ac0f84bd7b {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:47:03 devstack sudo[101312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-675c6fe8-2f2d-4d31-b537-d80c89f34810.f733b34d-9ba6-4583-b612-e8ac0f84bd7b Jun 17 05:47:03 devstack sudo[101312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:47:05 devstack sudo[101312]: pam_unix(sudo:session): session closed for user root Jun 17 05:47:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0a527ca3-a760-400a-b1c8-3ec304f1e4a2 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-675c6fe8-2f2d-4d31-b537-d80c89f34810.f733b34d-9ba6-4583-b612-e8ac0f84bd7b" returned: 0 in 1.193s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:47:05 devstack cinder-volume[92083]: DEBUG dbcounter [-] [92083] Writing DB stats cinder:SELECT=72,cinder:INSERT=26,cinder:UPDATE=74,cinder:DELETE=6 {{(pid=92083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:47:05 devstack cinder-volume[92083]: DEBUG dbcounter [-] [92083] Writing DB stats cinder:UPDATE=73,cinder:SELECT=68,cinder:INSERT=28,cinder:DELETE=7 {{(pid=92083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:47:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0a527ca3-a760-400a-b1c8-3ec304f1e4a2 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-675c6fe8-2f2d-4d31-b537-d80c89f34810.info {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:47:05 devstack sudo[101348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-675c6fe8-2f2d-4d31-b537-d80c89f34810.info Jun 17 05:47:05 devstack sudo[101348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:47:05 devstack sudo[101348]: pam_unix(sudo:session): session closed for user root Jun 17 05:47:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0a527ca3-a760-400a-b1c8-3ec304f1e4a2 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-675c6fe8-2f2d-4d31-b537-d80c89f34810.info" returned: 0 in 0.812s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:47:05 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [None req-0a527ca3-a760-400a-b1c8-3ec304f1e4a2 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-675c6fe8-2f2d-4d31-b537-d80c89f34810.info is being set with open permissions: ugo+rw Jun 17 05:47:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0a527ca3-a760-400a-b1c8-3ec304f1e4a2 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-675c6fe8-2f2d-4d31-b537-d80c89f34810.info {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:47:05 devstack sudo[101351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-675c6fe8-2f2d-4d31-b537-d80c89f34810.info Jun 17 05:47:05 devstack sudo[101351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:47:06 devstack sudo[101351]: pam_unix(sudo:session): session closed for user root Jun 17 05:47:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0a527ca3-a760-400a-b1c8-3ec304f1e4a2 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-675c6fe8-2f2d-4d31-b537-d80c89f34810.info" returned: 0 in 0.606s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:47:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-0a527ca3-a760-400a-b1c8-3ec304f1e4a2 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.939s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:47:06 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-0a527ca3-a760-400a-b1c8-3ec304f1e4a2 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] Create snapshot completed successfully Jun 17 05:47:07 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b97c57d-057e-46e2-86cb-f8a4c819defb tempest-AbsoluteLimitsTests-2096168513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:47:07 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4b97c57d-057e-46e2-86cb-f8a4c819defb tempest-AbsoluteLimitsTests-2096168513 None] Flow 'volume_create_manager' (aa77074b-4f96-4dcf-aff4-828e73ba771c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:47:07 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4b97c57d-057e-46e2-86cb-f8a4c819defb tempest-AbsoluteLimitsTests-2096168513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (335829e3-a378-4e46-9dd6-7a7e635d7df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:47:07 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4b97c57d-057e-46e2-86cb-f8a4c819defb tempest-AbsoluteLimitsTests-2096168513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (335829e3-a378-4e46-9dd6-7a7e635d7df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:47:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-289711639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85a656f3-cff8-4ac8-90c5-4805305c4960,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47e66d15da5c4aed86a0b9f90d393494',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:47:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:47:07Z,use_quota=True,user_id='e38fbcc74ccd4d46a8edf84c9b391179',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:47:07 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4b97c57d-057e-46e2-86cb-f8a4c819defb tempest-AbsoluteLimitsTests-2096168513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e48c9f0b-fd87-4b1b-a6a9-b4024f87d331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:47:07 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4b97c57d-057e-46e2-86cb-f8a4c819defb tempest-AbsoluteLimitsTests-2096168513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e48c9f0b-fd87-4b1b-a6a9-b4024f87d331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:47:07 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4b97c57d-057e-46e2-86cb-f8a4c819defb tempest-AbsoluteLimitsTests-2096168513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e755619-c7f0-49c9-ad1a-3891b3e8ffa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:47:07 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4b97c57d-057e-46e2-86cb-f8a4c819defb tempest-AbsoluteLimitsTests-2096168513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e755619-c7f0-49c9-ad1a-3891b3e8ffa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85a656f3-cff8-4ac8-90c5-4805305c4960', 'volume_name': 'volume-85a656f3-cff8-4ac8-90c5-4805305c4960', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:47:07 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4b97c57d-057e-46e2-86cb-f8a4c819defb tempest-AbsoluteLimitsTests-2096168513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (436d445b-b08b-463a-92f8-d576d70fd06d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:47:07 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4b97c57d-057e-46e2-86cb-f8a4c819defb tempest-AbsoluteLimitsTests-2096168513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (436d445b-b08b-463a-92f8-d576d70fd06d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:47:07 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4b97c57d-057e-46e2-86cb-f8a4c819defb tempest-AbsoluteLimitsTests-2096168513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c19c576-317b-4f0d-84c2-a168b7920f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:47:07 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-4b97c57d-057e-46e2-86cb-f8a4c819defb tempest-AbsoluteLimitsTests-2096168513 None] Volume 85a656f3-cff8-4ac8-90c5-4805305c4960: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85a656f3-cff8-4ac8-90c5-4805305c4960', 'volume_size': 1} Jun 17 05:47:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-4b97c57d-057e-46e2-86cb-f8a4c819defb tempest-AbsoluteLimitsTests-2096168513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:47:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-4b97c57d-057e-46e2-86cb-f8a4c819defb tempest-AbsoluteLimitsTests-2096168513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:47:07 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-4b97c57d-057e-46e2-86cb-f8a4c819defb tempest-AbsoluteLimitsTests-2096168513 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:47:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-289711639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85a656f3-cff8-4ac8-90c5-4805305c4960,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47e66d15da5c4aed86a0b9f90d393494',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:47:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:47:07Z,use_quota=True,user_id='e38fbcc74ccd4d46a8edf84c9b391179',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:47:07 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-4b97c57d-057e-46e2-86cb-f8a4c819defb tempest-AbsoluteLimitsTests-2096168513 None] Creating volume 85a656f3-cff8-4ac8-90c5-4805305c4960 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:47:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-4b97c57d-057e-46e2-86cb-f8a4c819defb tempest-AbsoluteLimitsTests-2096168513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:47:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-4b97c57d-057e-46e2-86cb-f8a4c819defb tempest-AbsoluteLimitsTests-2096168513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:47:07 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-4b97c57d-057e-46e2-86cb-f8a4c819defb tempest-AbsoluteLimitsTests-2096168513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:47:07 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-4b97c57d-057e-46e2-86cb-f8a4c819defb tempest-AbsoluteLimitsTests-2096168513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:47:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-4b97c57d-057e-46e2-86cb-f8a4c819defb tempest-AbsoluteLimitsTests-2096168513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:47:07 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-4b97c57d-057e-46e2-86cb-f8a4c819defb tempest-AbsoluteLimitsTests-2096168513 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:47:07 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-4b97c57d-057e-46e2-86cb-f8a4c819defb tempest-AbsoluteLimitsTests-2096168513 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:47:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4b97c57d-057e-46e2-86cb-f8a4c819defb tempest-AbsoluteLimitsTests-2096168513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-85a656f3-cff8-4ac8-90c5-4805305c4960 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:47:07 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-57603e1d-2d39-435f-9403-9972ebd9c997 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] Acquiring lock "cinder-f733b34d-9ba6-4583-b612-e8ac0f84bd7b-delete_snapshot" by "delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:47:07 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-57603e1d-2d39-435f-9403-9972ebd9c997 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] Lock "cinder-f733b34d-9ba6-4583-b612-e8ac0f84bd7b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:47:07 devstack sudo[101354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-85a656f3-cff8-4ac8-90c5-4805305c4960 1073741824 Jun 17 05:47:07 devstack sudo[101354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:47:07 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-57603e1d-2d39-435f-9403-9972ebd9c997 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] Acquiring lock "cinder-quobyte-675c6fe8-2f2d-4d31-b537-d80c89f34810" by "delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:47:07 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-57603e1d-2d39-435f-9403-9972ebd9c997 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] Lock "cinder-quobyte-675c6fe8-2f2d-4d31-b537-d80c89f34810" acquired by "delete_snapshot" :: waited 0.018s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:47:07 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-57603e1d-2d39-435f-9403-9972ebd9c997 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] Acquiring lock "cinder-quobyte-f733b34d-9ba6-4583-b612-e8ac0f84bd7b" by "_delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:47:07 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-57603e1d-2d39-435f-9403-9972ebd9c997 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] Lock "cinder-quobyte-f733b34d-9ba6-4583-b612-e8ac0f84bd7b" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:47:07 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-57603e1d-2d39-435f-9403-9972ebd9c997 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] Deleting offline snapshot f733b34d-9ba6-4583-b612-e8ac0f84bd7b of volume 675c6fe8-2f2d-4d31-b537-d80c89f34810 {{(pid=92083) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 17 05:47:07 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-57603e1d-2d39-435f-9403-9972ebd9c997 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] snapshot_file for this snap is: volume-675c6fe8-2f2d-4d31-b537-d80c89f34810.f733b34d-9ba6-4583-b612-e8ac0f84bd7b {{(pid=92083) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 17 05:47:07 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e844b2-d527-40df-9fb2-3f3daf24885c]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:47:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-57603e1d-2d39-435f-9403-9972ebd9c997 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-675c6fe8-2f2d-4d31-b537-d80c89f34810.f733b34d-9ba6-4583-b612-e8ac0f84bd7b {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:47:07 devstack sudo[101356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-675c6fe8-2f2d-4d31-b537-d80c89f34810.f733b34d-9ba6-4583-b612-e8ac0f84bd7b Jun 17 05:47:07 devstack sudo[101356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:47:08 devstack sudo[101354]: pam_unix(sudo:session): session closed for user root Jun 17 05:47:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4b97c57d-057e-46e2-86cb-f8a4c819defb tempest-AbsoluteLimitsTests-2096168513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-85a656f3-cff8-4ac8-90c5-4805305c4960 1073741824" returned: 0 in 0.822s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:47:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4b97c57d-057e-46e2-86cb-f8a4c819defb tempest-AbsoluteLimitsTests-2096168513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-85a656f3-cff8-4ac8-90c5-4805305c4960 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:47:08 devstack sudo[101356]: pam_unix(sudo:session): session closed for user root Jun 17 05:47:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-57603e1d-2d39-435f-9403-9972ebd9c997 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-675c6fe8-2f2d-4d31-b537-d80c89f34810.f733b34d-9ba6-4583-b612-e8ac0f84bd7b" returned: 0 in 0.770s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:47:08 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-57603e1d-2d39-435f-9403-9972ebd9c997 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-675c6fe8-2f2d-4d31-b537-d80c89f34810(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92083) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 05:47:08 devstack sudo[101366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-85a656f3-cff8-4ac8-90c5-4805305c4960 Jun 17 05:47:08 devstack sudo[101366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:47:08 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2eaa0f-4884-41e6-8738-6e3a3ab2dddc]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:47:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-57603e1d-2d39-435f-9403-9972ebd9c997 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-675c6fe8-2f2d-4d31-b537-d80c89f34810 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:47:08 devstack sudo[101368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-675c6fe8-2f2d-4d31-b537-d80c89f34810 Jun 17 05:47:08 devstack sudo[101368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:47:08 devstack sudo[101366]: pam_unix(sudo:session): session closed for user root Jun 17 05:47:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4b97c57d-057e-46e2-86cb-f8a4c819defb tempest-AbsoluteLimitsTests-2096168513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-85a656f3-cff8-4ac8-90c5-4805305c4960" returned: 0 in 0.693s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:47:08 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-4b97c57d-057e-46e2-86cb-f8a4c819defb tempest-AbsoluteLimitsTests-2096168513 None] <== create_volume: return (1566ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:47:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-4b97c57d-057e-46e2-86cb-f8a4c819defb tempest-AbsoluteLimitsTests-2096168513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.571s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:47:08 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4b97c57d-057e-46e2-86cb-f8a4c819defb tempest-AbsoluteLimitsTests-2096168513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c19c576-317b-4f0d-84c2-a168b7920f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85a656f3-cff8-4ac8-90c5-4805305c4960', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:47:08 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4b97c57d-057e-46e2-86cb-f8a4c819defb tempest-AbsoluteLimitsTests-2096168513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eed9491-21a2-46ac-b586-59427e1fd692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:47:08 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-4b97c57d-057e-46e2-86cb-f8a4c819defb tempest-AbsoluteLimitsTests-2096168513 None] Volume volume-85a656f3-cff8-4ac8-90c5-4805305c4960 (85a656f3-cff8-4ac8-90c5-4805305c4960): created successfully Jun 17 05:47:08 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4b97c57d-057e-46e2-86cb-f8a4c819defb tempest-AbsoluteLimitsTests-2096168513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eed9491-21a2-46ac-b586-59427e1fd692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:47:08 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4b97c57d-057e-46e2-86cb-f8a4c819defb tempest-AbsoluteLimitsTests-2096168513 None] Flow 'volume_create_manager' (aa77074b-4f96-4dcf-aff4-828e73ba771c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:47:08 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-4b97c57d-057e-46e2-86cb-f8a4c819defb tempest-AbsoluteLimitsTests-2096168513 None] Created volume successfully. Jun 17 05:47:09 devstack sudo[101368]: pam_unix(sudo:session): session closed for user root Jun 17 05:47:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-57603e1d-2d39-435f-9403-9972ebd9c997 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-675c6fe8-2f2d-4d31-b537-d80c89f34810" returned: 0 in 0.741s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:47:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-57603e1d-2d39-435f-9403-9972ebd9c997 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-675c6fe8-2f2d-4d31-b537-d80c89f34810.f733b34d-9ba6-4583-b612-e8ac0f84bd7b {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:47:09 devstack sudo[101376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-675c6fe8-2f2d-4d31-b537-d80c89f34810.f733b34d-9ba6-4583-b612-e8ac0f84bd7b Jun 17 05:47:09 devstack sudo[101376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:47:09 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-8aa27981-7ca9-4ddc-9d13-afd2622a90f0 tempest-AbsoluteLimitsTests-2096168513 None] Acquiring lock "cinder-85a656f3-cff8-4ac8-90c5-4805305c4960-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:47:09 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-8aa27981-7ca9-4ddc-9d13-afd2622a90f0 tempest-AbsoluteLimitsTests-2096168513 None] Lock "cinder-85a656f3-cff8-4ac8-90c5-4805305c4960-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:47:09 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-8aa27981-7ca9-4ddc-9d13-afd2622a90f0 tempest-AbsoluteLimitsTests-2096168513 None] Acquiring lock "cinder-quobyte-85a656f3-cff8-4ac8-90c5-4805305c4960" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:47:09 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-8aa27981-7ca9-4ddc-9d13-afd2622a90f0 tempest-AbsoluteLimitsTests-2096168513 None] Lock "cinder-quobyte-85a656f3-cff8-4ac8-90c5-4805305c4960" acquired by "delete_volume" :: waited 0.016s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:47:09 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[80bfdf69-0d3e-4f57-8732-0f69e0a31c30]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:47:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8aa27981-7ca9-4ddc-9d13-afd2622a90f0 tempest-AbsoluteLimitsTests-2096168513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-85a656f3-cff8-4ac8-90c5-4805305c4960 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:47:09 devstack sudo[101376]: pam_unix(sudo:session): session closed for user root Jun 17 05:47:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-57603e1d-2d39-435f-9403-9972ebd9c997 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-675c6fe8-2f2d-4d31-b537-d80c89f34810.f733b34d-9ba6-4583-b612-e8ac0f84bd7b" returned: 0 in 0.752s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:47:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-57603e1d-2d39-435f-9403-9972ebd9c997 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-675c6fe8-2f2d-4d31-b537-d80c89f34810.f733b34d-9ba6-4583-b612-e8ac0f84bd7b {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:47:09 devstack sudo[101383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-675c6fe8-2f2d-4d31-b537-d80c89f34810.f733b34d-9ba6-4583-b612-e8ac0f84bd7b Jun 17 05:47:09 devstack sudo[101383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:47:09 devstack sudo[101382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-85a656f3-cff8-4ac8-90c5-4805305c4960 Jun 17 05:47:09 devstack sudo[101382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:47:10 devstack sudo[101383]: pam_unix(sudo:session): session closed for user root Jun 17 05:47:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-57603e1d-2d39-435f-9403-9972ebd9c997 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-675c6fe8-2f2d-4d31-b537-d80c89f34810.f733b34d-9ba6-4583-b612-e8ac0f84bd7b" returned: 0 in 0.709s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:47:10 devstack sudo[101382]: pam_unix(sudo:session): session closed for user root Jun 17 05:47:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8aa27981-7ca9-4ddc-9d13-afd2622a90f0 tempest-AbsoluteLimitsTests-2096168513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-85a656f3-cff8-4ac8-90c5-4805305c4960" returned: 0 in 0.811s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:47:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8aa27981-7ca9-4ddc-9d13-afd2622a90f0 tempest-AbsoluteLimitsTests-2096168513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-85a656f3-cff8-4ac8-90c5-4805305c4960 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:47:10 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-57603e1d-2d39-435f-9403-9972ebd9c997 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] Lock "cinder-quobyte-f733b34d-9ba6-4583-b612-e8ac0f84bd7b" released by "_delete_snapshot" :: held 3.150s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:47:10 devstack sudo[101410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-85a656f3-cff8-4ac8-90c5-4805305c4960 Jun 17 05:47:10 devstack sudo[101410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:47:10 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-57603e1d-2d39-435f-9403-9972ebd9c997 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] Lock "cinder-quobyte-675c6fe8-2f2d-4d31-b537-d80c89f34810" released by "delete_snapshot" :: held 3.190s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:47:10 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-57603e1d-2d39-435f-9403-9972ebd9c997 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] Created reservations ['b71a249e-e648-423b-acbc-85deace89bf5', '895587c8-bcf2-4e07-be16-921e0737d4f5', 'c002a889-72a7-4ee6-b83f-4b4357531a4b', '031e2894-3e19-4f6a-a850-eb7475e001d7'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:47:10 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-57603e1d-2d39-435f-9403-9972ebd9c997 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] Delete snapshot completed successfully. Jun 17 05:47:10 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-57603e1d-2d39-435f-9403-9972ebd9c997 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] Lock "cinder-f733b34d-9ba6-4583-b612-e8ac0f84bd7b-delete_snapshot" released by "delete_snapshot" :: held 3.381s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:47:11 devstack sudo[101410]: pam_unix(sudo:session): session closed for user root Jun 17 05:47:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8aa27981-7ca9-4ddc-9d13-afd2622a90f0 tempest-AbsoluteLimitsTests-2096168513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-85a656f3-cff8-4ac8-90c5-4805305c4960" returned: 0 in 0.663s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:47:11 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-8aa27981-7ca9-4ddc-9d13-afd2622a90f0 tempest-AbsoluteLimitsTests-2096168513 None] Lock "cinder-quobyte-85a656f3-cff8-4ac8-90c5-4805305c4960" released by "delete_volume" :: held 1.522s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:47:11 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-8aa27981-7ca9-4ddc-9d13-afd2622a90f0 tempest-AbsoluteLimitsTests-2096168513 None] Created reservations ['12e66a86-7d82-4110-80ea-f6b8f3838a7b', '6abd3b55-3ebb-4758-89e9-1fc51991ac51', '53cd240f-37c2-4203-a871-0b6d426710f0', '3b8782e6-6d27-46bc-8d75-29f07b9e9a6f'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:47:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-8aa27981-7ca9-4ddc-9d13-afd2622a90f0 tempest-AbsoluteLimitsTests-2096168513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:47:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-8aa27981-7ca9-4ddc-9d13-afd2622a90f0 tempest-AbsoluteLimitsTests-2096168513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:47:11 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-8aa27981-7ca9-4ddc-9d13-afd2622a90f0 tempest-AbsoluteLimitsTests-2096168513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:47:11 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-8aa27981-7ca9-4ddc-9d13-afd2622a90f0 tempest-AbsoluteLimitsTests-2096168513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:47:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-8aa27981-7ca9-4ddc-9d13-afd2622a90f0 tempest-AbsoluteLimitsTests-2096168513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:47:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8aa27981-7ca9-4ddc-9d13-afd2622a90f0 tempest-AbsoluteLimitsTests-2096168513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:47:11 devstack sudo[101413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:47:11 devstack sudo[101413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:47:11 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-19581788-d12c-40c8-b99c-696bea422f87 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] Acquiring lock "cinder-675c6fe8-2f2d-4d31-b537-d80c89f34810-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:47:11 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-19581788-d12c-40c8-b99c-696bea422f87 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] Lock "cinder-675c6fe8-2f2d-4d31-b537-d80c89f34810-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:47:11 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-19581788-d12c-40c8-b99c-696bea422f87 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] Acquiring lock "cinder-quobyte-675c6fe8-2f2d-4d31-b537-d80c89f34810" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:47:11 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-19581788-d12c-40c8-b99c-696bea422f87 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] Lock "cinder-quobyte-675c6fe8-2f2d-4d31-b537-d80c89f34810" acquired by "delete_volume" :: waited 0.024s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:47:11 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[091989d0-8a18-4f63-ae5a-6105574350dd]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:47:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-19581788-d12c-40c8-b99c-696bea422f87 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-675c6fe8-2f2d-4d31-b537-d80c89f34810 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:47:11 devstack sudo[101415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-675c6fe8-2f2d-4d31-b537-d80c89f34810 Jun 17 05:47:11 devstack sudo[101415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:47:12 devstack sudo[101413]: pam_unix(sudo:session): session closed for user root Jun 17 05:47:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8aa27981-7ca9-4ddc-9d13-afd2622a90f0 tempest-AbsoluteLimitsTests-2096168513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.749s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:47:12 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-8aa27981-7ca9-4ddc-9d13-afd2622a90f0 tempest-AbsoluteLimitsTests-2096168513 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:47:12 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-8aa27981-7ca9-4ddc-9d13-afd2622a90f0 tempest-AbsoluteLimitsTests-2096168513 None] Deleted volume successfully. Jun 17 05:47:12 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-8aa27981-7ca9-4ddc-9d13-afd2622a90f0 tempest-AbsoluteLimitsTests-2096168513 None] Lock "cinder-85a656f3-cff8-4ac8-90c5-4805305c4960-delete_volume" released by "delete_volume" :: held 2.525s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:47:12 devstack sudo[101415]: pam_unix(sudo:session): session closed for user root Jun 17 05:47:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-19581788-d12c-40c8-b99c-696bea422f87 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-675c6fe8-2f2d-4d31-b537-d80c89f34810" returned: 0 in 0.814s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:47:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-19581788-d12c-40c8-b99c-696bea422f87 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-675c6fe8-2f2d-4d31-b537-d80c89f34810 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:47:12 devstack sudo[101421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-675c6fe8-2f2d-4d31-b537-d80c89f34810 Jun 17 05:47:12 devstack sudo[101421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:47:13 devstack sudo[101421]: pam_unix(sudo:session): session closed for user root Jun 17 05:47:13 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-19581788-d12c-40c8-b99c-696bea422f87 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-675c6fe8-2f2d-4d31-b537-d80c89f34810" returned: 0 in 0.745s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:47:13 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-19581788-d12c-40c8-b99c-696bea422f87 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] Lock "cinder-quobyte-675c6fe8-2f2d-4d31-b537-d80c89f34810" released by "delete_volume" :: held 1.658s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:47:13 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-19581788-d12c-40c8-b99c-696bea422f87 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] Created reservations ['acd35e65-5060-4dff-887c-0a243b9873f6', '8b8bd84b-9822-413c-a1d8-3a2a03ce1038', 'cbde90ac-c1df-48d9-ba82-c52a8254eade', '54cc1fc1-0c3b-4ccf-b7b7-352dcdb73298'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:47:13 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-19581788-d12c-40c8-b99c-696bea422f87 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:47:13 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-19581788-d12c-40c8-b99c-696bea422f87 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:47:13 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-19581788-d12c-40c8-b99c-696bea422f87 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:47:13 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-19581788-d12c-40c8-b99c-696bea422f87 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:47:13 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-19581788-d12c-40c8-b99c-696bea422f87 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:47:13 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-19581788-d12c-40c8-b99c-696bea422f87 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:47:13 devstack sudo[101429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:47:13 devstack sudo[101429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:47:14 devstack sudo[101429]: pam_unix(sudo:session): session closed for user root Jun 17 05:47:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-19581788-d12c-40c8-b99c-696bea422f87 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.634s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:47:14 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-19581788-d12c-40c8-b99c-696bea422f87 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:47:14 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-19581788-d12c-40c8-b99c-696bea422f87 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] Deleted volume successfully. Jun 17 05:47:14 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-19581788-d12c-40c8-b99c-696bea422f87 tempest-VolumesSnapshotNegativeTestJSON-126023310 None] Lock "cinder-675c6fe8-2f2d-4d31-b537-d80c89f34810-delete_volume" released by "delete_volume" :: held 2.557s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:47:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-a1151bfb-0eb0-458e-a447-9206954f7b54 req-0b696756-5fbe-41e7-b464-68d73ea2422d tempest-TestInstancesWithCinderVolumes-461180917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:47:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-a1151bfb-0eb0-458e-a447-9206954f7b54 req-0b696756-5fbe-41e7-b464-68d73ea2422d tempest-TestInstancesWithCinderVolumes-461180917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:47:16 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[751d90c2-955b-45e0-88c2-8b6fc31d3051]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:47:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-a1151bfb-0eb0-458e-a447-9206954f7b54 req-0b696756-5fbe-41e7-b464-68d73ea2422d tempest-TestInstancesWithCinderVolumes-461180917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-eccf11ea-9b27-4d82-a92e-16647136f4fc {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:47:16 devstack sudo[101446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-eccf11ea-9b27-4d82-a92e-16647136f4fc Jun 17 05:47:16 devstack sudo[101446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:47:17 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-adc26112-23c9-4f24-8947-434488f57975 tempest-VolumesTransfersTest-1504320769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:47:17 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-adc26112-23c9-4f24-8947-434488f57975 tempest-VolumesTransfersTest-1504320769 None] Flow 'volume_create_manager' (22b1b380-381d-499a-be6a-87ab478d9ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:47:17 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-adc26112-23c9-4f24-8947-434488f57975 tempest-VolumesTransfersTest-1504320769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24c7eecc-eab9-42b9-8ef6-87b86362deb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:47:17 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-adc26112-23c9-4f24-8947-434488f57975 tempest-VolumesTransfersTest-1504320769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24c7eecc-eab9-42b9-8ef6-87b86362deb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:47:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-576027199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be2fc4f9-c8f2-48e6-8612-acd6b8205531,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c82a5c50d0ca424d839f4868da32fce9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:47:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:47:18Z,use_quota=True,user_id='6a98ac929138411b8b90f2a7f28d3d5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:47:17 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-adc26112-23c9-4f24-8947-434488f57975 tempest-VolumesTransfersTest-1504320769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (834635fa-18c2-43e0-8297-e263ffd7a41b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:47:17 devstack sudo[101446]: pam_unix(sudo:session): session closed for user root Jun 17 05:47:17 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-adc26112-23c9-4f24-8947-434488f57975 tempest-VolumesTransfersTest-1504320769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (834635fa-18c2-43e0-8297-e263ffd7a41b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:47:17 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-adc26112-23c9-4f24-8947-434488f57975 tempest-VolumesTransfersTest-1504320769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7669968b-3080-4ad3-b399-45c8fee1232b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:47:17 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-adc26112-23c9-4f24-8947-434488f57975 tempest-VolumesTransfersTest-1504320769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7669968b-3080-4ad3-b399-45c8fee1232b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be2fc4f9-c8f2-48e6-8612-acd6b8205531', 'volume_name': 'volume-be2fc4f9-c8f2-48e6-8612-acd6b8205531', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:47:17 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-adc26112-23c9-4f24-8947-434488f57975 tempest-VolumesTransfersTest-1504320769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83423404-1178-4751-80a0-f8e2826fe912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:47:17 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-adc26112-23c9-4f24-8947-434488f57975 tempest-VolumesTransfersTest-1504320769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83423404-1178-4751-80a0-f8e2826fe912) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:47:17 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-adc26112-23c9-4f24-8947-434488f57975 tempest-VolumesTransfersTest-1504320769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44d3ba9f-fc3e-42dd-9588-1c6505b9a07d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:47:17 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-adc26112-23c9-4f24-8947-434488f57975 tempest-VolumesTransfersTest-1504320769 None] Volume be2fc4f9-c8f2-48e6-8612-acd6b8205531: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be2fc4f9-c8f2-48e6-8612-acd6b8205531', 'volume_size': 1} Jun 17 05:47:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-adc26112-23c9-4f24-8947-434488f57975 tempest-VolumesTransfersTest-1504320769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:47:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-a1151bfb-0eb0-458e-a447-9206954f7b54 req-0b696756-5fbe-41e7-b464-68d73ea2422d tempest-TestInstancesWithCinderVolumes-461180917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-eccf11ea-9b27-4d82-a92e-16647136f4fc" returned: 0 in 0.899s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:47:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-a1151bfb-0eb0-458e-a447-9206954f7b54 req-0b696756-5fbe-41e7-b464-68d73ea2422d tempest-TestInstancesWithCinderVolumes-461180917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.921s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:47:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-adc26112-23c9-4f24-8947-434488f57975 tempest-VolumesTransfersTest-1504320769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:47:17 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-adc26112-23c9-4f24-8947-434488f57975 tempest-VolumesTransfersTest-1504320769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:47:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-576027199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be2fc4f9-c8f2-48e6-8612-acd6b8205531,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c82a5c50d0ca424d839f4868da32fce9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:47:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:47:18Z,use_quota=True,user_id='6a98ac929138411b8b90f2a7f28d3d5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:47:17 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-adc26112-23c9-4f24-8947-434488f57975 tempest-VolumesTransfersTest-1504320769 None] Creating volume be2fc4f9-c8f2-48e6-8612-acd6b8205531 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:47:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-adc26112-23c9-4f24-8947-434488f57975 tempest-VolumesTransfersTest-1504320769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:47:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-adc26112-23c9-4f24-8947-434488f57975 tempest-VolumesTransfersTest-1504320769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:47:17 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-adc26112-23c9-4f24-8947-434488f57975 tempest-VolumesTransfersTest-1504320769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:47:17 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-adc26112-23c9-4f24-8947-434488f57975 tempest-VolumesTransfersTest-1504320769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:47:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-adc26112-23c9-4f24-8947-434488f57975 tempest-VolumesTransfersTest-1504320769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:47:17 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-adc26112-23c9-4f24-8947-434488f57975 tempest-VolumesTransfersTest-1504320769 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:47:17 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-adc26112-23c9-4f24-8947-434488f57975 tempest-VolumesTransfersTest-1504320769 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:47:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-adc26112-23c9-4f24-8947-434488f57975 tempest-VolumesTransfersTest-1504320769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-be2fc4f9-c8f2-48e6-8612-acd6b8205531 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:47:17 devstack sudo[101451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-be2fc4f9-c8f2-48e6-8612-acd6b8205531 1073741824 Jun 17 05:47:17 devstack sudo[101451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:47:17 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [req-a1151bfb-0eb0-458e-a447-9206954f7b54 req-0b696756-5fbe-41e7-b464-68d73ea2422d tempest-TestInstancesWithCinderVolumes-461180917 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f', 'name': 'volume-eccf11ea-9b27-4d82-a92e-16647136f4fc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '17a5c4fd-7f0d-4195-ba4e-efc23467bf3c', 'enforce_multipath': True} {{(pid=92083) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 17 05:47:17 devstack cinder-volume[92083]: INFO cinder.volume.manager [req-a1151bfb-0eb0-458e-a447-9206954f7b54 req-0b696756-5fbe-41e7-b464-68d73ea2422d tempest-TestInstancesWithCinderVolumes-461180917 None] attachment_update completed successfully. Jun 17 05:47:18 devstack sudo[101451]: pam_unix(sudo:session): session closed for user root Jun 17 05:47:18 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-adc26112-23c9-4f24-8947-434488f57975 tempest-VolumesTransfersTest-1504320769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-be2fc4f9-c8f2-48e6-8612-acd6b8205531 1073741824" returned: 0 in 0.948s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:47:18 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-adc26112-23c9-4f24-8947-434488f57975 tempest-VolumesTransfersTest-1504320769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-be2fc4f9-c8f2-48e6-8612-acd6b8205531 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:47:18 devstack sudo[101456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-be2fc4f9-c8f2-48e6-8612-acd6b8205531 Jun 17 05:47:18 devstack sudo[101456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:47:19 devstack sudo[101456]: pam_unix(sudo:session): session closed for user root Jun 17 05:47:19 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-adc26112-23c9-4f24-8947-434488f57975 tempest-VolumesTransfersTest-1504320769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-be2fc4f9-c8f2-48e6-8612-acd6b8205531" returned: 0 in 0.658s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:47:19 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-adc26112-23c9-4f24-8947-434488f57975 tempest-VolumesTransfersTest-1504320769 None] <== create_volume: return (1662ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:47:19 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-adc26112-23c9-4f24-8947-434488f57975 tempest-VolumesTransfersTest-1504320769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.665s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:47:19 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-adc26112-23c9-4f24-8947-434488f57975 tempest-VolumesTransfersTest-1504320769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44d3ba9f-fc3e-42dd-9588-1c6505b9a07d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be2fc4f9-c8f2-48e6-8612-acd6b8205531', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:47:19 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-adc26112-23c9-4f24-8947-434488f57975 tempest-VolumesTransfersTest-1504320769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (131d3680-e3aa-48a1-9ae2-0fb0969b5358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:47:19 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-adc26112-23c9-4f24-8947-434488f57975 tempest-VolumesTransfersTest-1504320769 None] Volume volume-be2fc4f9-c8f2-48e6-8612-acd6b8205531 (be2fc4f9-c8f2-48e6-8612-acd6b8205531): created successfully Jun 17 05:47:19 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-adc26112-23c9-4f24-8947-434488f57975 tempest-VolumesTransfersTest-1504320769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (131d3680-e3aa-48a1-9ae2-0fb0969b5358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:47:19 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-adc26112-23c9-4f24-8947-434488f57975 tempest-VolumesTransfersTest-1504320769 None] Flow 'volume_create_manager' (22b1b380-381d-499a-be6a-87ab478d9ab1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:47:19 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-adc26112-23c9-4f24-8947-434488f57975 tempest-VolumesTransfersTest-1504320769 None] Created volume successfully. Jun 17 05:47:20 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-c4ba4784-6a3e-4945-9b66-96ed01ec7e11 tempest-VolumesTransfersTest-52247280 None] Transfer volume completed successfully. Jun 17 05:47:21 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-0b7f953a-f4a3-41c6-9cbf-2808b515468f tempest-VolumesTransfersTest-1571231794 None] Acquiring lock "cinder-be2fc4f9-c8f2-48e6-8612-acd6b8205531-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:47:21 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-0b7f953a-f4a3-41c6-9cbf-2808b515468f tempest-VolumesTransfersTest-1571231794 None] Lock "cinder-be2fc4f9-c8f2-48e6-8612-acd6b8205531-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:47:21 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-0b7f953a-f4a3-41c6-9cbf-2808b515468f tempest-VolumesTransfersTest-1571231794 None] Acquiring lock "cinder-quobyte-be2fc4f9-c8f2-48e6-8612-acd6b8205531" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:47:21 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-0b7f953a-f4a3-41c6-9cbf-2808b515468f tempest-VolumesTransfersTest-1571231794 None] Lock "cinder-quobyte-be2fc4f9-c8f2-48e6-8612-acd6b8205531" acquired by "delete_volume" :: waited 0.018s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:47:21 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc989b6-9187-4c8c-9ab1-6484946b8699]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:47:21 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0b7f953a-f4a3-41c6-9cbf-2808b515468f tempest-VolumesTransfersTest-1571231794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-be2fc4f9-c8f2-48e6-8612-acd6b8205531 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:47:21 devstack sudo[101462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-be2fc4f9-c8f2-48e6-8612-acd6b8205531 Jun 17 05:47:21 devstack sudo[101462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:47:22 devstack sudo[101462]: pam_unix(sudo:session): session closed for user root Jun 17 05:47:22 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0b7f953a-f4a3-41c6-9cbf-2808b515468f tempest-VolumesTransfersTest-1571231794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-be2fc4f9-c8f2-48e6-8612-acd6b8205531" returned: 0 in 0.877s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:47:22 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0b7f953a-f4a3-41c6-9cbf-2808b515468f tempest-VolumesTransfersTest-1571231794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-be2fc4f9-c8f2-48e6-8612-acd6b8205531 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:47:22 devstack sudo[101473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-be2fc4f9-c8f2-48e6-8612-acd6b8205531 Jun 17 05:47:22 devstack sudo[101473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:47:23 devstack sudo[101473]: pam_unix(sudo:session): session closed for user root Jun 17 05:47:23 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0b7f953a-f4a3-41c6-9cbf-2808b515468f tempest-VolumesTransfersTest-1571231794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-be2fc4f9-c8f2-48e6-8612-acd6b8205531" returned: 0 in 0.690s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:47:23 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-0b7f953a-f4a3-41c6-9cbf-2808b515468f tempest-VolumesTransfersTest-1571231794 None] Lock "cinder-quobyte-be2fc4f9-c8f2-48e6-8612-acd6b8205531" released by "delete_volume" :: held 1.620s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:47:23 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-0b7f953a-f4a3-41c6-9cbf-2808b515468f tempest-VolumesTransfersTest-1571231794 None] Created reservations ['9dfa2025-e21d-4ae3-a22b-b7f4d17fb3ff', 'fadceb4e-d0c9-4995-ab9a-d0b454244f5d', '1cf9f0a7-9bb1-4993-829b-cd80298c635f', '60bf4826-46e3-42e1-9229-1630c8e2ba81'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:47:23 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-0b7f953a-f4a3-41c6-9cbf-2808b515468f tempest-VolumesTransfersTest-1571231794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:47:23 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-0b7f953a-f4a3-41c6-9cbf-2808b515468f tempest-VolumesTransfersTest-1571231794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:47:23 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-0b7f953a-f4a3-41c6-9cbf-2808b515468f tempest-VolumesTransfersTest-1571231794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:47:23 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-0b7f953a-f4a3-41c6-9cbf-2808b515468f tempest-VolumesTransfersTest-1571231794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:47:23 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-0b7f953a-f4a3-41c6-9cbf-2808b515468f tempest-VolumesTransfersTest-1571231794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:47:23 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0b7f953a-f4a3-41c6-9cbf-2808b515468f tempest-VolumesTransfersTest-1571231794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:47:23 devstack sudo[101476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:47:23 devstack sudo[101476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:47:24 devstack sudo[101476]: pam_unix(sudo:session): session closed for user root Jun 17 05:47:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0b7f953a-f4a3-41c6-9cbf-2808b515468f tempest-VolumesTransfersTest-1571231794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.695s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:47:24 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-0b7f953a-f4a3-41c6-9cbf-2808b515468f tempest-VolumesTransfersTest-1571231794 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:47:24 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-0b7f953a-f4a3-41c6-9cbf-2808b515468f tempest-VolumesTransfersTest-1571231794 None] Deleted volume successfully. Jun 17 05:47:24 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-0b7f953a-f4a3-41c6-9cbf-2808b515468f tempest-VolumesTransfersTest-1571231794 None] Lock "cinder-be2fc4f9-c8f2-48e6-8612-acd6b8205531-delete_volume" released by "delete_volume" :: held 2.546s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:47:24 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-66c6f0b1-60dc-41cd-91e0-e4924e3025d4 tempest-AttachVolumeNegativeTest-1827868215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:47:24 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-66c6f0b1-60dc-41cd-91e0-e4924e3025d4 tempest-AttachVolumeNegativeTest-1827868215 None] Flow 'volume_create_manager' (e75d94e9-6cac-434a-9603-c395ad941386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:47:24 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-66c6f0b1-60dc-41cd-91e0-e4924e3025d4 tempest-AttachVolumeNegativeTest-1827868215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74f96fc4-44fe-4955-8afb-c4be0f8fc9c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:47:24 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-66c6f0b1-60dc-41cd-91e0-e4924e3025d4 tempest-AttachVolumeNegativeTest-1827868215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74f96fc4-44fe-4955-8afb-c4be0f8fc9c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:47:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-865422098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8e00ae9-6aeb-41a1-95b9-32e0a13f5fe0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c02a66f7d37409daee1a984e0052823',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:47:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:47:24Z,use_quota=True,user_id='23e65f7b04184a998e98388dd4c3169a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:47:24 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-66c6f0b1-60dc-41cd-91e0-e4924e3025d4 tempest-AttachVolumeNegativeTest-1827868215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cb336c4-6bd5-4c6a-90d9-b549cdf3e484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:47:24 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-66c6f0b1-60dc-41cd-91e0-e4924e3025d4 tempest-AttachVolumeNegativeTest-1827868215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cb336c4-6bd5-4c6a-90d9-b549cdf3e484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:47:24 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-66c6f0b1-60dc-41cd-91e0-e4924e3025d4 tempest-AttachVolumeNegativeTest-1827868215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cad1c42-a47a-4bf7-b439-c442e208e2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:47:24 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-66c6f0b1-60dc-41cd-91e0-e4924e3025d4 tempest-AttachVolumeNegativeTest-1827868215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cad1c42-a47a-4bf7-b439-c442e208e2d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8e00ae9-6aeb-41a1-95b9-32e0a13f5fe0', 'volume_name': 'volume-c8e00ae9-6aeb-41a1-95b9-32e0a13f5fe0', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:47:24 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-66c6f0b1-60dc-41cd-91e0-e4924e3025d4 tempest-AttachVolumeNegativeTest-1827868215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe5add55-bf5f-47b2-84dc-bda7ded11440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:47:24 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-66c6f0b1-60dc-41cd-91e0-e4924e3025d4 tempest-AttachVolumeNegativeTest-1827868215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe5add55-bf5f-47b2-84dc-bda7ded11440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:47:24 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-66c6f0b1-60dc-41cd-91e0-e4924e3025d4 tempest-AttachVolumeNegativeTest-1827868215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d04623c3-a36f-4326-8ad2-0e0f9260386d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:47:24 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-66c6f0b1-60dc-41cd-91e0-e4924e3025d4 tempest-AttachVolumeNegativeTest-1827868215 None] Volume c8e00ae9-6aeb-41a1-95b9-32e0a13f5fe0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8e00ae9-6aeb-41a1-95b9-32e0a13f5fe0', 'volume_size': 1} Jun 17 05:47:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-66c6f0b1-60dc-41cd-91e0-e4924e3025d4 tempest-AttachVolumeNegativeTest-1827868215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:47:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-66c6f0b1-60dc-41cd-91e0-e4924e3025d4 tempest-AttachVolumeNegativeTest-1827868215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:47:24 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-66c6f0b1-60dc-41cd-91e0-e4924e3025d4 tempest-AttachVolumeNegativeTest-1827868215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:47:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-865422098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8e00ae9-6aeb-41a1-95b9-32e0a13f5fe0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c02a66f7d37409daee1a984e0052823',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:47:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:47:24Z,use_quota=True,user_id='23e65f7b04184a998e98388dd4c3169a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:47:24 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-66c6f0b1-60dc-41cd-91e0-e4924e3025d4 tempest-AttachVolumeNegativeTest-1827868215 None] Creating volume c8e00ae9-6aeb-41a1-95b9-32e0a13f5fe0 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:47:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-66c6f0b1-60dc-41cd-91e0-e4924e3025d4 tempest-AttachVolumeNegativeTest-1827868215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:47:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-66c6f0b1-60dc-41cd-91e0-e4924e3025d4 tempest-AttachVolumeNegativeTest-1827868215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:47:24 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-66c6f0b1-60dc-41cd-91e0-e4924e3025d4 tempest-AttachVolumeNegativeTest-1827868215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:47:24 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-66c6f0b1-60dc-41cd-91e0-e4924e3025d4 tempest-AttachVolumeNegativeTest-1827868215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:47:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-66c6f0b1-60dc-41cd-91e0-e4924e3025d4 tempest-AttachVolumeNegativeTest-1827868215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:47:24 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-66c6f0b1-60dc-41cd-91e0-e4924e3025d4 tempest-AttachVolumeNegativeTest-1827868215 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:47:24 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-66c6f0b1-60dc-41cd-91e0-e4924e3025d4 tempest-AttachVolumeNegativeTest-1827868215 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:47:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-66c6f0b1-60dc-41cd-91e0-e4924e3025d4 tempest-AttachVolumeNegativeTest-1827868215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c8e00ae9-6aeb-41a1-95b9-32e0a13f5fe0 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:47:24 devstack sudo[101481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c8e00ae9-6aeb-41a1-95b9-32e0a13f5fe0 1073741824 Jun 17 05:47:24 devstack sudo[101481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:47:24 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e5e0a0d-ae09-45aa-892f-a2563e71d6b9 tempest-VolumesTransfersTest-1504320769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:47:24 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1e5e0a0d-ae09-45aa-892f-a2563e71d6b9 tempest-VolumesTransfersTest-1504320769 None] Flow 'volume_create_manager' (fc50be32-7a01-4332-a27a-12a84607ccca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:47:24 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1e5e0a0d-ae09-45aa-892f-a2563e71d6b9 tempest-VolumesTransfersTest-1504320769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0858f619-ce5e-4393-9cc2-32f75840fcc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:47:24 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1e5e0a0d-ae09-45aa-892f-a2563e71d6b9 tempest-VolumesTransfersTest-1504320769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0858f619-ce5e-4393-9cc2-32f75840fcc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:47:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-726252694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb00db97-72bb-47d0-9a75-df4507d0bd7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c82a5c50d0ca424d839f4868da32fce9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:47:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:47:24Z,use_quota=True,user_id='6a98ac929138411b8b90f2a7f28d3d5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:47:24 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1e5e0a0d-ae09-45aa-892f-a2563e71d6b9 tempest-VolumesTransfersTest-1504320769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be8eec18-acc1-4eb4-8304-019899e1fe4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:47:24 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1e5e0a0d-ae09-45aa-892f-a2563e71d6b9 tempest-VolumesTransfersTest-1504320769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be8eec18-acc1-4eb4-8304-019899e1fe4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:47:24 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1e5e0a0d-ae09-45aa-892f-a2563e71d6b9 tempest-VolumesTransfersTest-1504320769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (473d9eb4-fd79-4485-a9b5-c1bbbacd8baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:47:24 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1e5e0a0d-ae09-45aa-892f-a2563e71d6b9 tempest-VolumesTransfersTest-1504320769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (473d9eb4-fd79-4485-a9b5-c1bbbacd8baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb00db97-72bb-47d0-9a75-df4507d0bd7b', 'volume_name': 'volume-eb00db97-72bb-47d0-9a75-df4507d0bd7b', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:47:24 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1e5e0a0d-ae09-45aa-892f-a2563e71d6b9 tempest-VolumesTransfersTest-1504320769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba4eb3df-d42e-4470-a5bf-15a5d1d55e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:47:24 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1e5e0a0d-ae09-45aa-892f-a2563e71d6b9 tempest-VolumesTransfersTest-1504320769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba4eb3df-d42e-4470-a5bf-15a5d1d55e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:47:24 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1e5e0a0d-ae09-45aa-892f-a2563e71d6b9 tempest-VolumesTransfersTest-1504320769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (033016a0-896e-466c-9fd0-63ac6b5aafe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:47:24 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-1e5e0a0d-ae09-45aa-892f-a2563e71d6b9 tempest-VolumesTransfersTest-1504320769 None] Volume eb00db97-72bb-47d0-9a75-df4507d0bd7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb00db97-72bb-47d0-9a75-df4507d0bd7b', 'volume_size': 1} Jun 17 05:47:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-1e5e0a0d-ae09-45aa-892f-a2563e71d6b9 tempest-VolumesTransfersTest-1504320769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:47:25 devstack sudo[101481]: pam_unix(sudo:session): session closed for user root Jun 17 05:47:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-66c6f0b1-60dc-41cd-91e0-e4924e3025d4 tempest-AttachVolumeNegativeTest-1827868215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c8e00ae9-6aeb-41a1-95b9-32e0a13f5fe0 1073741824" returned: 0 in 0.933s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:47:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-66c6f0b1-60dc-41cd-91e0-e4924e3025d4 tempest-AttachVolumeNegativeTest-1827868215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c8e00ae9-6aeb-41a1-95b9-32e0a13f5fe0 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:47:25 devstack sudo[101487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c8e00ae9-6aeb-41a1-95b9-32e0a13f5fe0 Jun 17 05:47:25 devstack sudo[101487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:47:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-1072b1a0-d8f2-4b30-b733-5e5d3a2c409f req-cf23f1a9-d263-4904-9340-424030f714b7 tempest-TestInstancesWithCinderVolumes-461180917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:47:25 devstack sudo[101487]: pam_unix(sudo:session): session closed for user root Jun 17 05:47:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-66c6f0b1-60dc-41cd-91e0-e4924e3025d4 tempest-AttachVolumeNegativeTest-1827868215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c8e00ae9-6aeb-41a1-95b9-32e0a13f5fe0" returned: 0 in 0.649s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:47:25 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-66c6f0b1-60dc-41cd-91e0-e4924e3025d4 tempest-AttachVolumeNegativeTest-1827868215 None] <== create_volume: return (1625ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:47:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-66c6f0b1-60dc-41cd-91e0-e4924e3025d4 tempest-AttachVolumeNegativeTest-1827868215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.628s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:47:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-1e5e0a0d-ae09-45aa-892f-a2563e71d6b9 tempest-VolumesTransfersTest-1504320769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.485s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:47:25 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-1e5e0a0d-ae09-45aa-892f-a2563e71d6b9 tempest-VolumesTransfersTest-1504320769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:47:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-726252694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb00db97-72bb-47d0-9a75-df4507d0bd7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c82a5c50d0ca424d839f4868da32fce9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:47:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:47:24Z,use_quota=True,user_id='6a98ac929138411b8b90f2a7f28d3d5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:47:25 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-1e5e0a0d-ae09-45aa-892f-a2563e71d6b9 tempest-VolumesTransfersTest-1504320769 None] Creating volume eb00db97-72bb-47d0-9a75-df4507d0bd7b {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:47:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-1e5e0a0d-ae09-45aa-892f-a2563e71d6b9 tempest-VolumesTransfersTest-1504320769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:47:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-1e5e0a0d-ae09-45aa-892f-a2563e71d6b9 tempest-VolumesTransfersTest-1504320769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:47:25 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-1e5e0a0d-ae09-45aa-892f-a2563e71d6b9 tempest-VolumesTransfersTest-1504320769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:47:25 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-1e5e0a0d-ae09-45aa-892f-a2563e71d6b9 tempest-VolumesTransfersTest-1504320769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:47:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-1e5e0a0d-ae09-45aa-892f-a2563e71d6b9 tempest-VolumesTransfersTest-1504320769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:47:25 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-1e5e0a0d-ae09-45aa-892f-a2563e71d6b9 tempest-VolumesTransfersTest-1504320769 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:47:25 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-1e5e0a0d-ae09-45aa-892f-a2563e71d6b9 tempest-VolumesTransfersTest-1504320769 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:47:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1e5e0a0d-ae09-45aa-892f-a2563e71d6b9 tempest-VolumesTransfersTest-1504320769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-eb00db97-72bb-47d0-9a75-df4507d0bd7b 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:47:25 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-66c6f0b1-60dc-41cd-91e0-e4924e3025d4 tempest-AttachVolumeNegativeTest-1827868215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d04623c3-a36f-4326-8ad2-0e0f9260386d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8e00ae9-6aeb-41a1-95b9-32e0a13f5fe0', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:47:25 devstack sudo[101498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-eb00db97-72bb-47d0-9a75-df4507d0bd7b 1073741824 Jun 17 05:47:25 devstack sudo[101498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:47:25 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-66c6f0b1-60dc-41cd-91e0-e4924e3025d4 tempest-AttachVolumeNegativeTest-1827868215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fbfe657-306b-4d33-a510-3e9391ea5640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:47:26 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-66c6f0b1-60dc-41cd-91e0-e4924e3025d4 tempest-AttachVolumeNegativeTest-1827868215 None] Volume volume-c8e00ae9-6aeb-41a1-95b9-32e0a13f5fe0 (c8e00ae9-6aeb-41a1-95b9-32e0a13f5fe0): created successfully Jun 17 05:47:26 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-66c6f0b1-60dc-41cd-91e0-e4924e3025d4 tempest-AttachVolumeNegativeTest-1827868215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fbfe657-306b-4d33-a510-3e9391ea5640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:47:26 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-66c6f0b1-60dc-41cd-91e0-e4924e3025d4 tempest-AttachVolumeNegativeTest-1827868215 None] Flow 'volume_create_manager' (e75d94e9-6cac-434a-9603-c395ad941386) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:47:26 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-66c6f0b1-60dc-41cd-91e0-e4924e3025d4 tempest-AttachVolumeNegativeTest-1827868215 None] Created volume successfully. Jun 17 05:47:26 devstack sudo[101498]: pam_unix(sudo:session): session closed for user root Jun 17 05:47:26 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1e5e0a0d-ae09-45aa-892f-a2563e71d6b9 tempest-VolumesTransfersTest-1504320769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-eb00db97-72bb-47d0-9a75-df4507d0bd7b 1073741824" returned: 0 in 0.922s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:47:26 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1e5e0a0d-ae09-45aa-892f-a2563e71d6b9 tempest-VolumesTransfersTest-1504320769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-eb00db97-72bb-47d0-9a75-df4507d0bd7b {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:47:26 devstack sudo[101540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-eb00db97-72bb-47d0-9a75-df4507d0bd7b Jun 17 05:47:26 devstack sudo[101540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:47:27 devstack sudo[101540]: pam_unix(sudo:session): session closed for user root Jun 17 05:47:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1e5e0a0d-ae09-45aa-892f-a2563e71d6b9 tempest-VolumesTransfersTest-1504320769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-eb00db97-72bb-47d0-9a75-df4507d0bd7b" returned: 0 in 0.606s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:47:27 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-1e5e0a0d-ae09-45aa-892f-a2563e71d6b9 tempest-VolumesTransfersTest-1504320769 None] <== create_volume: return (1570ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:47:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-1e5e0a0d-ae09-45aa-892f-a2563e71d6b9 tempest-VolumesTransfersTest-1504320769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.574s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:47:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-1072b1a0-d8f2-4b30-b733-5e5d3a2c409f req-cf23f1a9-d263-4904-9340-424030f714b7 tempest-TestInstancesWithCinderVolumes-461180917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.945s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:47:27 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1e5e0a0d-ae09-45aa-892f-a2563e71d6b9 tempest-VolumesTransfersTest-1504320769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (033016a0-896e-466c-9fd0-63ac6b5aafe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb00db97-72bb-47d0-9a75-df4507d0bd7b', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:47:27 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1e5e0a0d-ae09-45aa-892f-a2563e71d6b9 tempest-VolumesTransfersTest-1504320769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed968bef-3342-46c6-955a-edba0e0d6190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:47:27 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8a427b-dc43-4fd3-acb3-fd37301851e6]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:47:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-1072b1a0-d8f2-4b30-b733-5e5d3a2c409f req-cf23f1a9-d263-4904-9340-424030f714b7 tempest-TestInstancesWithCinderVolumes-461180917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ac1d52c8-46fe-45cc-a400-3acfb34dde06 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:47:27 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-1e5e0a0d-ae09-45aa-892f-a2563e71d6b9 tempest-VolumesTransfersTest-1504320769 None] Volume volume-eb00db97-72bb-47d0-9a75-df4507d0bd7b (eb00db97-72bb-47d0-9a75-df4507d0bd7b): created successfully Jun 17 05:47:27 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1e5e0a0d-ae09-45aa-892f-a2563e71d6b9 tempest-VolumesTransfersTest-1504320769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed968bef-3342-46c6-955a-edba0e0d6190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:47:27 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1e5e0a0d-ae09-45aa-892f-a2563e71d6b9 tempest-VolumesTransfersTest-1504320769 None] Flow 'volume_create_manager' (fc50be32-7a01-4332-a27a-12a84607ccca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:47:27 devstack cinder-volume[92083]: DEBUG oslo_service.periodic_task [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92083) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 05:47:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:47:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:47:27 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:47:27 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:47:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:47:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:47:27 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-1e5e0a0d-ae09-45aa-892f-a2563e71d6b9 tempest-VolumesTransfersTest-1504320769 None] Created volume successfully. Jun 17 05:47:27 devstack sudo[101545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:47:27 devstack sudo[101545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:47:27 devstack sudo[101544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ac1d52c8-46fe-45cc-a400-3acfb34dde06 Jun 17 05:47:27 devstack sudo[101544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:47:28 devstack sudo[101545]: pam_unix(sudo:session): session closed for user root Jun 17 05:47:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.684s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:47:28 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:47:28 devstack cinder-volume[92083]: DEBUG oslo_service.periodic_task [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running periodic task VolumeManager._thread_info {{(pid=92083) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 05:47:28 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] thread count: 28 {{(pid=92083) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 17 05:47:28 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] thread info: [<_MainThread(MainThread, started 133483869905024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92083) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 17 05:47:28 devstack sudo[101544]: pam_unix(sudo:session): session closed for user root Jun 17 05:47:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-1072b1a0-d8f2-4b30-b733-5e5d3a2c409f req-cf23f1a9-d263-4904-9340-424030f714b7 tempest-TestInstancesWithCinderVolumes-461180917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ac1d52c8-46fe-45cc-a400-3acfb34dde06" returned: 0 in 0.779s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:47:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-1072b1a0-d8f2-4b30-b733-5e5d3a2c409f req-cf23f1a9-d263-4904-9340-424030f714b7 tempest-TestInstancesWithCinderVolumes-461180917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.827s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:47:28 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [req-1072b1a0-d8f2-4b30-b733-5e5d3a2c409f req-cf23f1a9-d263-4904-9340-424030f714b7 tempest-TestInstancesWithCinderVolumes-461180917 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f', 'name': 'volume-ac1d52c8-46fe-45cc-a400-3acfb34dde06', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1ec28918-55d9-45b4-9117-cb68d98d6180', 'enforce_multipath': True} {{(pid=92083) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 17 05:47:28 devstack cinder-volume[92083]: INFO cinder.volume.manager [req-1072b1a0-d8f2-4b30-b733-5e5d3a2c409f req-cf23f1a9-d263-4904-9340-424030f714b7 tempest-TestInstancesWithCinderVolumes-461180917 None] attachment_update completed successfully. Jun 17 05:47:29 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-c9e9cab5-6b58-447b-abcf-ae04969d43ba tempest-VolumesTransfersTest-1571231794 None] Acquiring lock "cinder-eb00db97-72bb-47d0-9a75-df4507d0bd7b-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:47:29 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-c9e9cab5-6b58-447b-abcf-ae04969d43ba tempest-VolumesTransfersTest-1571231794 None] Lock "cinder-eb00db97-72bb-47d0-9a75-df4507d0bd7b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:47:29 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-c9e9cab5-6b58-447b-abcf-ae04969d43ba tempest-VolumesTransfersTest-1571231794 None] Acquiring lock "cinder-quobyte-eb00db97-72bb-47d0-9a75-df4507d0bd7b" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:47:29 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-c9e9cab5-6b58-447b-abcf-ae04969d43ba tempest-VolumesTransfersTest-1571231794 None] Lock "cinder-quobyte-eb00db97-72bb-47d0-9a75-df4507d0bd7b" acquired by "delete_volume" :: waited 0.019s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:47:29 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[687b3301-d3ab-4828-a0d3-76ee24c1b480]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:47:29 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c9e9cab5-6b58-447b-abcf-ae04969d43ba tempest-VolumesTransfersTest-1571231794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-eb00db97-72bb-47d0-9a75-df4507d0bd7b {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:47:29 devstack sudo[101555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-eb00db97-72bb-47d0-9a75-df4507d0bd7b Jun 17 05:47:29 devstack sudo[101555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:47:29 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-af2eb538-df79-4f29-adff-24ba49844248 req-36970328-efd2-42a1-be3e-46b4afebbf02 tempest-AttachVolumeNegativeTest-1827868215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:47:29 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-af2eb538-df79-4f29-adff-24ba49844248 req-36970328-efd2-42a1-be3e-46b4afebbf02 tempest-AttachVolumeNegativeTest-1827868215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:47:29 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[274c89ff-41e3-459a-9928-d0d039265288]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:47:29 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-af2eb538-df79-4f29-adff-24ba49844248 req-36970328-efd2-42a1-be3e-46b4afebbf02 tempest-AttachVolumeNegativeTest-1827868215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c8e00ae9-6aeb-41a1-95b9-32e0a13f5fe0 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:47:29 devstack sudo[101566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c8e00ae9-6aeb-41a1-95b9-32e0a13f5fe0 Jun 17 05:47:29 devstack sudo[101566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:47:30 devstack sudo[101555]: pam_unix(sudo:session): session closed for user root Jun 17 05:47:30 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c9e9cab5-6b58-447b-abcf-ae04969d43ba tempest-VolumesTransfersTest-1571231794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-eb00db97-72bb-47d0-9a75-df4507d0bd7b" returned: 0 in 0.880s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:47:30 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c9e9cab5-6b58-447b-abcf-ae04969d43ba tempest-VolumesTransfersTest-1571231794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-eb00db97-72bb-47d0-9a75-df4507d0bd7b {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:47:30 devstack sudo[101572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-eb00db97-72bb-47d0-9a75-df4507d0bd7b Jun 17 05:47:30 devstack sudo[101572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:47:30 devstack sudo[101566]: pam_unix(sudo:session): session closed for user root Jun 17 05:47:30 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-af2eb538-df79-4f29-adff-24ba49844248 req-36970328-efd2-42a1-be3e-46b4afebbf02 tempest-AttachVolumeNegativeTest-1827868215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c8e00ae9-6aeb-41a1-95b9-32e0a13f5fe0" returned: 0 in 0.883s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:47:30 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-af2eb538-df79-4f29-adff-24ba49844248 req-36970328-efd2-42a1-be3e-46b4afebbf02 tempest-AttachVolumeNegativeTest-1827868215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.918s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:47:30 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [req-af2eb538-df79-4f29-adff-24ba49844248 req-36970328-efd2-42a1-be3e-46b4afebbf02 tempest-AttachVolumeNegativeTest-1827868215 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f', 'name': 'volume-c8e00ae9-6aeb-41a1-95b9-32e0a13f5fe0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'edc415b2-3a78-4ec4-a574-02c8e717f2f4', 'enforce_multipath': True} {{(pid=92083) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 17 05:47:30 devstack cinder-volume[92083]: INFO cinder.volume.manager [req-af2eb538-df79-4f29-adff-24ba49844248 req-36970328-efd2-42a1-be3e-46b4afebbf02 tempest-AttachVolumeNegativeTest-1827868215 None] attachment_update completed successfully. Jun 17 05:47:30 devstack sudo[101572]: pam_unix(sudo:session): session closed for user root Jun 17 05:47:30 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c9e9cab5-6b58-447b-abcf-ae04969d43ba tempest-VolumesTransfersTest-1571231794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-eb00db97-72bb-47d0-9a75-df4507d0bd7b" returned: 0 in 0.645s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:47:30 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-c9e9cab5-6b58-447b-abcf-ae04969d43ba tempest-VolumesTransfersTest-1571231794 None] Lock "cinder-quobyte-eb00db97-72bb-47d0-9a75-df4507d0bd7b" released by "delete_volume" :: held 1.575s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:47:30 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-c9e9cab5-6b58-447b-abcf-ae04969d43ba tempest-VolumesTransfersTest-1571231794 None] Created reservations ['8985ed77-3f45-48f5-9861-6676c5571fd4', '7315f3a0-f670-4081-a4bd-eb2173b455c7', 'f2b35fa5-ca51-4fff-823d-b92cff7a78ab', 'b06d6c0f-0e47-4b38-a24f-c5008806cdc6'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:47:30 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-c9e9cab5-6b58-447b-abcf-ae04969d43ba tempest-VolumesTransfersTest-1571231794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:47:30 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-c9e9cab5-6b58-447b-abcf-ae04969d43ba tempest-VolumesTransfersTest-1571231794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:47:30 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-c9e9cab5-6b58-447b-abcf-ae04969d43ba tempest-VolumesTransfersTest-1571231794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:47:30 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-c9e9cab5-6b58-447b-abcf-ae04969d43ba tempest-VolumesTransfersTest-1571231794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:47:30 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-c9e9cab5-6b58-447b-abcf-ae04969d43ba tempest-VolumesTransfersTest-1571231794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:47:30 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c9e9cab5-6b58-447b-abcf-ae04969d43ba tempest-VolumesTransfersTest-1571231794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:47:30 devstack sudo[101578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:47:30 devstack sudo[101578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:47:31 devstack sudo[101578]: pam_unix(sudo:session): session closed for user root Jun 17 05:47:31 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c9e9cab5-6b58-447b-abcf-ae04969d43ba tempest-VolumesTransfersTest-1571231794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.903s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:47:31 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-c9e9cab5-6b58-447b-abcf-ae04969d43ba tempest-VolumesTransfersTest-1571231794 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:47:31 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-c9e9cab5-6b58-447b-abcf-ae04969d43ba tempest-VolumesTransfersTest-1571231794 None] Deleted volume successfully. Jun 17 05:47:31 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-c9e9cab5-6b58-447b-abcf-ae04969d43ba tempest-VolumesTransfersTest-1571231794 None] Lock "cinder-eb00db97-72bb-47d0-9a75-df4507d0bd7b-delete_volume" released by "delete_volume" :: held 2.699s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:47:37 devstack cinder-volume[92083]: INFO cinder.volume.manager [req-e20e3ce5-26fa-4425-afc7-55f9930ce933 req-a855794c-d2c2-483a-b0df-fc04f5748ffa tempest-AttachVolumeNegativeTest-1827868215 None] Terminate volume connection completed successfully. Jun 17 05:47:37 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [req-e20e3ce5-26fa-4425-afc7-55f9930ce933 req-a855794c-d2c2-483a-b0df-fc04f5748ffa tempest-AttachVolumeNegativeTest-1827868215 None] Deleting attachment edc415b2-3a78-4ec4-a574-02c8e717f2f4. {{(pid=92083) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 17 05:47:38 devstack cinder-volume[92083]: INFO cinder.volume.manager [req-445a7c21-07f6-49f1-b256-7ed7544d7c65 req-c61ef84c-b279-4abf-b70b-4346c2dcb94a tempest-TestInstancesWithCinderVolumes-461180917 None] Terminate volume connection completed successfully. Jun 17 05:47:38 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [req-445a7c21-07f6-49f1-b256-7ed7544d7c65 req-c61ef84c-b279-4abf-b70b-4346c2dcb94a tempest-TestInstancesWithCinderVolumes-461180917 None] Deleting attachment 17a5c4fd-7f0d-4195-ba4e-efc23467bf3c. {{(pid=92083) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 17 05:47:39 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-2131b902-52af-4897-8d0e-f3ce7117cb2e tempest-VolumesTransfersV355Test-1326723784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:47:39 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-2131b902-52af-4897-8d0e-f3ce7117cb2e tempest-VolumesTransfersV355Test-1326723784 None] Flow 'volume_create_manager' (86baf0ea-25be-4c4f-be06-f50fc49785ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:47:39 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-2131b902-52af-4897-8d0e-f3ce7117cb2e tempest-VolumesTransfersV355Test-1326723784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c390cea1-da0b-445d-b046-f4320b4b1c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:47:39 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-2131b902-52af-4897-8d0e-f3ce7117cb2e tempest-VolumesTransfersV355Test-1326723784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c390cea1-da0b-445d-b046-f4320b4b1c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:47:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-583513217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fff45ef-556f-4330-90a3-9b29c9b44f91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b739fe1f346b41b6907d9d06c1ac663f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:47:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:47:40Z,use_quota=True,user_id='3110c97696d8423799de5e4449952e2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:47:39 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-2131b902-52af-4897-8d0e-f3ce7117cb2e tempest-VolumesTransfersV355Test-1326723784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dac03ea9-6ab3-4799-922c-6ace3eeba147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:47:39 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-2131b902-52af-4897-8d0e-f3ce7117cb2e tempest-VolumesTransfersV355Test-1326723784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dac03ea9-6ab3-4799-922c-6ace3eeba147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:47:39 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-2131b902-52af-4897-8d0e-f3ce7117cb2e tempest-VolumesTransfersV355Test-1326723784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2d6d3de-1953-437f-851f-eec5c4e48226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:47:39 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-2131b902-52af-4897-8d0e-f3ce7117cb2e tempest-VolumesTransfersV355Test-1326723784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2d6d3de-1953-437f-851f-eec5c4e48226) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fff45ef-556f-4330-90a3-9b29c9b44f91', 'volume_name': 'volume-0fff45ef-556f-4330-90a3-9b29c9b44f91', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:47:39 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-2131b902-52af-4897-8d0e-f3ce7117cb2e tempest-VolumesTransfersV355Test-1326723784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5eaf37d-9fc5-403d-8be7-f823076aabbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:47:39 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-2131b902-52af-4897-8d0e-f3ce7117cb2e tempest-VolumesTransfersV355Test-1326723784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5eaf37d-9fc5-403d-8be7-f823076aabbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:47:39 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-2131b902-52af-4897-8d0e-f3ce7117cb2e tempest-VolumesTransfersV355Test-1326723784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aa6f6a5-0a3d-4543-9c19-0e1c9d0ce7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:47:39 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-2131b902-52af-4897-8d0e-f3ce7117cb2e tempest-VolumesTransfersV355Test-1326723784 None] Volume 0fff45ef-556f-4330-90a3-9b29c9b44f91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fff45ef-556f-4330-90a3-9b29c9b44f91', 'volume_size': 1} Jun 17 05:47:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-2131b902-52af-4897-8d0e-f3ce7117cb2e tempest-VolumesTransfersV355Test-1326723784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:47:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-2131b902-52af-4897-8d0e-f3ce7117cb2e tempest-VolumesTransfersV355Test-1326723784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:47:39 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-2131b902-52af-4897-8d0e-f3ce7117cb2e tempest-VolumesTransfersV355Test-1326723784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:47:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-583513217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fff45ef-556f-4330-90a3-9b29c9b44f91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b739fe1f346b41b6907d9d06c1ac663f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:47:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:47:40Z,use_quota=True,user_id='3110c97696d8423799de5e4449952e2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:47:39 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-2131b902-52af-4897-8d0e-f3ce7117cb2e tempest-VolumesTransfersV355Test-1326723784 None] Creating volume 0fff45ef-556f-4330-90a3-9b29c9b44f91 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:47:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-2131b902-52af-4897-8d0e-f3ce7117cb2e tempest-VolumesTransfersV355Test-1326723784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:47:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-2131b902-52af-4897-8d0e-f3ce7117cb2e tempest-VolumesTransfersV355Test-1326723784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:47:39 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-2131b902-52af-4897-8d0e-f3ce7117cb2e tempest-VolumesTransfersV355Test-1326723784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:47:39 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-2131b902-52af-4897-8d0e-f3ce7117cb2e tempest-VolumesTransfersV355Test-1326723784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:47:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-2131b902-52af-4897-8d0e-f3ce7117cb2e tempest-VolumesTransfersV355Test-1326723784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:47:39 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-2131b902-52af-4897-8d0e-f3ce7117cb2e tempest-VolumesTransfersV355Test-1326723784 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:47:39 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-2131b902-52af-4897-8d0e-f3ce7117cb2e tempest-VolumesTransfersV355Test-1326723784 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:47:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-2131b902-52af-4897-8d0e-f3ce7117cb2e tempest-VolumesTransfersV355Test-1326723784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0fff45ef-556f-4330-90a3-9b29c9b44f91 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:47:39 devstack sudo[101621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0fff45ef-556f-4330-90a3-9b29c9b44f91 1073741824 Jun 17 05:47:39 devstack sudo[101621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:47:40 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-8e87d727-eb4e-4cb6-9a05-d504261b5b6c tempest-TestInstancesWithCinderVolumes-461180917 None] Acquiring lock "cinder-eccf11ea-9b27-4d82-a92e-16647136f4fc-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:47:40 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-8e87d727-eb4e-4cb6-9a05-d504261b5b6c tempest-TestInstancesWithCinderVolumes-461180917 None] Lock "cinder-eccf11ea-9b27-4d82-a92e-16647136f4fc-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:47:40 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-8e87d727-eb4e-4cb6-9a05-d504261b5b6c tempest-TestInstancesWithCinderVolumes-461180917 None] Acquiring lock "cinder-quobyte-eccf11ea-9b27-4d82-a92e-16647136f4fc" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:47:40 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-8e87d727-eb4e-4cb6-9a05-d504261b5b6c tempest-TestInstancesWithCinderVolumes-461180917 None] Lock "cinder-quobyte-eccf11ea-9b27-4d82-a92e-16647136f4fc" acquired by "delete_volume" :: waited 0.019s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:47:40 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[e90644ff-68ce-4e9a-9343-847ae6abb097]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:47:40 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8e87d727-eb4e-4cb6-9a05-d504261b5b6c tempest-TestInstancesWithCinderVolumes-461180917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-eccf11ea-9b27-4d82-a92e-16647136f4fc {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:47:40 devstack sudo[101630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-eccf11ea-9b27-4d82-a92e-16647136f4fc Jun 17 05:47:40 devstack sudo[101630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:47:40 devstack sudo[101621]: pam_unix(sudo:session): session closed for user root Jun 17 05:47:40 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-2131b902-52af-4897-8d0e-f3ce7117cb2e tempest-VolumesTransfersV355Test-1326723784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0fff45ef-556f-4330-90a3-9b29c9b44f91 1073741824" returned: 0 in 0.988s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:47:40 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-2131b902-52af-4897-8d0e-f3ce7117cb2e tempest-VolumesTransfersV355Test-1326723784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0fff45ef-556f-4330-90a3-9b29c9b44f91 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:47:40 devstack sudo[101633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0fff45ef-556f-4330-90a3-9b29c9b44f91 Jun 17 05:47:40 devstack sudo[101633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:47:41 devstack sudo[101630]: pam_unix(sudo:session): session closed for user root Jun 17 05:47:41 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8e87d727-eb4e-4cb6-9a05-d504261b5b6c tempest-TestInstancesWithCinderVolumes-461180917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-eccf11ea-9b27-4d82-a92e-16647136f4fc" returned: 0 in 1.131s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:47:41 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8e87d727-eb4e-4cb6-9a05-d504261b5b6c tempest-TestInstancesWithCinderVolumes-461180917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-eccf11ea-9b27-4d82-a92e-16647136f4fc {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:47:41 devstack sudo[101675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-eccf11ea-9b27-4d82-a92e-16647136f4fc Jun 17 05:47:41 devstack sudo[101675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:47:41 devstack sudo[101633]: pam_unix(sudo:session): session closed for user root Jun 17 05:47:41 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-2131b902-52af-4897-8d0e-f3ce7117cb2e tempest-VolumesTransfersV355Test-1326723784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0fff45ef-556f-4330-90a3-9b29c9b44f91" returned: 0 in 0.951s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:47:41 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-2131b902-52af-4897-8d0e-f3ce7117cb2e tempest-VolumesTransfersV355Test-1326723784 None] <== create_volume: return (1992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:47:41 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-2131b902-52af-4897-8d0e-f3ce7117cb2e tempest-VolumesTransfersV355Test-1326723784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.995s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:47:41 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-2131b902-52af-4897-8d0e-f3ce7117cb2e tempest-VolumesTransfersV355Test-1326723784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aa6f6a5-0a3d-4543-9c19-0e1c9d0ce7bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fff45ef-556f-4330-90a3-9b29c9b44f91', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:47:41 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-2131b902-52af-4897-8d0e-f3ce7117cb2e tempest-VolumesTransfersV355Test-1326723784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f50fd238-ab82-4795-af81-7f6f28a80db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:47:41 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-2131b902-52af-4897-8d0e-f3ce7117cb2e tempest-VolumesTransfersV355Test-1326723784 None] Volume volume-0fff45ef-556f-4330-90a3-9b29c9b44f91 (0fff45ef-556f-4330-90a3-9b29c9b44f91): created successfully Jun 17 05:47:41 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-2131b902-52af-4897-8d0e-f3ce7117cb2e tempest-VolumesTransfersV355Test-1326723784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f50fd238-ab82-4795-af81-7f6f28a80db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:47:41 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-2131b902-52af-4897-8d0e-f3ce7117cb2e tempest-VolumesTransfersV355Test-1326723784 None] Flow 'volume_create_manager' (86baf0ea-25be-4c4f-be06-f50fc49785ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:47:41 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-2131b902-52af-4897-8d0e-f3ce7117cb2e tempest-VolumesTransfersV355Test-1326723784 None] Created volume successfully. Jun 17 05:47:42 devstack sudo[101675]: pam_unix(sudo:session): session closed for user root Jun 17 05:47:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8e87d727-eb4e-4cb6-9a05-d504261b5b6c tempest-TestInstancesWithCinderVolumes-461180917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-eccf11ea-9b27-4d82-a92e-16647136f4fc" returned: 0 in 0.833s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:47:42 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-8e87d727-eb4e-4cb6-9a05-d504261b5b6c tempest-TestInstancesWithCinderVolumes-461180917 None] Lock "cinder-quobyte-eccf11ea-9b27-4d82-a92e-16647136f4fc" released by "delete_volume" :: held 2.010s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:47:42 devstack cinder-volume[92083]: WARNING cinder.quota [None req-8e87d727-eb4e-4cb6-9a05-d504261b5b6c tempest-TestInstancesWithCinderVolumes-461180917 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1918685743-1804748835 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1918685743-1804748835, it is now deprecated. Please use the default quota class for default quota. Jun 17 05:47:42 devstack cinder-volume[92083]: WARNING cinder.quota [None req-8e87d727-eb4e-4cb6-9a05-d504261b5b6c tempest-TestInstancesWithCinderVolumes-461180917 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1918685743-1804748835 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1918685743-1804748835, it is now deprecated. Please use the default quota class for default quota. Jun 17 05:47:42 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-8e87d727-eb4e-4cb6-9a05-d504261b5b6c tempest-TestInstancesWithCinderVolumes-461180917 None] Created reservations ['28fd0100-9e2c-4ce3-a0c8-8cbdbe0ab913', '8e45ba20-ac9f-4346-a3e4-7166af9e4098', '35274203-fc77-411d-87b5-a6640abd9092', 'd51c1361-451e-4e8e-9a6f-500b2419ba7a'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:47:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-8e87d727-eb4e-4cb6-9a05-d504261b5b6c tempest-TestInstancesWithCinderVolumes-461180917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:47:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-8e87d727-eb4e-4cb6-9a05-d504261b5b6c tempest-TestInstancesWithCinderVolumes-461180917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:47:42 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-8e87d727-eb4e-4cb6-9a05-d504261b5b6c tempest-TestInstancesWithCinderVolumes-461180917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:47:42 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-8e87d727-eb4e-4cb6-9a05-d504261b5b6c tempest-TestInstancesWithCinderVolumes-461180917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:47:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-8e87d727-eb4e-4cb6-9a05-d504261b5b6c tempest-TestInstancesWithCinderVolumes-461180917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:47:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8e87d727-eb4e-4cb6-9a05-d504261b5b6c tempest-TestInstancesWithCinderVolumes-461180917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:47:42 devstack sudo[101679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:47:42 devstack sudo[101679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:47:43 devstack sudo[101679]: pam_unix(sudo:session): session closed for user root Jun 17 05:47:43 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8e87d727-eb4e-4cb6-9a05-d504261b5b6c tempest-TestInstancesWithCinderVolumes-461180917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 1.037s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:47:43 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-8e87d727-eb4e-4cb6-9a05-d504261b5b6c tempest-TestInstancesWithCinderVolumes-461180917 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:47:43 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-8e87d727-eb4e-4cb6-9a05-d504261b5b6c tempest-TestInstancesWithCinderVolumes-461180917 None] Deleted volume successfully. Jun 17 05:47:43 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-8e87d727-eb4e-4cb6-9a05-d504261b5b6c tempest-TestInstancesWithCinderVolumes-461180917 None] Lock "cinder-eccf11ea-9b27-4d82-a92e-16647136f4fc-delete_volume" released by "delete_volume" :: held 3.433s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:47:44 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-fdf6e4ca-03bb-451a-8583-4f78ca99d73c tempest-VolumesTransfersV355Test-157429405 None] Transfer volume completed successfully. Jun 17 05:47:45 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-b62a355a-15e3-4942-8bbb-08946aa7424d tempest-VolumesTransfersV355Test-1278236228 None] Acquiring lock "cinder-0fff45ef-556f-4330-90a3-9b29c9b44f91-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:47:45 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-b62a355a-15e3-4942-8bbb-08946aa7424d tempest-VolumesTransfersV355Test-1278236228 None] Lock "cinder-0fff45ef-556f-4330-90a3-9b29c9b44f91-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:47:45 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-b62a355a-15e3-4942-8bbb-08946aa7424d tempest-VolumesTransfersV355Test-1278236228 None] Acquiring lock "cinder-quobyte-0fff45ef-556f-4330-90a3-9b29c9b44f91" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:47:45 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-b62a355a-15e3-4942-8bbb-08946aa7424d tempest-VolumesTransfersV355Test-1278236228 None] Lock "cinder-quobyte-0fff45ef-556f-4330-90a3-9b29c9b44f91" acquired by "delete_volume" :: waited 0.014s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:47:45 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[28acafd3-8ef7-4955-a879-d397b1bc2e1e]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:47:45 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b62a355a-15e3-4942-8bbb-08946aa7424d tempest-VolumesTransfersV355Test-1278236228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0fff45ef-556f-4330-90a3-9b29c9b44f91 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:47:45 devstack sudo[101706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0fff45ef-556f-4330-90a3-9b29c9b44f91 Jun 17 05:47:45 devstack sudo[101706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:47:45 devstack sudo[101706]: pam_unix(sudo:session): session closed for user root Jun 17 05:47:45 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b62a355a-15e3-4942-8bbb-08946aa7424d tempest-VolumesTransfersV355Test-1278236228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0fff45ef-556f-4330-90a3-9b29c9b44f91" returned: 0 in 0.725s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:47:45 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b62a355a-15e3-4942-8bbb-08946aa7424d tempest-VolumesTransfersV355Test-1278236228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0fff45ef-556f-4330-90a3-9b29c9b44f91 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:47:45 devstack sudo[101713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0fff45ef-556f-4330-90a3-9b29c9b44f91 Jun 17 05:47:45 devstack sudo[101713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:47:45 devstack cinder-volume[92083]: INFO cinder.volume.manager [req-42c56d64-945e-4279-b323-f9380373514d req-bbd7097e-7e60-4754-9c41-d4d88f069224 tempest-TestInstancesWithCinderVolumes-461180917 None] Terminate volume connection completed successfully. Jun 17 05:47:45 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [req-42c56d64-945e-4279-b323-f9380373514d req-bbd7097e-7e60-4754-9c41-d4d88f069224 tempest-TestInstancesWithCinderVolumes-461180917 None] Deleting attachment 1ec28918-55d9-45b4-9117-cb68d98d6180. {{(pid=92083) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 17 05:47:46 devstack sudo[101713]: pam_unix(sudo:session): session closed for user root Jun 17 05:47:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b62a355a-15e3-4942-8bbb-08946aa7424d tempest-VolumesTransfersV355Test-1278236228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0fff45ef-556f-4330-90a3-9b29c9b44f91" returned: 0 in 0.595s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:47:46 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-b62a355a-15e3-4942-8bbb-08946aa7424d tempest-VolumesTransfersV355Test-1278236228 None] Lock "cinder-quobyte-0fff45ef-556f-4330-90a3-9b29c9b44f91" released by "delete_volume" :: held 1.359s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:47:46 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-b62a355a-15e3-4942-8bbb-08946aa7424d tempest-VolumesTransfersV355Test-1278236228 None] Created reservations ['de46c3c4-4116-4dd6-9eba-8787cba985a5', '40c84344-b61e-42fb-b690-638f036928e1', '520a6938-9dc8-40c5-bb77-bfa56fc6d0f7', 'dde2e9fd-7c13-4c31-87ab-b0e2af593db1'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:47:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-b62a355a-15e3-4942-8bbb-08946aa7424d tempest-VolumesTransfersV355Test-1278236228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:47:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-b62a355a-15e3-4942-8bbb-08946aa7424d tempest-VolumesTransfersV355Test-1278236228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:47:46 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-b62a355a-15e3-4942-8bbb-08946aa7424d tempest-VolumesTransfersV355Test-1278236228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:47:46 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-b62a355a-15e3-4942-8bbb-08946aa7424d tempest-VolumesTransfersV355Test-1278236228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:47:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-b62a355a-15e3-4942-8bbb-08946aa7424d tempest-VolumesTransfersV355Test-1278236228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:47:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b62a355a-15e3-4942-8bbb-08946aa7424d tempest-VolumesTransfersV355Test-1278236228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:47:46 devstack sudo[101716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:47:46 devstack sudo[101716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:47:47 devstack sudo[101716]: pam_unix(sudo:session): session closed for user root Jun 17 05:47:47 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b62a355a-15e3-4942-8bbb-08946aa7424d tempest-VolumesTransfersV355Test-1278236228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.622s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:47:47 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-b62a355a-15e3-4942-8bbb-08946aa7424d tempest-VolumesTransfersV355Test-1278236228 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:47:47 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-b62a355a-15e3-4942-8bbb-08946aa7424d tempest-VolumesTransfersV355Test-1278236228 None] Deleted volume successfully. Jun 17 05:47:47 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-b62a355a-15e3-4942-8bbb-08946aa7424d tempest-VolumesTransfersV355Test-1278236228 None] Lock "cinder-0fff45ef-556f-4330-90a3-9b29c9b44f91-delete_volume" released by "delete_volume" :: held 2.169s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:47:47 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-201edac3-dbb6-4a9e-9eb4-324bc451412f tempest-VolumesTransfersV355Test-1326723784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:47:47 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-201edac3-dbb6-4a9e-9eb4-324bc451412f tempest-VolumesTransfersV355Test-1326723784 None] Flow 'volume_create_manager' (4ea86312-56d1-4efc-a84d-bc853a3f2037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:47:47 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-201edac3-dbb6-4a9e-9eb4-324bc451412f tempest-VolumesTransfersV355Test-1326723784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32a346a4-c552-481a-ac23-6c4d72e97c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:47:47 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-201edac3-dbb6-4a9e-9eb4-324bc451412f tempest-VolumesTransfersV355Test-1326723784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32a346a4-c552-481a-ac23-6c4d72e97c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:47:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-136545243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fcd1493-c9d9-402a-a837-04c6d207d2ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b739fe1f346b41b6907d9d06c1ac663f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:47:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:47:48Z,use_quota=True,user_id='3110c97696d8423799de5e4449952e2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:47:47 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-201edac3-dbb6-4a9e-9eb4-324bc451412f tempest-VolumesTransfersV355Test-1326723784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b95295da-f22a-43e9-93cc-fb32b7e62063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:47:47 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-201edac3-dbb6-4a9e-9eb4-324bc451412f tempest-VolumesTransfersV355Test-1326723784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b95295da-f22a-43e9-93cc-fb32b7e62063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:47:47 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-201edac3-dbb6-4a9e-9eb4-324bc451412f tempest-VolumesTransfersV355Test-1326723784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22d22c47-11a6-4459-8229-459d2c8d6bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:47:47 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-201edac3-dbb6-4a9e-9eb4-324bc451412f tempest-VolumesTransfersV355Test-1326723784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22d22c47-11a6-4459-8229-459d2c8d6bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fcd1493-c9d9-402a-a837-04c6d207d2ab', 'volume_name': 'volume-2fcd1493-c9d9-402a-a837-04c6d207d2ab', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:47:47 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-201edac3-dbb6-4a9e-9eb4-324bc451412f tempest-VolumesTransfersV355Test-1326723784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26d5e9c9-4aa3-4bc8-b7bc-b39547a11bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:47:47 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-201edac3-dbb6-4a9e-9eb4-324bc451412f tempest-VolumesTransfersV355Test-1326723784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26d5e9c9-4aa3-4bc8-b7bc-b39547a11bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:47:47 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-201edac3-dbb6-4a9e-9eb4-324bc451412f tempest-VolumesTransfersV355Test-1326723784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31f481f5-49d0-4ac8-838c-fafb29fe794b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:47:47 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-201edac3-dbb6-4a9e-9eb4-324bc451412f tempest-VolumesTransfersV355Test-1326723784 None] Volume 2fcd1493-c9d9-402a-a837-04c6d207d2ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fcd1493-c9d9-402a-a837-04c6d207d2ab', 'volume_size': 1} Jun 17 05:47:47 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-201edac3-dbb6-4a9e-9eb4-324bc451412f tempest-VolumesTransfersV355Test-1326723784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:47:47 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-201edac3-dbb6-4a9e-9eb4-324bc451412f tempest-VolumesTransfersV355Test-1326723784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:47:47 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-201edac3-dbb6-4a9e-9eb4-324bc451412f tempest-VolumesTransfersV355Test-1326723784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:47:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-136545243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fcd1493-c9d9-402a-a837-04c6d207d2ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b739fe1f346b41b6907d9d06c1ac663f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:47:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:47:48Z,use_quota=True,user_id='3110c97696d8423799de5e4449952e2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:47:47 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-201edac3-dbb6-4a9e-9eb4-324bc451412f tempest-VolumesTransfersV355Test-1326723784 None] Creating volume 2fcd1493-c9d9-402a-a837-04c6d207d2ab {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:47:47 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-201edac3-dbb6-4a9e-9eb4-324bc451412f tempest-VolumesTransfersV355Test-1326723784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:47:47 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-201edac3-dbb6-4a9e-9eb4-324bc451412f tempest-VolumesTransfersV355Test-1326723784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:47:47 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-201edac3-dbb6-4a9e-9eb4-324bc451412f tempest-VolumesTransfersV355Test-1326723784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:47:47 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-201edac3-dbb6-4a9e-9eb4-324bc451412f tempest-VolumesTransfersV355Test-1326723784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:47:47 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-201edac3-dbb6-4a9e-9eb4-324bc451412f tempest-VolumesTransfersV355Test-1326723784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:47:47 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-201edac3-dbb6-4a9e-9eb4-324bc451412f tempest-VolumesTransfersV355Test-1326723784 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:47:47 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-201edac3-dbb6-4a9e-9eb4-324bc451412f tempest-VolumesTransfersV355Test-1326723784 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:47:47 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-201edac3-dbb6-4a9e-9eb4-324bc451412f tempest-VolumesTransfersV355Test-1326723784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2fcd1493-c9d9-402a-a837-04c6d207d2ab 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:47:47 devstack sudo[101719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2fcd1493-c9d9-402a-a837-04c6d207d2ab 1073741824 Jun 17 05:47:47 devstack sudo[101719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:47:47 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-442c553d-635d-4282-bcb9-df66f6d3a258 tempest-TestInstancesWithCinderVolumes-461180917 None] Acquiring lock "cinder-ac1d52c8-46fe-45cc-a400-3acfb34dde06-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:47:47 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-442c553d-635d-4282-bcb9-df66f6d3a258 tempest-TestInstancesWithCinderVolumes-461180917 None] Lock "cinder-ac1d52c8-46fe-45cc-a400-3acfb34dde06-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:47:47 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-442c553d-635d-4282-bcb9-df66f6d3a258 tempest-TestInstancesWithCinderVolumes-461180917 None] Acquiring lock "cinder-quobyte-ac1d52c8-46fe-45cc-a400-3acfb34dde06" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:47:47 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-442c553d-635d-4282-bcb9-df66f6d3a258 tempest-TestInstancesWithCinderVolumes-461180917 None] Lock "cinder-quobyte-ac1d52c8-46fe-45cc-a400-3acfb34dde06" acquired by "delete_volume" :: waited 0.016s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:47:48 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e24dc17-bc8e-4a79-999b-7bc449ec6ae9]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:47:48 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-442c553d-635d-4282-bcb9-df66f6d3a258 tempest-TestInstancesWithCinderVolumes-461180917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ac1d52c8-46fe-45cc-a400-3acfb34dde06 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:47:48 devstack sudo[101721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ac1d52c8-46fe-45cc-a400-3acfb34dde06 Jun 17 05:47:48 devstack sudo[101721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:47:49 devstack sudo[101719]: pam_unix(sudo:session): session closed for user root Jun 17 05:47:49 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-201edac3-dbb6-4a9e-9eb4-324bc451412f tempest-VolumesTransfersV355Test-1326723784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2fcd1493-c9d9-402a-a837-04c6d207d2ab 1073741824" returned: 0 in 1.153s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:47:49 devstack sudo[101721]: pam_unix(sudo:session): session closed for user root Jun 17 05:47:49 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-201edac3-dbb6-4a9e-9eb4-324bc451412f tempest-VolumesTransfersV355Test-1326723784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2fcd1493-c9d9-402a-a837-04c6d207d2ab {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:47:49 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-442c553d-635d-4282-bcb9-df66f6d3a258 tempest-TestInstancesWithCinderVolumes-461180917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ac1d52c8-46fe-45cc-a400-3acfb34dde06" returned: 0 in 1.036s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:47:49 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-442c553d-635d-4282-bcb9-df66f6d3a258 tempest-TestInstancesWithCinderVolumes-461180917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ac1d52c8-46fe-45cc-a400-3acfb34dde06 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:47:49 devstack sudo[101733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2fcd1493-c9d9-402a-a837-04c6d207d2ab Jun 17 05:47:49 devstack sudo[101733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:47:49 devstack sudo[101734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ac1d52c8-46fe-45cc-a400-3acfb34dde06 Jun 17 05:47:49 devstack sudo[101734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:47:49 devstack sudo[101733]: pam_unix(sudo:session): session closed for user root Jun 17 05:47:49 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-201edac3-dbb6-4a9e-9eb4-324bc451412f tempest-VolumesTransfersV355Test-1326723784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2fcd1493-c9d9-402a-a837-04c6d207d2ab" returned: 0 in 0.848s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:47:49 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-201edac3-dbb6-4a9e-9eb4-324bc451412f tempest-VolumesTransfersV355Test-1326723784 None] <== create_volume: return (2052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:47:49 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-201edac3-dbb6-4a9e-9eb4-324bc451412f tempest-VolumesTransfersV355Test-1326723784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.056s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:47:49 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-201edac3-dbb6-4a9e-9eb4-324bc451412f tempest-VolumesTransfersV355Test-1326723784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31f481f5-49d0-4ac8-838c-fafb29fe794b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fcd1493-c9d9-402a-a837-04c6d207d2ab', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:47:49 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-201edac3-dbb6-4a9e-9eb4-324bc451412f tempest-VolumesTransfersV355Test-1326723784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cd1d471-0376-4648-8341-34555d6a88ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:47:49 devstack sudo[101734]: pam_unix(sudo:session): session closed for user root Jun 17 05:47:49 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-442c553d-635d-4282-bcb9-df66f6d3a258 tempest-TestInstancesWithCinderVolumes-461180917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ac1d52c8-46fe-45cc-a400-3acfb34dde06" returned: 0 in 0.891s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:47:49 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-201edac3-dbb6-4a9e-9eb4-324bc451412f tempest-VolumesTransfersV355Test-1326723784 None] Volume volume-2fcd1493-c9d9-402a-a837-04c6d207d2ab (2fcd1493-c9d9-402a-a837-04c6d207d2ab): created successfully Jun 17 05:47:49 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-201edac3-dbb6-4a9e-9eb4-324bc451412f tempest-VolumesTransfersV355Test-1326723784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cd1d471-0376-4648-8341-34555d6a88ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:47:49 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-201edac3-dbb6-4a9e-9eb4-324bc451412f tempest-VolumesTransfersV355Test-1326723784 None] Flow 'volume_create_manager' (4ea86312-56d1-4efc-a84d-bc853a3f2037) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:47:49 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-442c553d-635d-4282-bcb9-df66f6d3a258 tempest-TestInstancesWithCinderVolumes-461180917 None] Lock "cinder-quobyte-ac1d52c8-46fe-45cc-a400-3acfb34dde06" released by "delete_volume" :: held 2.011s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:47:50 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-201edac3-dbb6-4a9e-9eb4-324bc451412f tempest-VolumesTransfersV355Test-1326723784 None] Created volume successfully. Jun 17 05:47:50 devstack cinder-volume[92083]: WARNING cinder.quota [None req-442c553d-635d-4282-bcb9-df66f6d3a258 tempest-TestInstancesWithCinderVolumes-461180917 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1815216189-76554261 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1815216189-76554261, it is now deprecated. Please use the default quota class for default quota. Jun 17 05:47:50 devstack cinder-volume[92083]: WARNING cinder.quota [None req-442c553d-635d-4282-bcb9-df66f6d3a258 tempest-TestInstancesWithCinderVolumes-461180917 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1815216189-76554261 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1815216189-76554261, it is now deprecated. Please use the default quota class for default quota. Jun 17 05:47:50 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-442c553d-635d-4282-bcb9-df66f6d3a258 tempest-TestInstancesWithCinderVolumes-461180917 None] Created reservations ['0a8bd54c-b401-4a8a-873d-8df0c570f4c1', '9081c57f-afa8-4b4a-843e-3c6e0772e332', 'b6f7afc9-074f-42ad-8dbd-ea1af3b37720', '1f733a5e-078a-4e21-9c78-8babc59400c9'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:47:50 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-442c553d-635d-4282-bcb9-df66f6d3a258 tempest-TestInstancesWithCinderVolumes-461180917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:47:50 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-442c553d-635d-4282-bcb9-df66f6d3a258 tempest-TestInstancesWithCinderVolumes-461180917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:47:50 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-442c553d-635d-4282-bcb9-df66f6d3a258 tempest-TestInstancesWithCinderVolumes-461180917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:47:50 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-442c553d-635d-4282-bcb9-df66f6d3a258 tempest-TestInstancesWithCinderVolumes-461180917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:47:50 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-442c553d-635d-4282-bcb9-df66f6d3a258 tempest-TestInstancesWithCinderVolumes-461180917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:47:50 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-442c553d-635d-4282-bcb9-df66f6d3a258 tempest-TestInstancesWithCinderVolumes-461180917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:47:50 devstack sudo[101740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:47:50 devstack sudo[101740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:47:50 devstack sudo[101740]: pam_unix(sudo:session): session closed for user root Jun 17 05:47:50 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-442c553d-635d-4282-bcb9-df66f6d3a258 tempest-TestInstancesWithCinderVolumes-461180917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.765s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:47:50 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-442c553d-635d-4282-bcb9-df66f6d3a258 tempest-TestInstancesWithCinderVolumes-461180917 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:47:50 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-442c553d-635d-4282-bcb9-df66f6d3a258 tempest-TestInstancesWithCinderVolumes-461180917 None] Deleted volume successfully. Jun 17 05:47:50 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-442c553d-635d-4282-bcb9-df66f6d3a258 tempest-TestInstancesWithCinderVolumes-461180917 None] Lock "cinder-ac1d52c8-46fe-45cc-a400-3acfb34dde06-delete_volume" released by "delete_volume" :: held 3.059s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:47:51 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-fb0109c1-7ea2-4b25-a3e0-aa0f8d876cbe tempest-VolumesTransfersV355Test-1278236228 None] Acquiring lock "cinder-2fcd1493-c9d9-402a-a837-04c6d207d2ab-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:47:51 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-fb0109c1-7ea2-4b25-a3e0-aa0f8d876cbe tempest-VolumesTransfersV355Test-1278236228 None] Lock "cinder-2fcd1493-c9d9-402a-a837-04c6d207d2ab-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:47:51 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-fb0109c1-7ea2-4b25-a3e0-aa0f8d876cbe tempest-VolumesTransfersV355Test-1278236228 None] Acquiring lock "cinder-quobyte-2fcd1493-c9d9-402a-a837-04c6d207d2ab" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:47:51 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-fb0109c1-7ea2-4b25-a3e0-aa0f8d876cbe tempest-VolumesTransfersV355Test-1278236228 None] Lock "cinder-quobyte-2fcd1493-c9d9-402a-a837-04c6d207d2ab" acquired by "delete_volume" :: waited 0.026s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:47:51 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86436ab-04c7-4561-af35-081d7023b888]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:47:51 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-fb0109c1-7ea2-4b25-a3e0-aa0f8d876cbe tempest-VolumesTransfersV355Test-1278236228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2fcd1493-c9d9-402a-a837-04c6d207d2ab {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:47:51 devstack sudo[101750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2fcd1493-c9d9-402a-a837-04c6d207d2ab Jun 17 05:47:51 devstack sudo[101750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:47:52 devstack sudo[101750]: pam_unix(sudo:session): session closed for user root Jun 17 05:47:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-fb0109c1-7ea2-4b25-a3e0-aa0f8d876cbe tempest-VolumesTransfersV355Test-1278236228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2fcd1493-c9d9-402a-a837-04c6d207d2ab" returned: 0 in 1.138s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:47:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-fb0109c1-7ea2-4b25-a3e0-aa0f8d876cbe tempest-VolumesTransfersV355Test-1278236228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2fcd1493-c9d9-402a-a837-04c6d207d2ab {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:47:52 devstack sudo[101820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2fcd1493-c9d9-402a-a837-04c6d207d2ab Jun 17 05:47:52 devstack sudo[101820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:47:53 devstack sudo[101820]: pam_unix(sudo:session): session closed for user root Jun 17 05:47:53 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-fb0109c1-7ea2-4b25-a3e0-aa0f8d876cbe tempest-VolumesTransfersV355Test-1278236228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2fcd1493-c9d9-402a-a837-04c6d207d2ab" returned: 0 in 1.097s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:47:53 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-fb0109c1-7ea2-4b25-a3e0-aa0f8d876cbe tempest-VolumesTransfersV355Test-1278236228 None] Lock "cinder-quobyte-2fcd1493-c9d9-402a-a837-04c6d207d2ab" released by "delete_volume" :: held 2.306s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:47:53 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-fb0109c1-7ea2-4b25-a3e0-aa0f8d876cbe tempest-VolumesTransfersV355Test-1278236228 None] Created reservations ['dd6f6b1a-f488-46b3-b0bb-89bfc3b41946', '3804a3e3-95da-4806-87a7-27be30391a12', '49161f48-ef35-454b-bc55-c37c6b771755', '8512c2cb-cf7c-425a-8306-4ffe03b95cbf'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:47:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-fb0109c1-7ea2-4b25-a3e0-aa0f8d876cbe tempest-VolumesTransfersV355Test-1278236228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:47:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-fb0109c1-7ea2-4b25-a3e0-aa0f8d876cbe tempest-VolumesTransfersV355Test-1278236228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:47:54 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-fb0109c1-7ea2-4b25-a3e0-aa0f8d876cbe tempest-VolumesTransfersV355Test-1278236228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:47:54 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-fb0109c1-7ea2-4b25-a3e0-aa0f8d876cbe tempest-VolumesTransfersV355Test-1278236228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:47:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-fb0109c1-7ea2-4b25-a3e0-aa0f8d876cbe tempest-VolumesTransfersV355Test-1278236228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:47:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-fb0109c1-7ea2-4b25-a3e0-aa0f8d876cbe tempest-VolumesTransfersV355Test-1278236228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:47:54 devstack sudo[101859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:47:54 devstack sudo[101859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:47:54 devstack sudo[101859]: pam_unix(sudo:session): session closed for user root Jun 17 05:47:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-fb0109c1-7ea2-4b25-a3e0-aa0f8d876cbe tempest-VolumesTransfersV355Test-1278236228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.703s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:47:54 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-fb0109c1-7ea2-4b25-a3e0-aa0f8d876cbe tempest-VolumesTransfersV355Test-1278236228 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:47:54 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-fb0109c1-7ea2-4b25-a3e0-aa0f8d876cbe tempest-VolumesTransfersV355Test-1278236228 None] Deleted volume successfully. Jun 17 05:47:54 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-fb0109c1-7ea2-4b25-a3e0-aa0f8d876cbe tempest-VolumesTransfersV355Test-1278236228 None] Lock "cinder-2fcd1493-c9d9-402a-a837-04c6d207d2ab-delete_volume" released by "delete_volume" :: held 3.269s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:47:55 devstack cinder-volume[92083]: INFO cinder.volume.manager [req-fe444c7c-234d-425d-aa11-cdc580289552 req-a953b1f5-c520-4973-b6a6-4081e06bcc1c tempest-TestInstancesWithCinderVolumes-461180917 None] Terminate volume connection completed successfully. Jun 17 05:47:55 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [req-fe444c7c-234d-425d-aa11-cdc580289552 req-a953b1f5-c520-4973-b6a6-4081e06bcc1c tempest-TestInstancesWithCinderVolumes-461180917 None] Deleting attachment 50d5933a-4b36-4b39-bb36-4dc550333bee. {{(pid=92083) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 17 05:48:03 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-fb7435a0-11a1-4aa7-8e13-359df043d7b8 tempest-TestInstancesWithCinderVolumes-461180917 None] Acquiring lock "cinder-a563a600-24a6-4a5a-ba89-efb07fb4fada-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:48:03 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-fb7435a0-11a1-4aa7-8e13-359df043d7b8 tempest-TestInstancesWithCinderVolumes-461180917 None] Lock "cinder-a563a600-24a6-4a5a-ba89-efb07fb4fada-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:48:03 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-fb7435a0-11a1-4aa7-8e13-359df043d7b8 tempest-TestInstancesWithCinderVolumes-461180917 None] Acquiring lock "cinder-quobyte-a563a600-24a6-4a5a-ba89-efb07fb4fada" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:48:03 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-fb7435a0-11a1-4aa7-8e13-359df043d7b8 tempest-TestInstancesWithCinderVolumes-461180917 None] Lock "cinder-quobyte-a563a600-24a6-4a5a-ba89-efb07fb4fada" acquired by "delete_volume" :: waited 0.020s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:48:03 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd36e38c-ab48-4cf9-979a-7de6265d4c64]: (4, 'raw') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:48:03 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-fb7435a0-11a1-4aa7-8e13-359df043d7b8 tempest-TestInstancesWithCinderVolumes-461180917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a563a600-24a6-4a5a-ba89-efb07fb4fada {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:48:03 devstack sudo[101952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a563a600-24a6-4a5a-ba89-efb07fb4fada Jun 17 05:48:03 devstack sudo[101952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:48:04 devstack sudo[101952]: pam_unix(sudo:session): session closed for user root Jun 17 05:48:04 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-fb7435a0-11a1-4aa7-8e13-359df043d7b8 tempest-TestInstancesWithCinderVolumes-461180917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a563a600-24a6-4a5a-ba89-efb07fb4fada" returned: 0 in 0.819s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:48:04 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-fb7435a0-11a1-4aa7-8e13-359df043d7b8 tempest-TestInstancesWithCinderVolumes-461180917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a563a600-24a6-4a5a-ba89-efb07fb4fada {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:48:04 devstack sudo[101956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a563a600-24a6-4a5a-ba89-efb07fb4fada Jun 17 05:48:04 devstack sudo[101956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:48:05 devstack sudo[101956]: pam_unix(sudo:session): session closed for user root Jun 17 05:48:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-fb7435a0-11a1-4aa7-8e13-359df043d7b8 tempest-TestInstancesWithCinderVolumes-461180917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a563a600-24a6-4a5a-ba89-efb07fb4fada" returned: 1 in 1.036s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:48:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-fb7435a0-11a1-4aa7-8e13-359df043d7b8 tempest-TestInstancesWithCinderVolumes-461180917 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a563a600-24a6-4a5a-ba89-efb07fb4fada' failed. Not Retrying. {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 05:48:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-fb7435a0-11a1-4aa7-8e13-359df043d7b8 tempest-TestInstancesWithCinderVolumes-461180917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a563a600-24a6-4a5a-ba89-efb07fb4fada {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:48:05 devstack sudo[101961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a563a600-24a6-4a5a-ba89-efb07fb4fada Jun 17 05:48:05 devstack sudo[101961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:48:06 devstack sudo[101961]: pam_unix(sudo:session): session closed for user root Jun 17 05:48:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-fb7435a0-11a1-4aa7-8e13-359df043d7b8 tempest-TestInstancesWithCinderVolumes-461180917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-a563a600-24a6-4a5a-ba89-efb07fb4fada" returned: 0 in 1.060s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:48:06 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-fb7435a0-11a1-4aa7-8e13-359df043d7b8 tempest-TestInstancesWithCinderVolumes-461180917 None] Lock "cinder-quobyte-a563a600-24a6-4a5a-ba89-efb07fb4fada" released by "delete_volume" :: held 2.994s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:48:06 devstack cinder-volume[92083]: DEBUG dbcounter [-] [92083] Writing DB stats cinder:UPDATE=84,cinder:SELECT=81,cinder:INSERT=20,cinder:DELETE=7 {{(pid=92083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:48:06 devstack cinder-volume[92083]: DEBUG dbcounter [-] [92083] Writing DB stats cinder:SELECT=84,cinder:UPDATE=103,cinder:INSERT=23,cinder:DELETE=8 {{(pid=92083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:48:06 devstack cinder-volume[92083]: WARNING cinder.quota [None req-fb7435a0-11a1-4aa7-8e13-359df043d7b8 tempest-TestInstancesWithCinderVolumes-461180917 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1900600737-933681820 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1900600737-933681820, it is now deprecated. Please use the default quota class for default quota. Jun 17 05:48:06 devstack cinder-volume[92083]: WARNING cinder.quota [None req-fb7435a0-11a1-4aa7-8e13-359df043d7b8 tempest-TestInstancesWithCinderVolumes-461180917 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1900600737-933681820 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1900600737-933681820, it is now deprecated. Please use the default quota class for default quota. Jun 17 05:48:06 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-fb7435a0-11a1-4aa7-8e13-359df043d7b8 tempest-TestInstancesWithCinderVolumes-461180917 None] Created reservations ['7bcd26ec-1baa-4b58-b1fd-20f829f647d5', '72600e10-3f08-4386-9bb3-5ae3e351c77a', '94e223f0-9531-4195-a0b6-8ab1a35573d6', '36f9c28c-f3d0-4f43-a2f2-2df3377d3356'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:48:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-fb7435a0-11a1-4aa7-8e13-359df043d7b8 tempest-TestInstancesWithCinderVolumes-461180917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:48:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-fb7435a0-11a1-4aa7-8e13-359df043d7b8 tempest-TestInstancesWithCinderVolumes-461180917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:48:06 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-fb7435a0-11a1-4aa7-8e13-359df043d7b8 tempest-TestInstancesWithCinderVolumes-461180917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:48:06 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-fb7435a0-11a1-4aa7-8e13-359df043d7b8 tempest-TestInstancesWithCinderVolumes-461180917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:48:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-fb7435a0-11a1-4aa7-8e13-359df043d7b8 tempest-TestInstancesWithCinderVolumes-461180917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:48:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-fb7435a0-11a1-4aa7-8e13-359df043d7b8 tempest-TestInstancesWithCinderVolumes-461180917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:48:06 devstack sudo[101968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:48:06 devstack sudo[101968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:48:07 devstack sudo[101968]: pam_unix(sudo:session): session closed for user root Jun 17 05:48:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-fb7435a0-11a1-4aa7-8e13-359df043d7b8 tempest-TestInstancesWithCinderVolumes-461180917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.990s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:48:07 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-fb7435a0-11a1-4aa7-8e13-359df043d7b8 tempest-TestInstancesWithCinderVolumes-461180917 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:48:07 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-fb7435a0-11a1-4aa7-8e13-359df043d7b8 tempest-TestInstancesWithCinderVolumes-461180917 None] Deleted volume successfully. Jun 17 05:48:07 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-fb7435a0-11a1-4aa7-8e13-359df043d7b8 tempest-TestInstancesWithCinderVolumes-461180917 None] Lock "cinder-a563a600-24a6-4a5a-ba89-efb07fb4fada-delete_volume" released by "delete_volume" :: held 4.336s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:48:16 devstack cinder-volume[92083]: DEBUG dbcounter [-] [92083] Writing DB stats cinder:INSERT=1,cinder:UPDATE=7,cinder:SELECT=2 {{(pid=92083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:48:17 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4460a0b-a426-4aee-9116-28a9853ec672 tempest-VolumesActionsTest-569015156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:48:17 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b4460a0b-a426-4aee-9116-28a9853ec672 tempest-VolumesActionsTest-569015156 None] Flow 'volume_create_manager' (df601c89-00fc-4ce3-b470-5976c0952fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:48:17 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b4460a0b-a426-4aee-9116-28a9853ec672 tempest-VolumesActionsTest-569015156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c9cd2db-c2cf-4743-9ae9-778a135e2ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:48:17 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b4460a0b-a426-4aee-9116-28a9853ec672 tempest-VolumesActionsTest-569015156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c9cd2db-c2cf-4743-9ae9-778a135e2ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:48:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-376890771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66775b65-c6d3-49ea-88d5-f86739e679d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='606d749f1880414f820e26479c394e2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:48:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:48:18Z,use_quota=True,user_id='87e217dd42fe4fe0911f8b0eb3a8b08b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:48:17 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b4460a0b-a426-4aee-9116-28a9853ec672 tempest-VolumesActionsTest-569015156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b23f401-42c4-49ed-8749-a6619ccf47e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:48:17 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b4460a0b-a426-4aee-9116-28a9853ec672 tempest-VolumesActionsTest-569015156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b23f401-42c4-49ed-8749-a6619ccf47e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:48:17 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b4460a0b-a426-4aee-9116-28a9853ec672 tempest-VolumesActionsTest-569015156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba880720-8cf6-40c6-9ac9-03b210f6f335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:48:17 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b4460a0b-a426-4aee-9116-28a9853ec672 tempest-VolumesActionsTest-569015156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba880720-8cf6-40c6-9ac9-03b210f6f335) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66775b65-c6d3-49ea-88d5-f86739e679d0', 'volume_name': 'volume-66775b65-c6d3-49ea-88d5-f86739e679d0', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:48:17 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b4460a0b-a426-4aee-9116-28a9853ec672 tempest-VolumesActionsTest-569015156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98eed0fd-7e9c-47f6-be55-0dc833e45ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:48:17 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b4460a0b-a426-4aee-9116-28a9853ec672 tempest-VolumesActionsTest-569015156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98eed0fd-7e9c-47f6-be55-0dc833e45ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:48:17 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b4460a0b-a426-4aee-9116-28a9853ec672 tempest-VolumesActionsTest-569015156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f31a422-6e35-4de7-9123-8c066603e844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:48:17 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-b4460a0b-a426-4aee-9116-28a9853ec672 tempest-VolumesActionsTest-569015156 None] Volume 66775b65-c6d3-49ea-88d5-f86739e679d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66775b65-c6d3-49ea-88d5-f86739e679d0', 'volume_size': 1} Jun 17 05:48:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-b4460a0b-a426-4aee-9116-28a9853ec672 tempest-VolumesActionsTest-569015156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:48:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-b4460a0b-a426-4aee-9116-28a9853ec672 tempest-VolumesActionsTest-569015156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:48:17 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-b4460a0b-a426-4aee-9116-28a9853ec672 tempest-VolumesActionsTest-569015156 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:48:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-376890771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66775b65-c6d3-49ea-88d5-f86739e679d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='606d749f1880414f820e26479c394e2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:48:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:48:18Z,use_quota=True,user_id='87e217dd42fe4fe0911f8b0eb3a8b08b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:48:17 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-b4460a0b-a426-4aee-9116-28a9853ec672 tempest-VolumesActionsTest-569015156 None] Creating volume 66775b65-c6d3-49ea-88d5-f86739e679d0 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:48:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-b4460a0b-a426-4aee-9116-28a9853ec672 tempest-VolumesActionsTest-569015156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:48:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-b4460a0b-a426-4aee-9116-28a9853ec672 tempest-VolumesActionsTest-569015156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:48:17 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-b4460a0b-a426-4aee-9116-28a9853ec672 tempest-VolumesActionsTest-569015156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:48:17 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-b4460a0b-a426-4aee-9116-28a9853ec672 tempest-VolumesActionsTest-569015156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:48:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-b4460a0b-a426-4aee-9116-28a9853ec672 tempest-VolumesActionsTest-569015156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:48:17 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-b4460a0b-a426-4aee-9116-28a9853ec672 tempest-VolumesActionsTest-569015156 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:48:17 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-b4460a0b-a426-4aee-9116-28a9853ec672 tempest-VolumesActionsTest-569015156 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:48:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b4460a0b-a426-4aee-9116-28a9853ec672 tempest-VolumesActionsTest-569015156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-66775b65-c6d3-49ea-88d5-f86739e679d0 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:48:17 devstack sudo[102070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-66775b65-c6d3-49ea-88d5-f86739e679d0 1073741824 Jun 17 05:48:17 devstack sudo[102070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:48:18 devstack sudo[102070]: pam_unix(sudo:session): session closed for user root Jun 17 05:48:18 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b4460a0b-a426-4aee-9116-28a9853ec672 tempest-VolumesActionsTest-569015156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-66775b65-c6d3-49ea-88d5-f86739e679d0 1073741824" returned: 0 in 1.198s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:48:18 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b4460a0b-a426-4aee-9116-28a9853ec672 tempest-VolumesActionsTest-569015156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-66775b65-c6d3-49ea-88d5-f86739e679d0 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:48:19 devstack sudo[102079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-66775b65-c6d3-49ea-88d5-f86739e679d0 Jun 17 05:48:19 devstack sudo[102079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:48:19 devstack sudo[102079]: pam_unix(sudo:session): session closed for user root Jun 17 05:48:19 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b4460a0b-a426-4aee-9116-28a9853ec672 tempest-VolumesActionsTest-569015156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-66775b65-c6d3-49ea-88d5-f86739e679d0" returned: 0 in 0.668s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:48:19 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-b4460a0b-a426-4aee-9116-28a9853ec672 tempest-VolumesActionsTest-569015156 None] <== create_volume: return (1932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:48:19 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-b4460a0b-a426-4aee-9116-28a9853ec672 tempest-VolumesActionsTest-569015156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.935s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:48:19 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b4460a0b-a426-4aee-9116-28a9853ec672 tempest-VolumesActionsTest-569015156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f31a422-6e35-4de7-9123-8c066603e844) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66775b65-c6d3-49ea-88d5-f86739e679d0', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:48:19 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b4460a0b-a426-4aee-9116-28a9853ec672 tempest-VolumesActionsTest-569015156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f37b9d39-a22b-49e9-b9f8-03ef54899266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:48:19 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-b4460a0b-a426-4aee-9116-28a9853ec672 tempest-VolumesActionsTest-569015156 None] Volume volume-66775b65-c6d3-49ea-88d5-f86739e679d0 (66775b65-c6d3-49ea-88d5-f86739e679d0): created successfully Jun 17 05:48:19 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b4460a0b-a426-4aee-9116-28a9853ec672 tempest-VolumesActionsTest-569015156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f37b9d39-a22b-49e9-b9f8-03ef54899266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:48:19 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b4460a0b-a426-4aee-9116-28a9853ec672 tempest-VolumesActionsTest-569015156 None] Flow 'volume_create_manager' (df601c89-00fc-4ce3-b470-5976c0952fd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:48:19 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-b4460a0b-a426-4aee-9116-28a9853ec672 tempest-VolumesActionsTest-569015156 None] Created volume successfully. Jun 17 05:48:27 devstack cinder-volume[92083]: DEBUG oslo_service.periodic_task [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92083) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 05:48:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:48:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:48:27 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:48:27 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:48:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:48:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:48:27 devstack sudo[102153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:48:27 devstack sudo[102153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:48:28 devstack sudo[102153]: pam_unix(sudo:session): session closed for user root Jun 17 05:48:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.703s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:48:28 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:48:28 devstack cinder-volume[92083]: DEBUG oslo_service.periodic_task [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running periodic task VolumeManager._thread_info {{(pid=92083) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 05:48:28 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] thread count: 28 {{(pid=92083) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 17 05:48:28 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] thread info: [<_MainThread(MainThread, started 133483869905024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92083) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 17 05:48:29 devstack cinder-volume[92083]: DEBUG dbcounter [-] [92083] Writing DB stats cinder:SELECT=3,cinder:UPDATE=5 {{(pid=92083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:48:29 devstack cinder-volume[92083]: DEBUG dbcounter [-] [92083] Writing DB stats cinder:SELECT=5,cinder:INSERT=4,cinder:UPDATE=9,cinder:DELETE=2 {{(pid=92083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:48:30 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-92813c1f-af99-4ea8-9296-905d56ab7b8d tempest-TestServerVolumeAttachScenarioOldVersion-1124689658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:48:30 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-92813c1f-af99-4ea8-9296-905d56ab7b8d tempest-TestServerVolumeAttachScenarioOldVersion-1124689658 None] Flow 'volume_create_manager' (b5fb38ab-7521-466c-9abd-e369ee817dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:48:30 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-92813c1f-af99-4ea8-9296-905d56ab7b8d tempest-TestServerVolumeAttachScenarioOldVersion-1124689658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af31f7db-32bd-41cd-971a-83e679f65e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:48:30 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-92813c1f-af99-4ea8-9296-905d56ab7b8d tempest-TestServerVolumeAttachScenarioOldVersion-1124689658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af31f7db-32bd-41cd-971a-83e679f65e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:48:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-236298999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c89bc2aa-8810-43f3-a33c-3ff889d81ade,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='638263e0278849ccb2c8bec76de3c210',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:48:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:48:30Z,use_quota=True,user_id='404edf7401e6409cabc8ca6702356d80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:48:30 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-92813c1f-af99-4ea8-9296-905d56ab7b8d tempest-TestServerVolumeAttachScenarioOldVersion-1124689658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e852f368-ce3c-4f7f-a76f-ddcb0d494d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:48:30 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-92813c1f-af99-4ea8-9296-905d56ab7b8d tempest-TestServerVolumeAttachScenarioOldVersion-1124689658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e852f368-ce3c-4f7f-a76f-ddcb0d494d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:48:30 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-92813c1f-af99-4ea8-9296-905d56ab7b8d tempest-TestServerVolumeAttachScenarioOldVersion-1124689658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (567a6542-32a2-4256-860d-809197b8beac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:48:30 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-92813c1f-af99-4ea8-9296-905d56ab7b8d tempest-TestServerVolumeAttachScenarioOldVersion-1124689658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (567a6542-32a2-4256-860d-809197b8beac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c89bc2aa-8810-43f3-a33c-3ff889d81ade', 'volume_name': 'volume-c89bc2aa-8810-43f3-a33c-3ff889d81ade', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:48:30 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-92813c1f-af99-4ea8-9296-905d56ab7b8d tempest-TestServerVolumeAttachScenarioOldVersion-1124689658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (993eb8b3-943b-4c92-bfd9-76ad4a059079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:48:30 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-92813c1f-af99-4ea8-9296-905d56ab7b8d tempest-TestServerVolumeAttachScenarioOldVersion-1124689658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (993eb8b3-943b-4c92-bfd9-76ad4a059079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:48:30 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-92813c1f-af99-4ea8-9296-905d56ab7b8d tempest-TestServerVolumeAttachScenarioOldVersion-1124689658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (958dfbf3-e4cb-4d26-b1f9-3d5fab990b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:48:30 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-92813c1f-af99-4ea8-9296-905d56ab7b8d tempest-TestServerVolumeAttachScenarioOldVersion-1124689658 None] Volume c89bc2aa-8810-43f3-a33c-3ff889d81ade: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c89bc2aa-8810-43f3-a33c-3ff889d81ade', 'volume_size': 1} Jun 17 05:48:30 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-92813c1f-af99-4ea8-9296-905d56ab7b8d tempest-TestServerVolumeAttachScenarioOldVersion-1124689658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:48:30 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-92813c1f-af99-4ea8-9296-905d56ab7b8d tempest-TestServerVolumeAttachScenarioOldVersion-1124689658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:48:30 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-92813c1f-af99-4ea8-9296-905d56ab7b8d tempest-TestServerVolumeAttachScenarioOldVersion-1124689658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:48:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-236298999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c89bc2aa-8810-43f3-a33c-3ff889d81ade,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='638263e0278849ccb2c8bec76de3c210',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:48:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:48:30Z,use_quota=True,user_id='404edf7401e6409cabc8ca6702356d80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:48:30 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-92813c1f-af99-4ea8-9296-905d56ab7b8d tempest-TestServerVolumeAttachScenarioOldVersion-1124689658 None] Creating volume c89bc2aa-8810-43f3-a33c-3ff889d81ade {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:48:30 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-92813c1f-af99-4ea8-9296-905d56ab7b8d tempest-TestServerVolumeAttachScenarioOldVersion-1124689658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:48:30 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-92813c1f-af99-4ea8-9296-905d56ab7b8d tempest-TestServerVolumeAttachScenarioOldVersion-1124689658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:48:30 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-92813c1f-af99-4ea8-9296-905d56ab7b8d tempest-TestServerVolumeAttachScenarioOldVersion-1124689658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:48:30 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-92813c1f-af99-4ea8-9296-905d56ab7b8d tempest-TestServerVolumeAttachScenarioOldVersion-1124689658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:48:30 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-92813c1f-af99-4ea8-9296-905d56ab7b8d tempest-TestServerVolumeAttachScenarioOldVersion-1124689658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:48:30 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-92813c1f-af99-4ea8-9296-905d56ab7b8d tempest-TestServerVolumeAttachScenarioOldVersion-1124689658 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:48:30 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-92813c1f-af99-4ea8-9296-905d56ab7b8d tempest-TestServerVolumeAttachScenarioOldVersion-1124689658 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:48:30 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-92813c1f-af99-4ea8-9296-905d56ab7b8d tempest-TestServerVolumeAttachScenarioOldVersion-1124689658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c89bc2aa-8810-43f3-a33c-3ff889d81ade 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:48:30 devstack sudo[102176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c89bc2aa-8810-43f3-a33c-3ff889d81ade 1073741824 Jun 17 05:48:30 devstack sudo[102176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:48:31 devstack sudo[102176]: pam_unix(sudo:session): session closed for user root Jun 17 05:48:31 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-92813c1f-af99-4ea8-9296-905d56ab7b8d tempest-TestServerVolumeAttachScenarioOldVersion-1124689658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c89bc2aa-8810-43f3-a33c-3ff889d81ade 1073741824" returned: 0 in 1.099s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:48:31 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-92813c1f-af99-4ea8-9296-905d56ab7b8d tempest-TestServerVolumeAttachScenarioOldVersion-1124689658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c89bc2aa-8810-43f3-a33c-3ff889d81ade {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:48:31 devstack sudo[102186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c89bc2aa-8810-43f3-a33c-3ff889d81ade Jun 17 05:48:31 devstack sudo[102186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:48:32 devstack sudo[102186]: pam_unix(sudo:session): session closed for user root Jun 17 05:48:32 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-92813c1f-af99-4ea8-9296-905d56ab7b8d tempest-TestServerVolumeAttachScenarioOldVersion-1124689658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c89bc2aa-8810-43f3-a33c-3ff889d81ade" returned: 0 in 0.810s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:48:32 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-92813c1f-af99-4ea8-9296-905d56ab7b8d tempest-TestServerVolumeAttachScenarioOldVersion-1124689658 None] <== create_volume: return (1964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:48:32 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-92813c1f-af99-4ea8-9296-905d56ab7b8d tempest-TestServerVolumeAttachScenarioOldVersion-1124689658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.967s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:48:32 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-92813c1f-af99-4ea8-9296-905d56ab7b8d tempest-TestServerVolumeAttachScenarioOldVersion-1124689658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (958dfbf3-e4cb-4d26-b1f9-3d5fab990b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c89bc2aa-8810-43f3-a33c-3ff889d81ade', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:48:32 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-92813c1f-af99-4ea8-9296-905d56ab7b8d tempest-TestServerVolumeAttachScenarioOldVersion-1124689658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c2161db-b159-4f29-9e62-eeeafd1141ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:48:32 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-92813c1f-af99-4ea8-9296-905d56ab7b8d tempest-TestServerVolumeAttachScenarioOldVersion-1124689658 None] Volume volume-c89bc2aa-8810-43f3-a33c-3ff889d81ade (c89bc2aa-8810-43f3-a33c-3ff889d81ade): created successfully Jun 17 05:48:32 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-92813c1f-af99-4ea8-9296-905d56ab7b8d tempest-TestServerVolumeAttachScenarioOldVersion-1124689658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c2161db-b159-4f29-9e62-eeeafd1141ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:48:32 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-92813c1f-af99-4ea8-9296-905d56ab7b8d tempest-TestServerVolumeAttachScenarioOldVersion-1124689658 None] Flow 'volume_create_manager' (b5fb38ab-7521-466c-9abd-e369ee817dee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:48:32 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-92813c1f-af99-4ea8-9296-905d56ab7b8d tempest-TestServerVolumeAttachScenarioOldVersion-1124689658 None] Created volume successfully. Jun 17 05:48:33 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa446c90-6fa6-470f-8ddf-23dabdf92bde tempest-AttachVolumeNegativeTest-1827868215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:48:33 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-aa446c90-6fa6-470f-8ddf-23dabdf92bde tempest-AttachVolumeNegativeTest-1827868215 None] Flow 'volume_create_manager' (bd2be9ac-99f5-4fd8-b1a2-54a39f2c26b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:48:33 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-aa446c90-6fa6-470f-8ddf-23dabdf92bde tempest-AttachVolumeNegativeTest-1827868215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (430ded66-4472-4198-b2c4-5f2979439086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:48:33 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-aa446c90-6fa6-470f-8ddf-23dabdf92bde tempest-AttachVolumeNegativeTest-1827868215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (430ded66-4472-4198-b2c4-5f2979439086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:48:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-455840188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=691f577d-bf47-4514-9d79-a645dfdf75a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c02a66f7d37409daee1a984e0052823',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:48:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:48:33Z,use_quota=True,user_id='23e65f7b04184a998e98388dd4c3169a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:48:33 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-aa446c90-6fa6-470f-8ddf-23dabdf92bde tempest-AttachVolumeNegativeTest-1827868215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ebbd3cf-677b-49fb-a05f-fcb3deb03431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:48:33 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-aa446c90-6fa6-470f-8ddf-23dabdf92bde tempest-AttachVolumeNegativeTest-1827868215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ebbd3cf-677b-49fb-a05f-fcb3deb03431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:48:33 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-aa446c90-6fa6-470f-8ddf-23dabdf92bde tempest-AttachVolumeNegativeTest-1827868215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef1d9410-6cb1-4a06-939d-7ac79ae746f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:48:33 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-aa446c90-6fa6-470f-8ddf-23dabdf92bde tempest-AttachVolumeNegativeTest-1827868215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef1d9410-6cb1-4a06-939d-7ac79ae746f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '691f577d-bf47-4514-9d79-a645dfdf75a3', 'volume_name': 'volume-691f577d-bf47-4514-9d79-a645dfdf75a3', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:48:33 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-aa446c90-6fa6-470f-8ddf-23dabdf92bde tempest-AttachVolumeNegativeTest-1827868215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c23ce89-92d4-43ee-ad9b-89a7c4e58add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:48:33 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-aa446c90-6fa6-470f-8ddf-23dabdf92bde tempest-AttachVolumeNegativeTest-1827868215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c23ce89-92d4-43ee-ad9b-89a7c4e58add) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:48:33 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-aa446c90-6fa6-470f-8ddf-23dabdf92bde tempest-AttachVolumeNegativeTest-1827868215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df429d81-5384-440f-9351-f04a9891960b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:48:33 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-aa446c90-6fa6-470f-8ddf-23dabdf92bde tempest-AttachVolumeNegativeTest-1827868215 None] Volume 691f577d-bf47-4514-9d79-a645dfdf75a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-691f577d-bf47-4514-9d79-a645dfdf75a3', 'volume_size': 1} Jun 17 05:48:33 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-aa446c90-6fa6-470f-8ddf-23dabdf92bde tempest-AttachVolumeNegativeTest-1827868215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:48:33 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-aa446c90-6fa6-470f-8ddf-23dabdf92bde tempest-AttachVolumeNegativeTest-1827868215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:48:33 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-aa446c90-6fa6-470f-8ddf-23dabdf92bde tempest-AttachVolumeNegativeTest-1827868215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:48:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-455840188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=691f577d-bf47-4514-9d79-a645dfdf75a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c02a66f7d37409daee1a984e0052823',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:48:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:48:33Z,use_quota=True,user_id='23e65f7b04184a998e98388dd4c3169a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:48:33 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-aa446c90-6fa6-470f-8ddf-23dabdf92bde tempest-AttachVolumeNegativeTest-1827868215 None] Creating volume 691f577d-bf47-4514-9d79-a645dfdf75a3 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:48:33 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-aa446c90-6fa6-470f-8ddf-23dabdf92bde tempest-AttachVolumeNegativeTest-1827868215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:48:33 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-aa446c90-6fa6-470f-8ddf-23dabdf92bde tempest-AttachVolumeNegativeTest-1827868215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:48:33 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-aa446c90-6fa6-470f-8ddf-23dabdf92bde tempest-AttachVolumeNegativeTest-1827868215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:48:33 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-aa446c90-6fa6-470f-8ddf-23dabdf92bde tempest-AttachVolumeNegativeTest-1827868215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:48:33 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-aa446c90-6fa6-470f-8ddf-23dabdf92bde tempest-AttachVolumeNegativeTest-1827868215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:48:33 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-aa446c90-6fa6-470f-8ddf-23dabdf92bde tempest-AttachVolumeNegativeTest-1827868215 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:48:33 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-aa446c90-6fa6-470f-8ddf-23dabdf92bde tempest-AttachVolumeNegativeTest-1827868215 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:48:33 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-aa446c90-6fa6-470f-8ddf-23dabdf92bde tempest-AttachVolumeNegativeTest-1827868215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-691f577d-bf47-4514-9d79-a645dfdf75a3 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:48:33 devstack sudo[102192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-691f577d-bf47-4514-9d79-a645dfdf75a3 1073741824 Jun 17 05:48:33 devstack sudo[102192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:48:34 devstack sudo[102192]: pam_unix(sudo:session): session closed for user root Jun 17 05:48:34 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-aa446c90-6fa6-470f-8ddf-23dabdf92bde tempest-AttachVolumeNegativeTest-1827868215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-691f577d-bf47-4514-9d79-a645dfdf75a3 1073741824" returned: 0 in 0.981s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:48:34 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-aa446c90-6fa6-470f-8ddf-23dabdf92bde tempest-AttachVolumeNegativeTest-1827868215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-691f577d-bf47-4514-9d79-a645dfdf75a3 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:48:34 devstack sudo[102199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-691f577d-bf47-4514-9d79-a645dfdf75a3 Jun 17 05:48:34 devstack sudo[102199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:48:35 devstack sudo[102199]: pam_unix(sudo:session): session closed for user root Jun 17 05:48:35 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-aa446c90-6fa6-470f-8ddf-23dabdf92bde tempest-AttachVolumeNegativeTest-1827868215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-691f577d-bf47-4514-9d79-a645dfdf75a3" returned: 0 in 0.623s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:48:35 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-aa446c90-6fa6-470f-8ddf-23dabdf92bde tempest-AttachVolumeNegativeTest-1827868215 None] <== create_volume: return (1661ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:48:35 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-aa446c90-6fa6-470f-8ddf-23dabdf92bde tempest-AttachVolumeNegativeTest-1827868215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.663s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:48:35 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-aa446c90-6fa6-470f-8ddf-23dabdf92bde tempest-AttachVolumeNegativeTest-1827868215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df429d81-5384-440f-9351-f04a9891960b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-691f577d-bf47-4514-9d79-a645dfdf75a3', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:48:35 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-aa446c90-6fa6-470f-8ddf-23dabdf92bde tempest-AttachVolumeNegativeTest-1827868215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d502994f-41e3-42a7-b393-b994068e10f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:48:35 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-aa446c90-6fa6-470f-8ddf-23dabdf92bde tempest-AttachVolumeNegativeTest-1827868215 None] Volume volume-691f577d-bf47-4514-9d79-a645dfdf75a3 (691f577d-bf47-4514-9d79-a645dfdf75a3): created successfully Jun 17 05:48:35 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-aa446c90-6fa6-470f-8ddf-23dabdf92bde tempest-AttachVolumeNegativeTest-1827868215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d502994f-41e3-42a7-b393-b994068e10f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:48:35 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-aa446c90-6fa6-470f-8ddf-23dabdf92bde tempest-AttachVolumeNegativeTest-1827868215 None] Flow 'volume_create_manager' (bd2be9ac-99f5-4fd8-b1a2-54a39f2c26b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:48:35 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-aa446c90-6fa6-470f-8ddf-23dabdf92bde tempest-AttachVolumeNegativeTest-1827868215 None] Created volume successfully. Jun 17 05:48:36 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-e9ed6d2e-ca0c-4580-88f1-e41f1298beeb req-d0deb070-33ee-4160-a50b-923d3f1917e6 tempest-TestServerVolumeAttachScenarioOldVersion-1124689658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:48:36 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-e9ed6d2e-ca0c-4580-88f1-e41f1298beeb req-d0deb070-33ee-4160-a50b-923d3f1917e6 tempest-TestServerVolumeAttachScenarioOldVersion-1124689658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:48:36 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04ac0c3-be44-4211-b0f8-70da230df7e4]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:48:36 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-e9ed6d2e-ca0c-4580-88f1-e41f1298beeb req-d0deb070-33ee-4160-a50b-923d3f1917e6 tempest-TestServerVolumeAttachScenarioOldVersion-1124689658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c89bc2aa-8810-43f3-a33c-3ff889d81ade {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:48:36 devstack sudo[102211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c89bc2aa-8810-43f3-a33c-3ff889d81ade Jun 17 05:48:36 devstack sudo[102211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:48:37 devstack sudo[102211]: pam_unix(sudo:session): session closed for user root Jun 17 05:48:37 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-e9ed6d2e-ca0c-4580-88f1-e41f1298beeb req-d0deb070-33ee-4160-a50b-923d3f1917e6 tempest-TestServerVolumeAttachScenarioOldVersion-1124689658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c89bc2aa-8810-43f3-a33c-3ff889d81ade" returned: 0 in 0.756s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:48:37 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-e9ed6d2e-ca0c-4580-88f1-e41f1298beeb req-d0deb070-33ee-4160-a50b-923d3f1917e6 tempest-TestServerVolumeAttachScenarioOldVersion-1124689658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.782s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:48:37 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [req-e9ed6d2e-ca0c-4580-88f1-e41f1298beeb req-d0deb070-33ee-4160-a50b-923d3f1917e6 tempest-TestServerVolumeAttachScenarioOldVersion-1124689658 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f', 'name': 'volume-c89bc2aa-8810-43f3-a33c-3ff889d81ade', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9a8c9b03-11d8-4c79-a24b-180586490946', 'enforce_multipath': True} {{(pid=92083) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 17 05:48:37 devstack cinder-volume[92083]: INFO cinder.volume.manager [req-e9ed6d2e-ca0c-4580-88f1-e41f1298beeb req-d0deb070-33ee-4160-a50b-923d3f1917e6 tempest-TestServerVolumeAttachScenarioOldVersion-1124689658 None] attachment_update completed successfully. Jun 17 05:48:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-f067e9ef-f295-457a-bd0a-4b00754a0b78 req-94e4081d-2a05-45ca-b6e7-7c51b62fbccd tempest-AttachVolumeNegativeTest-1827868215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:48:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-f067e9ef-f295-457a-bd0a-4b00754a0b78 req-94e4081d-2a05-45ca-b6e7-7c51b62fbccd tempest-AttachVolumeNegativeTest-1827868215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:48:39 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb413f26-e479-43b2-a77b-cd4cd7a8bc2c]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:48:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-f067e9ef-f295-457a-bd0a-4b00754a0b78 req-94e4081d-2a05-45ca-b6e7-7c51b62fbccd tempest-AttachVolumeNegativeTest-1827868215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-691f577d-bf47-4514-9d79-a645dfdf75a3 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:48:39 devstack sudo[102662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-691f577d-bf47-4514-9d79-a645dfdf75a3 Jun 17 05:48:39 devstack sudo[102662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:48:40 devstack sudo[102662]: pam_unix(sudo:session): session closed for user root Jun 17 05:48:40 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-f067e9ef-f295-457a-bd0a-4b00754a0b78 req-94e4081d-2a05-45ca-b6e7-7c51b62fbccd tempest-AttachVolumeNegativeTest-1827868215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-691f577d-bf47-4514-9d79-a645dfdf75a3" returned: 0 in 0.950s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:48:40 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-f067e9ef-f295-457a-bd0a-4b00754a0b78 req-94e4081d-2a05-45ca-b6e7-7c51b62fbccd tempest-AttachVolumeNegativeTest-1827868215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.997s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:48:40 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [req-f067e9ef-f295-457a-bd0a-4b00754a0b78 req-94e4081d-2a05-45ca-b6e7-7c51b62fbccd tempest-AttachVolumeNegativeTest-1827868215 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f', 'name': 'volume-691f577d-bf47-4514-9d79-a645dfdf75a3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0520d956-01ab-4005-8c58-f8d566d33646', 'enforce_multipath': True} {{(pid=92083) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 17 05:48:40 devstack cinder-volume[92083]: INFO cinder.volume.manager [req-f067e9ef-f295-457a-bd0a-4b00754a0b78 req-94e4081d-2a05-45ca-b6e7-7c51b62fbccd tempest-AttachVolumeNegativeTest-1827868215 None] attachment_update completed successfully. Jun 17 05:48:43 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-98819cae-e64d-4133-97ee-8bbaa4e3222e tempest-VolumesActionsTest-569015156 None] Acquiring lock "cinder-66775b65-c6d3-49ea-88d5-f86739e679d0" by "attach_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:48:44 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-98819cae-e64d-4133-97ee-8bbaa4e3222e tempest-VolumesActionsTest-569015156 None] Lock "cinder-66775b65-c6d3-49ea-88d5-f86739e679d0" acquired by "attach_volume" :: waited 0.036s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:48:44 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-98819cae-e64d-4133-97ee-8bbaa4e3222e tempest-VolumesActionsTest-569015156 None] Attaching volume 66775b65-c6d3-49ea-88d5-f86739e679d0 to instance f629af10-3ab4-4cf3-a7d7-5140fa002ea8 at mountpoint /dev/vdb on host None. Jun 17 05:48:44 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-98819cae-e64d-4133-97ee-8bbaa4e3222e tempest-VolumesActionsTest-569015156 None] Attach volume completed successfully. Jun 17 05:48:44 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-98819cae-e64d-4133-97ee-8bbaa4e3222e tempest-VolumesActionsTest-569015156 None] Lock "cinder-66775b65-c6d3-49ea-88d5-f86739e679d0" released by "attach_volume" :: held 0.121s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:48:44 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-7338cea0-998e-454a-946d-f49053ec7026 tempest-VolumesActionsTest-569015156 None] Acquiring lock "cinder-66775b65-c6d3-49ea-88d5-f86739e679d0-detach_volume" by "detach_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:48:44 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-7338cea0-998e-454a-946d-f49053ec7026 tempest-VolumesActionsTest-569015156 None] Lock "cinder-66775b65-c6d3-49ea-88d5-f86739e679d0-detach_volume" acquired by "detach_volume" :: waited 0.033s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:48:44 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-7338cea0-998e-454a-946d-f49053ec7026 tempest-VolumesActionsTest-569015156 None] Detaching volume 66775b65-c6d3-49ea-88d5-f86739e679d0 from instance f629af10-3ab4-4cf3-a7d7-5140fa002ea8. Jun 17 05:48:44 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-7338cea0-998e-454a-946d-f49053ec7026 tempest-VolumesActionsTest-569015156 None] Detach volume completed successfully. Jun 17 05:48:44 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-7338cea0-998e-454a-946d-f49053ec7026 tempest-VolumesActionsTest-569015156 None] Lock "cinder-66775b65-c6d3-49ea-88d5-f86739e679d0-detach_volume" released by "detach_volume" :: held 0.153s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:48:46 devstack cinder-volume[92083]: INFO cinder.volume.manager [req-d2780aa6-9c70-4ccc-b3d5-c23f16706317 req-aeab7b06-083b-46e5-a4d7-f1ae027d30c3 tempest-TestServerVolumeAttachScenarioOldVersion-1124689658 None] Terminate volume connection completed successfully. Jun 17 05:48:46 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [req-d2780aa6-9c70-4ccc-b3d5-c23f16706317 req-aeab7b06-083b-46e5-a4d7-f1ae027d30c3 tempest-TestServerVolumeAttachScenarioOldVersion-1124689658 None] Deleting attachment 9a8c9b03-11d8-4c79-a24b-180586490946. {{(pid=92083) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 17 05:48:46 devstack cinder-volume[92083]: INFO cinder.volume.manager [req-a1318ccb-cf79-44cb-9314-9bd1731f871d req-0d7ac30d-6532-4cd5-a219-cefed75be9bf tempest-AttachVolumeNegativeTest-1827868215 None] Terminate volume connection completed successfully. Jun 17 05:48:46 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [req-a1318ccb-cf79-44cb-9314-9bd1731f871d req-0d7ac30d-6532-4cd5-a219-cefed75be9bf tempest-AttachVolumeNegativeTest-1827868215 None] Deleting attachment 0520d956-01ab-4005-8c58-f8d566d33646. {{(pid=92083) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 17 05:48:48 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-f554642d-f7d1-4f98-8ca6-d46868d8e775 tempest-TestServerVolumeAttachScenarioOldVersion-1124689658 None] Acquiring lock "cinder-c89bc2aa-8810-43f3-a33c-3ff889d81ade-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:48:48 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-f554642d-f7d1-4f98-8ca6-d46868d8e775 tempest-TestServerVolumeAttachScenarioOldVersion-1124689658 None] Lock "cinder-c89bc2aa-8810-43f3-a33c-3ff889d81ade-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:48:48 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-f554642d-f7d1-4f98-8ca6-d46868d8e775 tempest-TestServerVolumeAttachScenarioOldVersion-1124689658 None] Acquiring lock "cinder-quobyte-c89bc2aa-8810-43f3-a33c-3ff889d81ade" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:48:48 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-f554642d-f7d1-4f98-8ca6-d46868d8e775 tempest-TestServerVolumeAttachScenarioOldVersion-1124689658 None] Lock "cinder-quobyte-c89bc2aa-8810-43f3-a33c-3ff889d81ade" acquired by "delete_volume" :: waited 0.031s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:48:48 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[05db57fc-def4-4ab3-b4f8-976eeb6947af]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:48:48 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f554642d-f7d1-4f98-8ca6-d46868d8e775 tempest-TestServerVolumeAttachScenarioOldVersion-1124689658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c89bc2aa-8810-43f3-a33c-3ff889d81ade {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:48:48 devstack sudo[102749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c89bc2aa-8810-43f3-a33c-3ff889d81ade Jun 17 05:48:48 devstack sudo[102749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:48:49 devstack sudo[102749]: pam_unix(sudo:session): session closed for user root Jun 17 05:48:49 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f554642d-f7d1-4f98-8ca6-d46868d8e775 tempest-TestServerVolumeAttachScenarioOldVersion-1124689658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c89bc2aa-8810-43f3-a33c-3ff889d81ade" returned: 0 in 0.807s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:48:49 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f554642d-f7d1-4f98-8ca6-d46868d8e775 tempest-TestServerVolumeAttachScenarioOldVersion-1124689658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c89bc2aa-8810-43f3-a33c-3ff889d81ade {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:48:49 devstack sudo[102756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c89bc2aa-8810-43f3-a33c-3ff889d81ade Jun 17 05:48:49 devstack sudo[102756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:48:50 devstack sudo[102756]: pam_unix(sudo:session): session closed for user root Jun 17 05:48:50 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f554642d-f7d1-4f98-8ca6-d46868d8e775 tempest-TestServerVolumeAttachScenarioOldVersion-1124689658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c89bc2aa-8810-43f3-a33c-3ff889d81ade" returned: 0 in 0.752s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:48:50 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-f554642d-f7d1-4f98-8ca6-d46868d8e775 tempest-TestServerVolumeAttachScenarioOldVersion-1124689658 None] Lock "cinder-quobyte-c89bc2aa-8810-43f3-a33c-3ff889d81ade" released by "delete_volume" :: held 1.636s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:48:50 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-f554642d-f7d1-4f98-8ca6-d46868d8e775 tempest-TestServerVolumeAttachScenarioOldVersion-1124689658 None] Created reservations ['a2de53ba-720a-4b25-a0d8-e432cc7d6cf8', '589cfa14-73f7-4057-a07a-55f3cbf4ed9d', '24a70f94-ca1c-4702-bf02-37f1aa5af5b5', '3bd700c1-7671-4b30-8358-9e8b941cd59b'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:48:50 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-f554642d-f7d1-4f98-8ca6-d46868d8e775 tempest-TestServerVolumeAttachScenarioOldVersion-1124689658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:48:50 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-f554642d-f7d1-4f98-8ca6-d46868d8e775 tempest-TestServerVolumeAttachScenarioOldVersion-1124689658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:48:50 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-f554642d-f7d1-4f98-8ca6-d46868d8e775 tempest-TestServerVolumeAttachScenarioOldVersion-1124689658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:48:50 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-f554642d-f7d1-4f98-8ca6-d46868d8e775 tempest-TestServerVolumeAttachScenarioOldVersion-1124689658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:48:50 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-f554642d-f7d1-4f98-8ca6-d46868d8e775 tempest-TestServerVolumeAttachScenarioOldVersion-1124689658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:48:50 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f554642d-f7d1-4f98-8ca6-d46868d8e775 tempest-TestServerVolumeAttachScenarioOldVersion-1124689658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:48:50 devstack sudo[102807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:48:50 devstack sudo[102807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:48:51 devstack sudo[102807]: pam_unix(sudo:session): session closed for user root Jun 17 05:48:51 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f554642d-f7d1-4f98-8ca6-d46868d8e775 tempest-TestServerVolumeAttachScenarioOldVersion-1124689658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.795s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:48:51 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-f554642d-f7d1-4f98-8ca6-d46868d8e775 tempest-TestServerVolumeAttachScenarioOldVersion-1124689658 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:48:51 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-f554642d-f7d1-4f98-8ca6-d46868d8e775 tempest-TestServerVolumeAttachScenarioOldVersion-1124689658 None] Deleted volume successfully. Jun 17 05:48:51 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-f554642d-f7d1-4f98-8ca6-d46868d8e775 tempest-TestServerVolumeAttachScenarioOldVersion-1124689658 None] Lock "cinder-c89bc2aa-8810-43f3-a33c-3ff889d81ade-delete_volume" released by "delete_volume" :: held 2.710s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:48:58 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-10a689a4-b887-4989-a54f-4b6f9119ca5a tempest-AttachVolumeNegativeTest-1827868215 None] Acquiring lock "cinder-691f577d-bf47-4514-9d79-a645dfdf75a3-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:48:58 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-10a689a4-b887-4989-a54f-4b6f9119ca5a tempest-AttachVolumeNegativeTest-1827868215 None] Lock "cinder-691f577d-bf47-4514-9d79-a645dfdf75a3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:48:58 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-10a689a4-b887-4989-a54f-4b6f9119ca5a tempest-AttachVolumeNegativeTest-1827868215 None] Acquiring lock "cinder-quobyte-691f577d-bf47-4514-9d79-a645dfdf75a3" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:48:58 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-10a689a4-b887-4989-a54f-4b6f9119ca5a tempest-AttachVolumeNegativeTest-1827868215 None] Lock "cinder-quobyte-691f577d-bf47-4514-9d79-a645dfdf75a3" acquired by "delete_volume" :: waited 0.019s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:48:58 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[c120fc68-daba-4472-b8e0-48ef92b82fcb]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:48:58 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-10a689a4-b887-4989-a54f-4b6f9119ca5a tempest-AttachVolumeNegativeTest-1827868215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-691f577d-bf47-4514-9d79-a645dfdf75a3 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:48:58 devstack sudo[102891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-691f577d-bf47-4514-9d79-a645dfdf75a3 Jun 17 05:48:58 devstack sudo[102891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:48:59 devstack sudo[102891]: pam_unix(sudo:session): session closed for user root Jun 17 05:48:59 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-10a689a4-b887-4989-a54f-4b6f9119ca5a tempest-AttachVolumeNegativeTest-1827868215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-691f577d-bf47-4514-9d79-a645dfdf75a3" returned: 0 in 0.733s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:48:59 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-10a689a4-b887-4989-a54f-4b6f9119ca5a tempest-AttachVolumeNegativeTest-1827868215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-691f577d-bf47-4514-9d79-a645dfdf75a3 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:48:59 devstack sudo[102897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-691f577d-bf47-4514-9d79-a645dfdf75a3 Jun 17 05:48:59 devstack sudo[102897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:49:00 devstack sudo[102897]: pam_unix(sudo:session): session closed for user root Jun 17 05:49:00 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-10a689a4-b887-4989-a54f-4b6f9119ca5a tempest-AttachVolumeNegativeTest-1827868215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-691f577d-bf47-4514-9d79-a645dfdf75a3" returned: 0 in 0.658s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:49:00 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-10a689a4-b887-4989-a54f-4b6f9119ca5a tempest-AttachVolumeNegativeTest-1827868215 None] Lock "cinder-quobyte-691f577d-bf47-4514-9d79-a645dfdf75a3" released by "delete_volume" :: held 1.445s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:49:00 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-10a689a4-b887-4989-a54f-4b6f9119ca5a tempest-AttachVolumeNegativeTest-1827868215 None] Created reservations ['8cb6c4d5-8139-47f2-a121-c74b3da325c7', '97465cfd-13f4-4ddd-8856-045aeb0bbc30', 'd27fec07-a047-49e1-bebd-148b9c2eba6d', '86cec9ea-8555-4f9f-aede-0722fdf8ec0c'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:49:00 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-10a689a4-b887-4989-a54f-4b6f9119ca5a tempest-AttachVolumeNegativeTest-1827868215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:49:00 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-10a689a4-b887-4989-a54f-4b6f9119ca5a tempest-AttachVolumeNegativeTest-1827868215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:49:00 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-10a689a4-b887-4989-a54f-4b6f9119ca5a tempest-AttachVolumeNegativeTest-1827868215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:49:00 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-10a689a4-b887-4989-a54f-4b6f9119ca5a tempest-AttachVolumeNegativeTest-1827868215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:49:00 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-10a689a4-b887-4989-a54f-4b6f9119ca5a tempest-AttachVolumeNegativeTest-1827868215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:49:00 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-10a689a4-b887-4989-a54f-4b6f9119ca5a tempest-AttachVolumeNegativeTest-1827868215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:49:00 devstack sudo[102904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:49:00 devstack sudo[102904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:49:00 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-f623f527-8814-4e16-ab05-0b6a541b7547 tempest-AttachVolumeNegativeTest-1827868215 None] Acquiring lock "cinder-c8e00ae9-6aeb-41a1-95b9-32e0a13f5fe0-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:49:01 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-f623f527-8814-4e16-ab05-0b6a541b7547 tempest-AttachVolumeNegativeTest-1827868215 None] Lock "cinder-c8e00ae9-6aeb-41a1-95b9-32e0a13f5fe0-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:49:01 devstack sudo[102904]: pam_unix(sudo:session): session closed for user root Jun 17 05:49:01 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-10a689a4-b887-4989-a54f-4b6f9119ca5a tempest-AttachVolumeNegativeTest-1827868215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.868s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:49:01 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-10a689a4-b887-4989-a54f-4b6f9119ca5a tempest-AttachVolumeNegativeTest-1827868215 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:49:01 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-f623f527-8814-4e16-ab05-0b6a541b7547 tempest-AttachVolumeNegativeTest-1827868215 None] Acquiring lock "cinder-quobyte-c8e00ae9-6aeb-41a1-95b9-32e0a13f5fe0" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:49:01 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-10a689a4-b887-4989-a54f-4b6f9119ca5a tempest-AttachVolumeNegativeTest-1827868215 None] Deleted volume successfully. Jun 17 05:49:01 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-f623f527-8814-4e16-ab05-0b6a541b7547 tempest-AttachVolumeNegativeTest-1827868215 None] Lock "cinder-quobyte-c8e00ae9-6aeb-41a1-95b9-32e0a13f5fe0" acquired by "delete_volume" :: waited 0.041s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:49:01 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-10a689a4-b887-4989-a54f-4b6f9119ca5a tempest-AttachVolumeNegativeTest-1827868215 None] Lock "cinder-691f577d-bf47-4514-9d79-a645dfdf75a3-delete_volume" released by "delete_volume" :: held 2.579s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:49:01 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a6e212-fd0b-486f-a029-eb24ad5c99c7]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:49:01 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f623f527-8814-4e16-ab05-0b6a541b7547 tempest-AttachVolumeNegativeTest-1827868215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c8e00ae9-6aeb-41a1-95b9-32e0a13f5fe0 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:49:01 devstack sudo[102907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c8e00ae9-6aeb-41a1-95b9-32e0a13f5fe0 Jun 17 05:49:01 devstack sudo[102907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:49:02 devstack sudo[102907]: pam_unix(sudo:session): session closed for user root Jun 17 05:49:02 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f623f527-8814-4e16-ab05-0b6a541b7547 tempest-AttachVolumeNegativeTest-1827868215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c8e00ae9-6aeb-41a1-95b9-32e0a13f5fe0" returned: 0 in 1.457s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:49:02 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f623f527-8814-4e16-ab05-0b6a541b7547 tempest-AttachVolumeNegativeTest-1827868215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c8e00ae9-6aeb-41a1-95b9-32e0a13f5fe0 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:49:02 devstack sudo[102988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c8e00ae9-6aeb-41a1-95b9-32e0a13f5fe0 Jun 17 05:49:02 devstack sudo[102988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:49:03 devstack sudo[102988]: pam_unix(sudo:session): session closed for user root Jun 17 05:49:03 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f623f527-8814-4e16-ab05-0b6a541b7547 tempest-AttachVolumeNegativeTest-1827868215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c8e00ae9-6aeb-41a1-95b9-32e0a13f5fe0" returned: 0 in 0.865s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:49:03 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-f623f527-8814-4e16-ab05-0b6a541b7547 tempest-AttachVolumeNegativeTest-1827868215 None] Lock "cinder-quobyte-c8e00ae9-6aeb-41a1-95b9-32e0a13f5fe0" released by "delete_volume" :: held 2.386s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:49:03 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-f623f527-8814-4e16-ab05-0b6a541b7547 tempest-AttachVolumeNegativeTest-1827868215 None] Created reservations ['5be71ad6-565d-4aef-87f9-3264633f544b', 'e2f50116-4a55-49fa-b680-9bffbce7adbb', '1ec053da-74d9-4fb6-ac9b-1284619bfecf', 'bb59fa9d-ffc6-4fea-8dde-32a7949b969d'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:49:03 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-f623f527-8814-4e16-ab05-0b6a541b7547 tempest-AttachVolumeNegativeTest-1827868215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:49:03 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-f623f527-8814-4e16-ab05-0b6a541b7547 tempest-AttachVolumeNegativeTest-1827868215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:49:03 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-f623f527-8814-4e16-ab05-0b6a541b7547 tempest-AttachVolumeNegativeTest-1827868215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:49:03 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-f623f527-8814-4e16-ab05-0b6a541b7547 tempest-AttachVolumeNegativeTest-1827868215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:49:03 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-f623f527-8814-4e16-ab05-0b6a541b7547 tempest-AttachVolumeNegativeTest-1827868215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:49:03 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f623f527-8814-4e16-ab05-0b6a541b7547 tempest-AttachVolumeNegativeTest-1827868215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:49:03 devstack sudo[102997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:49:03 devstack sudo[102997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:49:05 devstack sudo[102997]: pam_unix(sudo:session): session closed for user root Jun 17 05:49:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f623f527-8814-4e16-ab05-0b6a541b7547 tempest-AttachVolumeNegativeTest-1827868215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 1.269s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:49:05 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-f623f527-8814-4e16-ab05-0b6a541b7547 tempest-AttachVolumeNegativeTest-1827868215 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:49:05 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-f623f527-8814-4e16-ab05-0b6a541b7547 tempest-AttachVolumeNegativeTest-1827868215 None] Deleted volume successfully. Jun 17 05:49:05 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-28d745ee-7e01-4499-8d09-40a6be05beda tempest-AttachVolumeNegativeTest-1827868215 None] Acquiring lock "cinder-f60c0803-95ae-4048-9840-c45bbe383601-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:49:05 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-f623f527-8814-4e16-ab05-0b6a541b7547 tempest-AttachVolumeNegativeTest-1827868215 None] Lock "cinder-c8e00ae9-6aeb-41a1-95b9-32e0a13f5fe0-delete_volume" released by "delete_volume" :: held 4.068s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:49:05 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-28d745ee-7e01-4499-8d09-40a6be05beda tempest-AttachVolumeNegativeTest-1827868215 None] Lock "cinder-f60c0803-95ae-4048-9840-c45bbe383601-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:49:05 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-28d745ee-7e01-4499-8d09-40a6be05beda tempest-AttachVolumeNegativeTest-1827868215 None] Acquiring lock "cinder-quobyte-f60c0803-95ae-4048-9840-c45bbe383601" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:49:05 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-28d745ee-7e01-4499-8d09-40a6be05beda tempest-AttachVolumeNegativeTest-1827868215 None] Lock "cinder-quobyte-f60c0803-95ae-4048-9840-c45bbe383601" acquired by "delete_volume" :: waited 0.026s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:49:05 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c2c51d-1544-4ca5-9a18-51bc4b5f0232]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:49:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-28d745ee-7e01-4499-8d09-40a6be05beda tempest-AttachVolumeNegativeTest-1827868215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f60c0803-95ae-4048-9840-c45bbe383601 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:49:05 devstack sudo[103000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f60c0803-95ae-4048-9840-c45bbe383601 Jun 17 05:49:05 devstack sudo[103000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:49:06 devstack sudo[103000]: pam_unix(sudo:session): session closed for user root Jun 17 05:49:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-28d745ee-7e01-4499-8d09-40a6be05beda tempest-AttachVolumeNegativeTest-1827868215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f60c0803-95ae-4048-9840-c45bbe383601" returned: 0 in 1.221s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:49:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-28d745ee-7e01-4499-8d09-40a6be05beda tempest-AttachVolumeNegativeTest-1827868215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f60c0803-95ae-4048-9840-c45bbe383601 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:49:06 devstack sudo[103011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f60c0803-95ae-4048-9840-c45bbe383601 Jun 17 05:49:06 devstack sudo[103011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:49:07 devstack sudo[103011]: pam_unix(sudo:session): session closed for user root Jun 17 05:49:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-28d745ee-7e01-4499-8d09-40a6be05beda tempest-AttachVolumeNegativeTest-1827868215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f60c0803-95ae-4048-9840-c45bbe383601" returned: 0 in 1.368s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:49:07 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-28d745ee-7e01-4499-8d09-40a6be05beda tempest-AttachVolumeNegativeTest-1827868215 None] Lock "cinder-quobyte-f60c0803-95ae-4048-9840-c45bbe383601" released by "delete_volume" :: held 2.675s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:49:07 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-28d745ee-7e01-4499-8d09-40a6be05beda tempest-AttachVolumeNegativeTest-1827868215 None] Created reservations ['5654efcd-fd42-4afc-bc89-82ccf1d53e18', '81f5f70e-5b67-4d78-aeae-d009c1edcdb0', 'b84d37c4-92de-4312-9870-176b8e51c39d', 'b1e1e178-2cf1-489a-ba55-a2be91f14fc1'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:49:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-28d745ee-7e01-4499-8d09-40a6be05beda tempest-AttachVolumeNegativeTest-1827868215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:49:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-28d745ee-7e01-4499-8d09-40a6be05beda tempest-AttachVolumeNegativeTest-1827868215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:49:08 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-28d745ee-7e01-4499-8d09-40a6be05beda tempest-AttachVolumeNegativeTest-1827868215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:49:08 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-28d745ee-7e01-4499-8d09-40a6be05beda tempest-AttachVolumeNegativeTest-1827868215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:49:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-28d745ee-7e01-4499-8d09-40a6be05beda tempest-AttachVolumeNegativeTest-1827868215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:49:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-28d745ee-7e01-4499-8d09-40a6be05beda tempest-AttachVolumeNegativeTest-1827868215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:49:08 devstack sudo[103066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:49:08 devstack sudo[103066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:49:09 devstack sudo[103066]: pam_unix(sudo:session): session closed for user root Jun 17 05:49:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-28d745ee-7e01-4499-8d09-40a6be05beda tempest-AttachVolumeNegativeTest-1827868215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 1.290s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:49:09 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-28d745ee-7e01-4499-8d09-40a6be05beda tempest-AttachVolumeNegativeTest-1827868215 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:49:09 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-28d745ee-7e01-4499-8d09-40a6be05beda tempest-AttachVolumeNegativeTest-1827868215 None] Deleted volume successfully. Jun 17 05:49:09 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-28d745ee-7e01-4499-8d09-40a6be05beda tempest-AttachVolumeNegativeTest-1827868215 None] Lock "cinder-f60c0803-95ae-4048-9840-c45bbe383601-delete_volume" released by "delete_volume" :: held 4.494s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:49:09 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-5822ed42-0ab3-47cc-8e02-6f27e56155c1 tempest-TestMinimumBasicScenario-1217357225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:49:09 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-5822ed42-0ab3-47cc-8e02-6f27e56155c1 tempest-TestMinimumBasicScenario-1217357225 None] Flow 'volume_create_manager' (246c3efd-0e77-43c7-a395-1eab4baed818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:49:09 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-5822ed42-0ab3-47cc-8e02-6f27e56155c1 tempest-TestMinimumBasicScenario-1217357225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c887e5ea-d4a9-4cf9-8e01-012785a3256b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:49:10 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-5822ed42-0ab3-47cc-8e02-6f27e56155c1 tempest-TestMinimumBasicScenario-1217357225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c887e5ea-d4a9-4cf9-8e01-012785a3256b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:49:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1527946225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d586246-8205-40da-bbac-c3c9d8d3dd73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93dd454761f148fa8e15b80552dc2fdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:49:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:49:10Z,use_quota=True,user_id='eaf6878e97e94e7589301b34bbaa39e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:49:10 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-5822ed42-0ab3-47cc-8e02-6f27e56155c1 tempest-TestMinimumBasicScenario-1217357225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9bb7456-eded-46c7-b558-6243b504df34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:49:10 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-5822ed42-0ab3-47cc-8e02-6f27e56155c1 tempest-TestMinimumBasicScenario-1217357225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9bb7456-eded-46c7-b558-6243b504df34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:49:10 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-5822ed42-0ab3-47cc-8e02-6f27e56155c1 tempest-TestMinimumBasicScenario-1217357225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0f3105d-f3e2-466c-bb4b-bd564e547b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:49:10 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-5822ed42-0ab3-47cc-8e02-6f27e56155c1 tempest-TestMinimumBasicScenario-1217357225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0f3105d-f3e2-466c-bb4b-bd564e547b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d586246-8205-40da-bbac-c3c9d8d3dd73', 'volume_name': 'volume-1d586246-8205-40da-bbac-c3c9d8d3dd73', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:49:10 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-5822ed42-0ab3-47cc-8e02-6f27e56155c1 tempest-TestMinimumBasicScenario-1217357225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c9f67b9-9665-4262-ae23-daa8727f4946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:49:10 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-5822ed42-0ab3-47cc-8e02-6f27e56155c1 tempest-TestMinimumBasicScenario-1217357225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c9f67b9-9665-4262-ae23-daa8727f4946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:49:10 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-5822ed42-0ab3-47cc-8e02-6f27e56155c1 tempest-TestMinimumBasicScenario-1217357225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (730b9e24-7bb5-47ba-ac16-a0b4ecb2e0d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:49:10 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-5822ed42-0ab3-47cc-8e02-6f27e56155c1 tempest-TestMinimumBasicScenario-1217357225 None] Volume 1d586246-8205-40da-bbac-c3c9d8d3dd73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d586246-8205-40da-bbac-c3c9d8d3dd73', 'volume_size': 1} Jun 17 05:49:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-5822ed42-0ab3-47cc-8e02-6f27e56155c1 tempest-TestMinimumBasicScenario-1217357225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:49:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-5822ed42-0ab3-47cc-8e02-6f27e56155c1 tempest-TestMinimumBasicScenario-1217357225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:49:10 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-5822ed42-0ab3-47cc-8e02-6f27e56155c1 tempest-TestMinimumBasicScenario-1217357225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:49:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1527946225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d586246-8205-40da-bbac-c3c9d8d3dd73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93dd454761f148fa8e15b80552dc2fdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:49:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:49:10Z,use_quota=True,user_id='eaf6878e97e94e7589301b34bbaa39e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:49:10 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-5822ed42-0ab3-47cc-8e02-6f27e56155c1 tempest-TestMinimumBasicScenario-1217357225 None] Creating volume 1d586246-8205-40da-bbac-c3c9d8d3dd73 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:49:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-5822ed42-0ab3-47cc-8e02-6f27e56155c1 tempest-TestMinimumBasicScenario-1217357225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:49:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-5822ed42-0ab3-47cc-8e02-6f27e56155c1 tempest-TestMinimumBasicScenario-1217357225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:49:10 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-5822ed42-0ab3-47cc-8e02-6f27e56155c1 tempest-TestMinimumBasicScenario-1217357225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:49:10 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-5822ed42-0ab3-47cc-8e02-6f27e56155c1 tempest-TestMinimumBasicScenario-1217357225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:49:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-5822ed42-0ab3-47cc-8e02-6f27e56155c1 tempest-TestMinimumBasicScenario-1217357225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:49:10 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-5822ed42-0ab3-47cc-8e02-6f27e56155c1 tempest-TestMinimumBasicScenario-1217357225 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:49:10 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-5822ed42-0ab3-47cc-8e02-6f27e56155c1 tempest-TestMinimumBasicScenario-1217357225 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:49:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-5822ed42-0ab3-47cc-8e02-6f27e56155c1 tempest-TestMinimumBasicScenario-1217357225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1d586246-8205-40da-bbac-c3c9d8d3dd73 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:49:10 devstack sudo[103084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1d586246-8205-40da-bbac-c3c9d8d3dd73 1073741824 Jun 17 05:49:10 devstack sudo[103084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:49:11 devstack sudo[103084]: pam_unix(sudo:session): session closed for user root Jun 17 05:49:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-5822ed42-0ab3-47cc-8e02-6f27e56155c1 tempest-TestMinimumBasicScenario-1217357225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1d586246-8205-40da-bbac-c3c9d8d3dd73 1073741824" returned: 0 in 1.634s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:49:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-5822ed42-0ab3-47cc-8e02-6f27e56155c1 tempest-TestMinimumBasicScenario-1217357225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1d586246-8205-40da-bbac-c3c9d8d3dd73 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:49:11 devstack sudo[103090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1d586246-8205-40da-bbac-c3c9d8d3dd73 Jun 17 05:49:11 devstack sudo[103090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:49:13 devstack sudo[103090]: pam_unix(sudo:session): session closed for user root Jun 17 05:49:13 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-5822ed42-0ab3-47cc-8e02-6f27e56155c1 tempest-TestMinimumBasicScenario-1217357225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1d586246-8205-40da-bbac-c3c9d8d3dd73" returned: 0 in 1.255s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:49:13 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-5822ed42-0ab3-47cc-8e02-6f27e56155c1 tempest-TestMinimumBasicScenario-1217357225 None] <== create_volume: return (2978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:49:13 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-5822ed42-0ab3-47cc-8e02-6f27e56155c1 tempest-TestMinimumBasicScenario-1217357225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.988s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:49:13 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-5822ed42-0ab3-47cc-8e02-6f27e56155c1 tempest-TestMinimumBasicScenario-1217357225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (730b9e24-7bb5-47ba-ac16-a0b4ecb2e0d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d586246-8205-40da-bbac-c3c9d8d3dd73', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:49:13 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-5822ed42-0ab3-47cc-8e02-6f27e56155c1 tempest-TestMinimumBasicScenario-1217357225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e421574a-0980-422a-a643-192c44860236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:49:13 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-5822ed42-0ab3-47cc-8e02-6f27e56155c1 tempest-TestMinimumBasicScenario-1217357225 None] Volume volume-1d586246-8205-40da-bbac-c3c9d8d3dd73 (1d586246-8205-40da-bbac-c3c9d8d3dd73): created successfully Jun 17 05:49:13 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-5822ed42-0ab3-47cc-8e02-6f27e56155c1 tempest-TestMinimumBasicScenario-1217357225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e421574a-0980-422a-a643-192c44860236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:49:13 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-5822ed42-0ab3-47cc-8e02-6f27e56155c1 tempest-TestMinimumBasicScenario-1217357225 None] Flow 'volume_create_manager' (246c3efd-0e77-43c7-a395-1eab4baed818) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:49:13 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-5822ed42-0ab3-47cc-8e02-6f27e56155c1 tempest-TestMinimumBasicScenario-1217357225 None] Created volume successfully. Jun 17 05:49:16 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-eb09dbeb-15ea-4f09-8ada-a2e2cd682537 tempest-VolumesActionsTest-569015156 None] Acquiring lock "cinder-66775b65-c6d3-49ea-88d5-f86739e679d0" by "attach_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:49:16 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-eb09dbeb-15ea-4f09-8ada-a2e2cd682537 tempest-VolumesActionsTest-569015156 None] Lock "cinder-66775b65-c6d3-49ea-88d5-f86739e679d0" acquired by "attach_volume" :: waited 0.041s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:49:16 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-eb09dbeb-15ea-4f09-8ada-a2e2cd682537 tempest-VolumesActionsTest-569015156 None] Attaching volume 66775b65-c6d3-49ea-88d5-f86739e679d0 to instance a4dbe37f-3661-4eb5-ac2b-8ee45f99e917 at mountpoint /dev/vdb on host None. Jun 17 05:49:16 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-eb09dbeb-15ea-4f09-8ada-a2e2cd682537 tempest-VolumesActionsTest-569015156 None] Attach volume completed successfully. Jun 17 05:49:16 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-eb09dbeb-15ea-4f09-8ada-a2e2cd682537 tempest-VolumesActionsTest-569015156 None] Lock "cinder-66775b65-c6d3-49ea-88d5-f86739e679d0" released by "attach_volume" :: held 0.235s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:49:17 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-8627cf25-e2bf-4713-af31-49b009f6a1fa tempest-VolumesActionsTest-569015156 None] Acquiring lock "cinder-66775b65-c6d3-49ea-88d5-f86739e679d0-detach_volume" by "detach_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:49:17 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-8627cf25-e2bf-4713-af31-49b009f6a1fa tempest-VolumesActionsTest-569015156 None] Lock "cinder-66775b65-c6d3-49ea-88d5-f86739e679d0-detach_volume" acquired by "detach_volume" :: waited 0.064s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:49:17 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-8627cf25-e2bf-4713-af31-49b009f6a1fa tempest-VolumesActionsTest-569015156 None] Detaching volume 66775b65-c6d3-49ea-88d5-f86739e679d0 from instance a4dbe37f-3661-4eb5-ac2b-8ee45f99e917. Jun 17 05:49:17 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-8627cf25-e2bf-4713-af31-49b009f6a1fa tempest-VolumesActionsTest-569015156 None] Detach volume completed successfully. Jun 17 05:49:17 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-8627cf25-e2bf-4713-af31-49b009f6a1fa tempest-VolumesActionsTest-569015156 None] Lock "cinder-66775b65-c6d3-49ea-88d5-f86739e679d0-detach_volume" released by "detach_volume" :: held 0.179s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:49:18 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-66ac75bb-60e4-4e23-b9f6-b57f4c9cb183 req-d5437c1d-d821-4f15-b770-cfc053122e92 tempest-TestMinimumBasicScenario-1217357225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:49:18 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-66ac75bb-60e4-4e23-b9f6-b57f4c9cb183 req-d5437c1d-d821-4f15-b770-cfc053122e92 tempest-TestMinimumBasicScenario-1217357225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:49:18 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d8f2f7-777e-4b2c-8713-73a2deb2e793]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:49:18 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-66ac75bb-60e4-4e23-b9f6-b57f4c9cb183 req-d5437c1d-d821-4f15-b770-cfc053122e92 tempest-TestMinimumBasicScenario-1217357225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1d586246-8205-40da-bbac-c3c9d8d3dd73 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:49:18 devstack sudo[103143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1d586246-8205-40da-bbac-c3c9d8d3dd73 Jun 17 05:49:18 devstack sudo[103143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:49:19 devstack sudo[103143]: pam_unix(sudo:session): session closed for user root Jun 17 05:49:19 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-66ac75bb-60e4-4e23-b9f6-b57f4c9cb183 req-d5437c1d-d821-4f15-b770-cfc053122e92 tempest-TestMinimumBasicScenario-1217357225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1d586246-8205-40da-bbac-c3c9d8d3dd73" returned: 0 in 1.206s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:49:19 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-66ac75bb-60e4-4e23-b9f6-b57f4c9cb183 req-d5437c1d-d821-4f15-b770-cfc053122e92 tempest-TestMinimumBasicScenario-1217357225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.236s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:49:19 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [req-66ac75bb-60e4-4e23-b9f6-b57f4c9cb183 req-d5437c1d-d821-4f15-b770-cfc053122e92 tempest-TestMinimumBasicScenario-1217357225 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f', 'name': 'volume-1d586246-8205-40da-bbac-c3c9d8d3dd73', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e6c95d12-befd-4189-86ca-ca90d297c7b8', 'enforce_multipath': True} {{(pid=92083) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 17 05:49:19 devstack cinder-volume[92083]: INFO cinder.volume.manager [req-66ac75bb-60e4-4e23-b9f6-b57f4c9cb183 req-d5437c1d-d821-4f15-b770-cfc053122e92 tempest-TestMinimumBasicScenario-1217357225 None] attachment_update completed successfully. Jun 17 05:49:23 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-30fa8e33-6310-45b2-a7ea-341be074c4a0 tempest-BackendsCapabilitiesAdminTestsJSON-385545353 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7578506469727, 'free_capacity_gb': 1775.7578506469727, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=92083) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jun 17 05:49:23 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e4e10565-8f56-4480-bc85-4ea26eaf7f37 tempest-BackendsCapabilitiesAdminTestsJSON-385545353 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7578506469727, 'free_capacity_gb': 1775.7578506469727, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=92083) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jun 17 05:49:26 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-1cec0a16-63da-4cf1-8ca3-0c84a8795a85 tempest-VolumesActionsTest-569015156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:49:26 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-1cec0a16-63da-4cf1-8ca3-0c84a8795a85 tempest-VolumesActionsTest-569015156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:49:26 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[368a2fb9-89c2-47df-8d87-51b90a58fcda]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:49:26 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1cec0a16-63da-4cf1-8ca3-0c84a8795a85 tempest-VolumesActionsTest-569015156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-66775b65-c6d3-49ea-88d5-f86739e679d0 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:49:26 devstack sudo[103575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-66775b65-c6d3-49ea-88d5-f86739e679d0 Jun 17 05:49:26 devstack sudo[103575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:49:27 devstack cinder-volume[92083]: DEBUG oslo_service.periodic_task [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92083) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 05:49:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:49:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:49:27 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:49:27 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:49:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:49:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:49:27 devstack sudo[103589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:49:27 devstack sudo[103589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:49:27 devstack sudo[103575]: pam_unix(sudo:session): session closed for user root Jun 17 05:49:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1cec0a16-63da-4cf1-8ca3-0c84a8795a85 tempest-VolumesActionsTest-569015156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-66775b65-c6d3-49ea-88d5-f86739e679d0" returned: 0 in 1.177s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:49:27 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ccfc6e-c0b4-4b17-ae79-c855e4db71fa]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:49:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1cec0a16-63da-4cf1-8ca3-0c84a8795a85 tempest-VolumesActionsTest-569015156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-66775b65-c6d3-49ea-88d5-f86739e679d0 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:49:28 devstack sudo[103616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-66775b65-c6d3-49ea-88d5-f86739e679d0 Jun 17 05:49:28 devstack sudo[103616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:49:28 devstack sudo[103589]: pam_unix(sudo:session): session closed for user root Jun 17 05:49:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 1.031s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:49:28 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:49:28 devstack cinder-volume[92083]: DEBUG oslo_service.periodic_task [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running periodic task VolumeManager._thread_info {{(pid=92083) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 05:49:28 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] thread count: 28 {{(pid=92083) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 17 05:49:28 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] thread info: [<_MainThread(MainThread, started 133483869905024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92083) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 17 05:49:29 devstack sudo[103616]: pam_unix(sudo:session): session closed for user root Jun 17 05:49:29 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1cec0a16-63da-4cf1-8ca3-0c84a8795a85 tempest-VolumesActionsTest-569015156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-66775b65-c6d3-49ea-88d5-f86739e679d0" returned: 0 in 1.292s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:49:29 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1cec0a16-63da-4cf1-8ca3-0c84a8795a85 tempest-VolumesActionsTest-569015156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-66775b65-c6d3-49ea-88d5-f86739e679d0 /opt/stack/data/cinder/conversion/66775b65-c6d3-49ea-88d5-f86739e679d0.temp_image.12c953ea-da11-4168-bd38-bcd3743b9790k4sy7etq.img {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:49:29 devstack sudo[103626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-66775b65-c6d3-49ea-88d5-f86739e679d0 /opt/stack/data/cinder/conversion/66775b65-c6d3-49ea-88d5-f86739e679d0.temp_image.12c953ea-da11-4168-bd38-bcd3743b9790k4sy7etq.img Jun 17 05:49:29 devstack sudo[103626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:49:29 devstack cinder-volume[92083]: DEBUG dbcounter [-] [92083] Writing DB stats cinder:UPDATE=58,cinder:SELECT=53,cinder:DELETE=4,cinder:INSERT=12 {{(pid=92083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:49:31 devstack cinder-volume[92083]: DEBUG dbcounter [-] [92083] Writing DB stats cinder:SELECT=65,cinder:UPDATE=46,cinder:INSERT=11,cinder:DELETE=3 {{(pid=92083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:49:31 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-e45805a2-4107-4276-aab8-8d6e20ccc9e4 tempest-GroupSnapshotsV319Test-926347175 None] Group tempest-GroupSnapshotsV319Test-Group-1600214528: creating Jun 17 05:49:31 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-e45805a2-4107-4276-aab8-8d6e20ccc9e4 tempest-GroupSnapshotsV319Test-926347175 None] Group tempest-GroupSnapshotsV319Test-Group-1600214528: created successfully Jun 17 05:49:31 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-e45805a2-4107-4276-aab8-8d6e20ccc9e4 tempest-GroupSnapshotsV319Test-926347175 None] Create group completed successfully. Jun 17 05:49:33 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-e24e6558-e959-4ff8-b318-b65c25eacea6 tempest-GroupSnapshotsV319Test-926347175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:49:33 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e24e6558-e959-4ff8-b318-b65c25eacea6 tempest-GroupSnapshotsV319Test-926347175 None] Flow 'volume_create_manager' (02650940-8c69-40c5-ad94-12e161a3a773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:49:33 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e24e6558-e959-4ff8-b318-b65c25eacea6 tempest-GroupSnapshotsV319Test-926347175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ee9b32a-4773-4028-b64f-d424189ffb47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:49:33 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e24e6558-e959-4ff8-b318-b65c25eacea6 tempest-GroupSnapshotsV319Test-926347175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ee9b32a-4773-4028-b64f-d424189ffb47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:49:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1173080257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=80955291-a54d-42c8-affd-614ecb2a2305,host='devstack@QuobyteHD#QuobyteHD',id=c8faf26c-7543-405b-baf7-5d2fc666f334,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24764b0d7d2e4a288c721256fa3139e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:49:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:49:34Z,use_quota=True,user_id='9b3e817442da441f97270c7f617a54f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e5d30c3-d20c-4ed5-ad99-2d563d2d353c),volume_type_id=3e5d30c3-d20c-4ed5-ad99-2d563d2d353c)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:49:34 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e24e6558-e959-4ff8-b318-b65c25eacea6 tempest-GroupSnapshotsV319Test-926347175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58c891a5-7c9c-408d-b321-5c58fb851ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:49:34 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e24e6558-e959-4ff8-b318-b65c25eacea6 tempest-GroupSnapshotsV319Test-926347175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58c891a5-7c9c-408d-b321-5c58fb851ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:49:34 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e24e6558-e959-4ff8-b318-b65c25eacea6 tempest-GroupSnapshotsV319Test-926347175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df23457b-07cd-41a5-ad32-c8a468591840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:49:34 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e24e6558-e959-4ff8-b318-b65c25eacea6 tempest-GroupSnapshotsV319Test-926347175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df23457b-07cd-41a5-ad32-c8a468591840) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8faf26c-7543-405b-baf7-5d2fc666f334', 'volume_name': 'volume-c8faf26c-7543-405b-baf7-5d2fc666f334', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:49:34 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e24e6558-e959-4ff8-b318-b65c25eacea6 tempest-GroupSnapshotsV319Test-926347175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afe8790c-8bd3-4388-afa1-b56f6798b311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:49:34 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e24e6558-e959-4ff8-b318-b65c25eacea6 tempest-GroupSnapshotsV319Test-926347175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afe8790c-8bd3-4388-afa1-b56f6798b311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:49:34 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e24e6558-e959-4ff8-b318-b65c25eacea6 tempest-GroupSnapshotsV319Test-926347175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6141d2a4-9b8f-4a54-a856-9ecf5c3400d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:49:34 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-e24e6558-e959-4ff8-b318-b65c25eacea6 tempest-GroupSnapshotsV319Test-926347175 None] Volume c8faf26c-7543-405b-baf7-5d2fc666f334: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8faf26c-7543-405b-baf7-5d2fc666f334', 'volume_size': 1} Jun 17 05:49:34 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e24e6558-e959-4ff8-b318-b65c25eacea6 tempest-GroupSnapshotsV319Test-926347175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:49:36 devstack sudo[103626]: pam_unix(sudo:session): session closed for user root Jun 17 05:49:36 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1cec0a16-63da-4cf1-8ca3-0c84a8795a85 tempest-VolumesActionsTest-569015156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-66775b65-c6d3-49ea-88d5-f86739e679d0 /opt/stack/data/cinder/conversion/66775b65-c6d3-49ea-88d5-f86739e679d0.temp_image.12c953ea-da11-4168-bd38-bcd3743b9790k4sy7etq.img" returned: 0 in 6.748s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:49:36 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e97875-1a8e-47e5-a1ca-57b0061032d0]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:49:36 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1cec0a16-63da-4cf1-8ca3-0c84a8795a85 tempest-VolumesActionsTest-569015156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-66775b65-c6d3-49ea-88d5-f86739e679d0 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:49:36 devstack sudo[103644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-66775b65-c6d3-49ea-88d5-f86739e679d0 Jun 17 05:49:36 devstack sudo[103644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:49:37 devstack sudo[103644]: pam_unix(sudo:session): session closed for user root Jun 17 05:49:37 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1cec0a16-63da-4cf1-8ca3-0c84a8795a85 tempest-VolumesActionsTest-569015156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-66775b65-c6d3-49ea-88d5-f86739e679d0" returned: 0 in 1.039s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:49:37 devstack cinder-volume[92083]: DEBUG cinder.image.image_utils [None req-1cec0a16-63da-4cf1-8ca3-0c84a8795a85 tempest-VolumesActionsTest-569015156 None] Image conversion details: src /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-66775b65-c6d3-49ea-88d5-f86739e679d0, size 1024.00 MB, duration 6.75 sec, destination /opt/stack/data/cinder/conversion/66775b65-c6d3-49ea-88d5-f86739e679d0.temp_image.12c953ea-da11-4168-bd38-bcd3743b9790k4sy7etq.img {{(pid=92083) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 17 05:49:37 devstack cinder-volume[92083]: INFO cinder.image.image_utils [None req-1cec0a16-63da-4cf1-8ca3-0c84a8795a85 tempest-VolumesActionsTest-569015156 None] Converted 1024.00 MB image at 151.73 MB/s Jun 17 05:49:37 devstack cinder-volume[92083]: DEBUG cinder.image.image_utils [None req-1cec0a16-63da-4cf1-8ca3-0c84a8795a85 tempest-VolumesActionsTest-569015156 None] 12c953ea-da11-4168-bd38-bcd3743b9790 was raw, no need to convert to raw {{(pid=92083) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jun 17 05:49:47 devstack cinder-volume[92083]: DEBUG dbcounter [-] [92083] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2 {{(pid=92083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:49:47 devstack cinder-volume[92083]: DEBUG dbcounter [-] [92083] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=92083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:49:58 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa0e0927-e464-4245-8537-2a619d6fde37 tempest-TestServerVolumeAttachmentScenario-875878610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:49:58 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-aa0e0927-e464-4245-8537-2a619d6fde37 tempest-TestServerVolumeAttachmentScenario-875878610 None] Flow 'volume_create_manager' (1ede3ce1-2fff-480b-930a-793a9b276241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:49:58 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-aa0e0927-e464-4245-8537-2a619d6fde37 tempest-TestServerVolumeAttachmentScenario-875878610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (359ab70a-323e-42f3-a35e-9c4f907d5ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:49:58 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-aa0e0927-e464-4245-8537-2a619d6fde37 tempest-TestServerVolumeAttachmentScenario-875878610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (359ab70a-323e-42f3-a35e-9c4f907d5ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:49:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-806986259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa25d0a5-e5bb-4bce-a035-5989951230bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92b445c999324f8bb85d4a9582b500cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:49:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:49:58Z,use_quota=True,user_id='4a38c8fbdc19496f8e4a58172e8b3a74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:49:58 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-aa0e0927-e464-4245-8537-2a619d6fde37 tempest-TestServerVolumeAttachmentScenario-875878610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66d8bc1a-34a2-496d-b0c7-3cdb21377b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:49:58 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-aa0e0927-e464-4245-8537-2a619d6fde37 tempest-TestServerVolumeAttachmentScenario-875878610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66d8bc1a-34a2-496d-b0c7-3cdb21377b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:49:58 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-aa0e0927-e464-4245-8537-2a619d6fde37 tempest-TestServerVolumeAttachmentScenario-875878610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dd4671a-9be4-47b1-a318-02e440bc36b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:49:58 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-aa0e0927-e464-4245-8537-2a619d6fde37 tempest-TestServerVolumeAttachmentScenario-875878610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dd4671a-9be4-47b1-a318-02e440bc36b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa25d0a5-e5bb-4bce-a035-5989951230bd', 'volume_name': 'volume-fa25d0a5-e5bb-4bce-a035-5989951230bd', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:49:58 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-aa0e0927-e464-4245-8537-2a619d6fde37 tempest-TestServerVolumeAttachmentScenario-875878610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6db933b7-4e7e-4ebf-af7b-c3725067de15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:49:58 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-aa0e0927-e464-4245-8537-2a619d6fde37 tempest-TestServerVolumeAttachmentScenario-875878610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6db933b7-4e7e-4ebf-af7b-c3725067de15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:49:58 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-aa0e0927-e464-4245-8537-2a619d6fde37 tempest-TestServerVolumeAttachmentScenario-875878610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcaa2672-35c8-46cf-b0d8-cf621082ab13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:49:58 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-aa0e0927-e464-4245-8537-2a619d6fde37 tempest-TestServerVolumeAttachmentScenario-875878610 None] Volume fa25d0a5-e5bb-4bce-a035-5989951230bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa25d0a5-e5bb-4bce-a035-5989951230bd', 'volume_size': 1} Jun 17 05:49:58 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-aa0e0927-e464-4245-8537-2a619d6fde37 tempest-TestServerVolumeAttachmentScenario-875878610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:49:58 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc6f2153-a1cf-49a9-9710-90e3b67691b7 tempest-TestServerVolumeAttachmentScenario-875878610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:49:58 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-cc6f2153-a1cf-49a9-9710-90e3b67691b7 tempest-TestServerVolumeAttachmentScenario-875878610 None] Flow 'volume_create_manager' (b1ca3694-974f-4622-b6c2-be6b36188c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:49:58 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-cc6f2153-a1cf-49a9-9710-90e3b67691b7 tempest-TestServerVolumeAttachmentScenario-875878610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03c07f6b-5656-40c9-93a7-697fa44a01e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:49:58 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-cc6f2153-a1cf-49a9-9710-90e3b67691b7 tempest-TestServerVolumeAttachmentScenario-875878610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03c07f6b-5656-40c9-93a7-697fa44a01e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:49:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1076177977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=519f9e31-8efb-498c-a677-2da62211f5c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92b445c999324f8bb85d4a9582b500cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:49:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:49:59Z,use_quota=True,user_id='4a38c8fbdc19496f8e4a58172e8b3a74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:49:58 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-cc6f2153-a1cf-49a9-9710-90e3b67691b7 tempest-TestServerVolumeAttachmentScenario-875878610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83a3a777-5de8-42ec-a926-381575f02d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:49:58 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-cc6f2153-a1cf-49a9-9710-90e3b67691b7 tempest-TestServerVolumeAttachmentScenario-875878610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83a3a777-5de8-42ec-a926-381575f02d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:49:58 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-cc6f2153-a1cf-49a9-9710-90e3b67691b7 tempest-TestServerVolumeAttachmentScenario-875878610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f28db13-1b1c-4598-8d83-01ae3cd6ce47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:49:59 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-cc6f2153-a1cf-49a9-9710-90e3b67691b7 tempest-TestServerVolumeAttachmentScenario-875878610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f28db13-1b1c-4598-8d83-01ae3cd6ce47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '519f9e31-8efb-498c-a677-2da62211f5c8', 'volume_name': 'volume-519f9e31-8efb-498c-a677-2da62211f5c8', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:49:59 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-cc6f2153-a1cf-49a9-9710-90e3b67691b7 tempest-TestServerVolumeAttachmentScenario-875878610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a21bdcb9-906a-4ec4-823d-5354cb0b2a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:49:59 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-cc6f2153-a1cf-49a9-9710-90e3b67691b7 tempest-TestServerVolumeAttachmentScenario-875878610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a21bdcb9-906a-4ec4-823d-5354cb0b2a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:49:59 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-cc6f2153-a1cf-49a9-9710-90e3b67691b7 tempest-TestServerVolumeAttachmentScenario-875878610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a347811-c4a1-466a-a80f-66560069c345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:49:59 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-cc6f2153-a1cf-49a9-9710-90e3b67691b7 tempest-TestServerVolumeAttachmentScenario-875878610 None] Volume 519f9e31-8efb-498c-a677-2da62211f5c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-519f9e31-8efb-498c-a677-2da62211f5c8', 'volume_size': 1} Jun 17 05:49:59 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-cc6f2153-a1cf-49a9-9710-90e3b67691b7 tempest-TestServerVolumeAttachmentScenario-875878610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:50:03 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-1cec0a16-63da-4cf1-8ca3-0c84a8795a85 tempest-VolumesActionsTest-569015156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 36.537s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:50:03 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1cec0a16-63da-4cf1-8ca3-0c84a8795a85 tempest-VolumesActionsTest-569015156 None] Uploaded volume to glance image-id: 12c953ea-da11-4168-bd38-bcd3743b9790. {{(pid=92083) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jun 17 05:50:03 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e24e6558-e959-4ff8-b318-b65c25eacea6 tempest-GroupSnapshotsV319Test-926347175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 29.093s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:50:03 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-e24e6558-e959-4ff8-b318-b65c25eacea6 tempest-GroupSnapshotsV319Test-926347175 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=80955291-a54d-42c8-affd-614ecb2a2305,created_at=2026-06-17T03:49:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1173080257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=80955291-a54d-42c8-affd-614ecb2a2305,host='devstack@QuobyteHD#QuobyteHD',id=c8faf26c-7543-405b-baf7-5d2fc666f334,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24764b0d7d2e4a288c721256fa3139e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:49:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:49:34Z,use_quota=True,user_id='9b3e817442da441f97270c7f617a54f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e5d30c3-d20c-4ed5-ad99-2d563d2d353c),volume_type_id=3e5d30c3-d20c-4ed5-ad99-2d563d2d353c)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:50:03 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-e24e6558-e959-4ff8-b318-b65c25eacea6 tempest-GroupSnapshotsV319Test-926347175 None] Creating volume c8faf26c-7543-405b-baf7-5d2fc666f334 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:50:03 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e24e6558-e959-4ff8-b318-b65c25eacea6 tempest-GroupSnapshotsV319Test-926347175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:50:03 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e24e6558-e959-4ff8-b318-b65c25eacea6 tempest-GroupSnapshotsV319Test-926347175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:50:03 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-e24e6558-e959-4ff8-b318-b65c25eacea6 tempest-GroupSnapshotsV319Test-926347175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:50:03 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-e24e6558-e959-4ff8-b318-b65c25eacea6 tempest-GroupSnapshotsV319Test-926347175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:50:03 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e24e6558-e959-4ff8-b318-b65c25eacea6 tempest-GroupSnapshotsV319Test-926347175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:50:03 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-e24e6558-e959-4ff8-b318-b65c25eacea6 tempest-GroupSnapshotsV319Test-926347175 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:50:03 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-e24e6558-e959-4ff8-b318-b65c25eacea6 tempest-GroupSnapshotsV319Test-926347175 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:50:03 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e24e6558-e959-4ff8-b318-b65c25eacea6 tempest-GroupSnapshotsV319Test-926347175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c8faf26c-7543-405b-baf7-5d2fc666f334 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:50:03 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-1cec0a16-63da-4cf1-8ca3-0c84a8795a85 tempest-VolumesActionsTest-569015156 None] Copy volume to image completed successfully. Jun 17 05:50:03 devstack sudo[103823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c8faf26c-7543-405b-baf7-5d2fc666f334 1073741824 Jun 17 05:50:03 devstack sudo[103823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:50:04 devstack sudo[103823]: pam_unix(sudo:session): session closed for user root Jun 17 05:50:04 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e24e6558-e959-4ff8-b318-b65c25eacea6 tempest-GroupSnapshotsV319Test-926347175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c8faf26c-7543-405b-baf7-5d2fc666f334 1073741824" returned: 0 in 1.255s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:50:04 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e24e6558-e959-4ff8-b318-b65c25eacea6 tempest-GroupSnapshotsV319Test-926347175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c8faf26c-7543-405b-baf7-5d2fc666f334 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:50:04 devstack sudo[103831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c8faf26c-7543-405b-baf7-5d2fc666f334 Jun 17 05:50:04 devstack sudo[103831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:50:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-71959d53-cfea-403a-9e0b-36c41c9c5ed1 tempest-VolumesActionsTest-569015156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:50:05 devstack sudo[103831]: pam_unix(sudo:session): session closed for user root Jun 17 05:50:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e24e6558-e959-4ff8-b318-b65c25eacea6 tempest-GroupSnapshotsV319Test-926347175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c8faf26c-7543-405b-baf7-5d2fc666f334" returned: 0 in 0.732s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:50:05 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-e24e6558-e959-4ff8-b318-b65c25eacea6 tempest-GroupSnapshotsV319Test-926347175 None] <== create_volume: return (2033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:50:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e24e6558-e959-4ff8-b318-b65c25eacea6 tempest-GroupSnapshotsV319Test-926347175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.036s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:50:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-aa0e0927-e464-4245-8537-2a619d6fde37 tempest-TestServerVolumeAttachmentScenario-875878610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.780s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:50:05 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-aa0e0927-e464-4245-8537-2a619d6fde37 tempest-TestServerVolumeAttachmentScenario-875878610 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:49:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-806986259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa25d0a5-e5bb-4bce-a035-5989951230bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92b445c999324f8bb85d4a9582b500cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:49:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:49:58Z,use_quota=True,user_id='4a38c8fbdc19496f8e4a58172e8b3a74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:50:05 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-aa0e0927-e464-4245-8537-2a619d6fde37 tempest-TestServerVolumeAttachmentScenario-875878610 None] Creating volume fa25d0a5-e5bb-4bce-a035-5989951230bd {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:50:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-aa0e0927-e464-4245-8537-2a619d6fde37 tempest-TestServerVolumeAttachmentScenario-875878610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:50:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-aa0e0927-e464-4245-8537-2a619d6fde37 tempest-TestServerVolumeAttachmentScenario-875878610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:50:05 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-aa0e0927-e464-4245-8537-2a619d6fde37 tempest-TestServerVolumeAttachmentScenario-875878610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:50:05 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-aa0e0927-e464-4245-8537-2a619d6fde37 tempest-TestServerVolumeAttachmentScenario-875878610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:50:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-aa0e0927-e464-4245-8537-2a619d6fde37 tempest-TestServerVolumeAttachmentScenario-875878610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:50:05 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-aa0e0927-e464-4245-8537-2a619d6fde37 tempest-TestServerVolumeAttachmentScenario-875878610 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:50:05 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-aa0e0927-e464-4245-8537-2a619d6fde37 tempest-TestServerVolumeAttachmentScenario-875878610 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:50:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-aa0e0927-e464-4245-8537-2a619d6fde37 tempest-TestServerVolumeAttachmentScenario-875878610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-fa25d0a5-e5bb-4bce-a035-5989951230bd 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:50:05 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e24e6558-e959-4ff8-b318-b65c25eacea6 tempest-GroupSnapshotsV319Test-926347175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6141d2a4-9b8f-4a54-a856-9ecf5c3400d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8faf26c-7543-405b-baf7-5d2fc666f334', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:50:05 devstack sudo[103837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-fa25d0a5-e5bb-4bce-a035-5989951230bd 1073741824 Jun 17 05:50:05 devstack sudo[103837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:50:05 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e24e6558-e959-4ff8-b318-b65c25eacea6 tempest-GroupSnapshotsV319Test-926347175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (249d35bb-62b1-4953-a6ba-2529976c7028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:50:05 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-e24e6558-e959-4ff8-b318-b65c25eacea6 tempest-GroupSnapshotsV319Test-926347175 None] Volume volume-c8faf26c-7543-405b-baf7-5d2fc666f334 (c8faf26c-7543-405b-baf7-5d2fc666f334): created successfully Jun 17 05:50:05 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e24e6558-e959-4ff8-b318-b65c25eacea6 tempest-GroupSnapshotsV319Test-926347175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (249d35bb-62b1-4953-a6ba-2529976c7028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:50:05 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e24e6558-e959-4ff8-b318-b65c25eacea6 tempest-GroupSnapshotsV319Test-926347175 None] Flow 'volume_create_manager' (02650940-8c69-40c5-ad94-12e161a3a773) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:50:05 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-e24e6558-e959-4ff8-b318-b65c25eacea6 tempest-GroupSnapshotsV319Test-926347175 None] Created volume successfully. Jun 17 05:50:06 devstack sudo[103837]: pam_unix(sudo:session): session closed for user root Jun 17 05:50:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-aa0e0927-e464-4245-8537-2a619d6fde37 tempest-TestServerVolumeAttachmentScenario-875878610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-fa25d0a5-e5bb-4bce-a035-5989951230bd 1073741824" returned: 0 in 0.820s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:50:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-aa0e0927-e464-4245-8537-2a619d6fde37 tempest-TestServerVolumeAttachmentScenario-875878610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-fa25d0a5-e5bb-4bce-a035-5989951230bd {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:50:06 devstack sudo[103843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-fa25d0a5-e5bb-4bce-a035-5989951230bd Jun 17 05:50:06 devstack sudo[103843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:50:06 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-c8e315c4-e662-402a-b3bc-1cb2fcaaafc0 tempest-GroupSnapshotsV319Test-926347175 None] GroupSnapshot 4ecc3b70-8adf-4a3c-9f78-0b03c3fac462: creating. Jun 17 05:50:06 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c8e315c4-e662-402a-b3bc-1cb2fcaaafc0 tempest-GroupSnapshotsV319Test-926347175 None] Group snapshot 4ecc3b70-8adf-4a3c-9f78-0b03c3fac462: creating. {{(pid=92083) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 17 05:50:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-c8e315c4-e662-402a-b3bc-1cb2fcaaafc0 tempest-GroupSnapshotsV319Test-926347175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:50:06 devstack sudo[103843]: pam_unix(sudo:session): session closed for user root Jun 17 05:50:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-aa0e0927-e464-4245-8537-2a619d6fde37 tempest-TestServerVolumeAttachmentScenario-875878610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-fa25d0a5-e5bb-4bce-a035-5989951230bd" returned: 0 in 0.703s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:50:06 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-aa0e0927-e464-4245-8537-2a619d6fde37 tempest-TestServerVolumeAttachmentScenario-875878610 None] <== create_volume: return (1560ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:50:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-aa0e0927-e464-4245-8537-2a619d6fde37 tempest-TestServerVolumeAttachmentScenario-875878610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.562s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:50:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-cc6f2153-a1cf-49a9-9710-90e3b67691b7 tempest-TestServerVolumeAttachmentScenario-875878610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.861s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:50:06 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-cc6f2153-a1cf-49a9-9710-90e3b67691b7 tempest-TestServerVolumeAttachmentScenario-875878610 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:49:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1076177977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=519f9e31-8efb-498c-a677-2da62211f5c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92b445c999324f8bb85d4a9582b500cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:49:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:49:59Z,use_quota=True,user_id='4a38c8fbdc19496f8e4a58172e8b3a74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:50:06 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-cc6f2153-a1cf-49a9-9710-90e3b67691b7 tempest-TestServerVolumeAttachmentScenario-875878610 None] Creating volume 519f9e31-8efb-498c-a677-2da62211f5c8 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:50:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-cc6f2153-a1cf-49a9-9710-90e3b67691b7 tempest-TestServerVolumeAttachmentScenario-875878610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:50:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-cc6f2153-a1cf-49a9-9710-90e3b67691b7 tempest-TestServerVolumeAttachmentScenario-875878610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:50:06 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-cc6f2153-a1cf-49a9-9710-90e3b67691b7 tempest-TestServerVolumeAttachmentScenario-875878610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:50:06 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-cc6f2153-a1cf-49a9-9710-90e3b67691b7 tempest-TestServerVolumeAttachmentScenario-875878610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:50:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-cc6f2153-a1cf-49a9-9710-90e3b67691b7 tempest-TestServerVolumeAttachmentScenario-875878610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:50:06 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-cc6f2153-a1cf-49a9-9710-90e3b67691b7 tempest-TestServerVolumeAttachmentScenario-875878610 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:50:06 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-cc6f2153-a1cf-49a9-9710-90e3b67691b7 tempest-TestServerVolumeAttachmentScenario-875878610 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:50:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-cc6f2153-a1cf-49a9-9710-90e3b67691b7 tempest-TestServerVolumeAttachmentScenario-875878610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-519f9e31-8efb-498c-a677-2da62211f5c8 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:50:06 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-aa0e0927-e464-4245-8537-2a619d6fde37 tempest-TestServerVolumeAttachmentScenario-875878610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcaa2672-35c8-46cf-b0d8-cf621082ab13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa25d0a5-e5bb-4bce-a035-5989951230bd', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:50:06 devstack sudo[103846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-519f9e31-8efb-498c-a677-2da62211f5c8 1073741824 Jun 17 05:50:06 devstack sudo[103846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:50:06 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-aa0e0927-e464-4245-8537-2a619d6fde37 tempest-TestServerVolumeAttachmentScenario-875878610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a278eae3-b8ca-4030-b253-76e0049ee786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:50:06 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-aa0e0927-e464-4245-8537-2a619d6fde37 tempest-TestServerVolumeAttachmentScenario-875878610 None] Volume volume-fa25d0a5-e5bb-4bce-a035-5989951230bd (fa25d0a5-e5bb-4bce-a035-5989951230bd): created successfully Jun 17 05:50:06 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-aa0e0927-e464-4245-8537-2a619d6fde37 tempest-TestServerVolumeAttachmentScenario-875878610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a278eae3-b8ca-4030-b253-76e0049ee786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:50:06 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-aa0e0927-e464-4245-8537-2a619d6fde37 tempest-TestServerVolumeAttachmentScenario-875878610 None] Flow 'volume_create_manager' (1ede3ce1-2fff-480b-930a-793a9b276241) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:50:07 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-aa0e0927-e464-4245-8537-2a619d6fde37 tempest-TestServerVolumeAttachmentScenario-875878610 None] Created volume successfully. Jun 17 05:50:07 devstack sudo[103846]: pam_unix(sudo:session): session closed for user root Jun 17 05:50:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-cc6f2153-a1cf-49a9-9710-90e3b67691b7 tempest-TestServerVolumeAttachmentScenario-875878610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-519f9e31-8efb-498c-a677-2da62211f5c8 1073741824" returned: 0 in 1.044s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:50:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-cc6f2153-a1cf-49a9-9710-90e3b67691b7 tempest-TestServerVolumeAttachmentScenario-875878610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-519f9e31-8efb-498c-a677-2da62211f5c8 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:50:08 devstack sudo[103855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-519f9e31-8efb-498c-a677-2da62211f5c8 Jun 17 05:50:08 devstack sudo[103855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:50:08 devstack sudo[103855]: pam_unix(sudo:session): session closed for user root Jun 17 05:50:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-cc6f2153-a1cf-49a9-9710-90e3b67691b7 tempest-TestServerVolumeAttachmentScenario-875878610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-519f9e31-8efb-498c-a677-2da62211f5c8" returned: 0 in 0.622s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:50:08 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-cc6f2153-a1cf-49a9-9710-90e3b67691b7 tempest-TestServerVolumeAttachmentScenario-875878610 None] <== create_volume: return (1716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:50:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-cc6f2153-a1cf-49a9-9710-90e3b67691b7 tempest-TestServerVolumeAttachmentScenario-875878610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.721s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:50:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-71959d53-cfea-403a-9e0b-36c41c9c5ed1 tempest-VolumesActionsTest-569015156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 3.536s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:50:08 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-cc6f2153-a1cf-49a9-9710-90e3b67691b7 tempest-TestServerVolumeAttachmentScenario-875878610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a347811-c4a1-466a-a80f-66560069c345) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-519f9e31-8efb-498c-a677-2da62211f5c8', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:50:08 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-cc6f2153-a1cf-49a9-9710-90e3b67691b7 tempest-TestServerVolumeAttachmentScenario-875878610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (010f01ca-aa08-4436-8c9d-449b12c95f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:50:08 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5875f9-27a6-4325-9d9f-027bbbabd075]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:50:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-71959d53-cfea-403a-9e0b-36c41c9c5ed1 tempest-VolumesActionsTest-569015156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-66775b65-c6d3-49ea-88d5-f86739e679d0 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:50:08 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-cc6f2153-a1cf-49a9-9710-90e3b67691b7 tempest-TestServerVolumeAttachmentScenario-875878610 None] Volume volume-519f9e31-8efb-498c-a677-2da62211f5c8 (519f9e31-8efb-498c-a677-2da62211f5c8): created successfully Jun 17 05:50:08 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-cc6f2153-a1cf-49a9-9710-90e3b67691b7 tempest-TestServerVolumeAttachmentScenario-875878610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (010f01ca-aa08-4436-8c9d-449b12c95f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:50:08 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-cc6f2153-a1cf-49a9-9710-90e3b67691b7 tempest-TestServerVolumeAttachmentScenario-875878610 None] Flow 'volume_create_manager' (b1ca3694-974f-4622-b6c2-be6b36188c01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:50:08 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-cc6f2153-a1cf-49a9-9710-90e3b67691b7 tempest-TestServerVolumeAttachmentScenario-875878610 None] Created volume successfully. Jun 17 05:50:08 devstack sudo[103859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-66775b65-c6d3-49ea-88d5-f86739e679d0 Jun 17 05:50:08 devstack sudo[103859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:50:09 devstack sudo[103859]: pam_unix(sudo:session): session closed for user root Jun 17 05:50:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-71959d53-cfea-403a-9e0b-36c41c9c5ed1 tempest-VolumesActionsTest-569015156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-66775b65-c6d3-49ea-88d5-f86739e679d0" returned: 0 in 0.761s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:50:09 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b107ed-6513-48a4-959a-600d22de2ca7]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:50:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-71959d53-cfea-403a-9e0b-36c41c9c5ed1 tempest-VolumesActionsTest-569015156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-66775b65-c6d3-49ea-88d5-f86739e679d0 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:50:09 devstack sudo[103881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-66775b65-c6d3-49ea-88d5-f86739e679d0 Jun 17 05:50:09 devstack sudo[103881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:50:10 devstack sudo[103881]: pam_unix(sudo:session): session closed for user root Jun 17 05:50:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-71959d53-cfea-403a-9e0b-36c41c9c5ed1 tempest-VolumesActionsTest-569015156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-66775b65-c6d3-49ea-88d5-f86739e679d0" returned: 0 in 0.761s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:50:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-71959d53-cfea-403a-9e0b-36c41c9c5ed1 tempest-VolumesActionsTest-569015156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-66775b65-c6d3-49ea-88d5-f86739e679d0 /opt/stack/data/cinder/conversion/66775b65-c6d3-49ea-88d5-f86739e679d0.temp_image.4f8cdd9d-b037-4c84-8765-d527d5b32489v7zdk2r2.img {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:50:10 devstack sudo[103886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-66775b65-c6d3-49ea-88d5-f86739e679d0 /opt/stack/data/cinder/conversion/66775b65-c6d3-49ea-88d5-f86739e679d0.temp_image.4f8cdd9d-b037-4c84-8765-d527d5b32489v7zdk2r2.img Jun 17 05:50:10 devstack sudo[103886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:50:16 devstack sudo[103886]: pam_unix(sudo:session): session closed for user root Jun 17 05:50:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-71959d53-cfea-403a-9e0b-36c41c9c5ed1 tempest-VolumesActionsTest-569015156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-66775b65-c6d3-49ea-88d5-f86739e679d0 /opt/stack/data/cinder/conversion/66775b65-c6d3-49ea-88d5-f86739e679d0.temp_image.4f8cdd9d-b037-4c84-8765-d527d5b32489v7zdk2r2.img" returned: 0 in 6.121s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:50:16 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3aec0b1-368e-419a-a01f-4f74167b5b74]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:50:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-71959d53-cfea-403a-9e0b-36c41c9c5ed1 tempest-VolumesActionsTest-569015156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-66775b65-c6d3-49ea-88d5-f86739e679d0 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:50:16 devstack sudo[103976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-66775b65-c6d3-49ea-88d5-f86739e679d0 Jun 17 05:50:16 devstack sudo[103976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:50:17 devstack sudo[103976]: pam_unix(sudo:session): session closed for user root Jun 17 05:50:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-71959d53-cfea-403a-9e0b-36c41c9c5ed1 tempest-VolumesActionsTest-569015156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-66775b65-c6d3-49ea-88d5-f86739e679d0" returned: 0 in 1.135s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:50:17 devstack cinder-volume[92083]: DEBUG cinder.image.image_utils [None req-71959d53-cfea-403a-9e0b-36c41c9c5ed1 tempest-VolumesActionsTest-569015156 None] Image conversion details: src /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-66775b65-c6d3-49ea-88d5-f86739e679d0, size 1024.00 MB, duration 6.12 sec, destination /opt/stack/data/cinder/conversion/66775b65-c6d3-49ea-88d5-f86739e679d0.temp_image.4f8cdd9d-b037-4c84-8765-d527d5b32489v7zdk2r2.img {{(pid=92083) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 17 05:50:17 devstack cinder-volume[92083]: INFO cinder.image.image_utils [None req-71959d53-cfea-403a-9e0b-36c41c9c5ed1 tempest-VolumesActionsTest-569015156 None] Converted 1024.00 MB image at 167.24 MB/s Jun 17 05:50:17 devstack cinder-volume[92083]: DEBUG cinder.image.image_utils [None req-71959d53-cfea-403a-9e0b-36c41c9c5ed1 tempest-VolumesActionsTest-569015156 None] 4f8cdd9d-b037-4c84-8765-d527d5b32489 was raw, converting to qcow2 {{(pid=92083) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jun 17 05:50:17 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf38ad3b-3253-4d17-a9b6-2b64e6a161f3]: (4, 'raw') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:50:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-71959d53-cfea-403a-9e0b-36c41c9c5ed1 tempest-VolumesActionsTest-569015156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/66775b65-c6d3-49ea-88d5-f86739e679d0.temp_image.4f8cdd9d-b037-4c84-8765-d527d5b32489v7zdk2r2.img {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:50:17 devstack sudo[103986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/66775b65-c6d3-49ea-88d5-f86739e679d0.temp_image.4f8cdd9d-b037-4c84-8765-d527d5b32489v7zdk2r2.img Jun 17 05:50:17 devstack sudo[103986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:50:18 devstack sudo[103986]: pam_unix(sudo:session): session closed for user root Jun 17 05:50:18 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-71959d53-cfea-403a-9e0b-36c41c9c5ed1 tempest-VolumesActionsTest-569015156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/66775b65-c6d3-49ea-88d5-f86739e679d0.temp_image.4f8cdd9d-b037-4c84-8765-d527d5b32489v7zdk2r2.img" returned: 0 in 0.886s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:50:18 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-71959d53-cfea-403a-9e0b-36c41c9c5ed1 tempest-VolumesActionsTest-569015156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/66775b65-c6d3-49ea-88d5-f86739e679d0.temp_image.4f8cdd9d-b037-4c84-8765-d527d5b32489v7zdk2r2.img {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:50:18 devstack sudo[103990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/66775b65-c6d3-49ea-88d5-f86739e679d0.temp_image.4f8cdd9d-b037-4c84-8765-d527d5b32489v7zdk2r2.img Jun 17 05:50:18 devstack sudo[103990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:50:19 devstack sudo[103990]: pam_unix(sudo:session): session closed for user root Jun 17 05:50:19 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-71959d53-cfea-403a-9e0b-36c41c9c5ed1 tempest-VolumesActionsTest-569015156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/66775b65-c6d3-49ea-88d5-f86739e679d0.temp_image.4f8cdd9d-b037-4c84-8765-d527d5b32489v7zdk2r2.img" returned: 1 in 0.800s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:50:19 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-71959d53-cfea-403a-9e0b-36c41c9c5ed1 tempest-VolumesActionsTest-569015156 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/66775b65-c6d3-49ea-88d5-f86739e679d0.temp_image.4f8cdd9d-b037-4c84-8765-d527d5b32489v7zdk2r2.img' failed. Not Retrying. {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 05:50:19 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-71959d53-cfea-403a-9e0b-36c41c9c5ed1 tempest-VolumesActionsTest-569015156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/66775b65-c6d3-49ea-88d5-f86739e679d0.temp_image.4f8cdd9d-b037-4c84-8765-d527d5b32489v7zdk2r2.img /opt/stack/data/cinder/conversion/vol_upload_llly1pur {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:50:19 devstack sudo[103998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/66775b65-c6d3-49ea-88d5-f86739e679d0.temp_image.4f8cdd9d-b037-4c84-8765-d527d5b32489v7zdk2r2.img /opt/stack/data/cinder/conversion/vol_upload_llly1pur Jun 17 05:50:19 devstack sudo[103998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:50:19 devstack sudo[103998]: pam_unix(sudo:session): session closed for user root Jun 17 05:50:19 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-71959d53-cfea-403a-9e0b-36c41c9c5ed1 tempest-VolumesActionsTest-569015156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/66775b65-c6d3-49ea-88d5-f86739e679d0.temp_image.4f8cdd9d-b037-4c84-8765-d527d5b32489v7zdk2r2.img /opt/stack/data/cinder/conversion/vol_upload_llly1pur" returned: 0 in 0.631s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:50:19 devstack cinder-volume[92083]: DEBUG cinder.image.image_utils [None req-71959d53-cfea-403a-9e0b-36c41c9c5ed1 tempest-VolumesActionsTest-569015156 None] Image conversion details: src /opt/stack/data/cinder/conversion/66775b65-c6d3-49ea-88d5-f86739e679d0.temp_image.4f8cdd9d-b037-4c84-8765-d527d5b32489v7zdk2r2.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_llly1pur {{(pid=92083) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 17 05:50:19 devstack cinder-volume[92083]: INFO cinder.image.image_utils [None req-71959d53-cfea-403a-9e0b-36c41c9c5ed1 tempest-VolumesActionsTest-569015156 None] Converted 1024.00 MB image at 1024.00 MB/s Jun 17 05:50:19 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e6420b-578f-42e5-b5b2-18fbd66bbb80]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:50:19 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-71959d53-cfea-403a-9e0b-36c41c9c5ed1 tempest-VolumesActionsTest-569015156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_llly1pur {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:50:20 devstack sudo[104003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_llly1pur Jun 17 05:50:20 devstack sudo[104003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:50:20 devstack cinder-volume[92083]: INFO cinder.volume.manager [req-6b4f57c7-db2a-462e-b29a-0e7b923e836d req-74548121-d2af-4387-b5b7-5c1816ef0cdd tempest-TestMinimumBasicScenario-1217357225 None] Terminate volume connection completed successfully. Jun 17 05:50:20 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [req-6b4f57c7-db2a-462e-b29a-0e7b923e836d req-74548121-d2af-4387-b5b7-5c1816ef0cdd tempest-TestMinimumBasicScenario-1217357225 None] Deleting attachment e6c95d12-befd-4189-86ca-ca90d297c7b8. {{(pid=92083) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 17 05:50:20 devstack sudo[104003]: pam_unix(sudo:session): session closed for user root Jun 17 05:50:20 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-71959d53-cfea-403a-9e0b-36c41c9c5ed1 tempest-VolumesActionsTest-569015156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_llly1pur" returned: 0 in 0.923s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:50:22 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-71959d53-cfea-403a-9e0b-36c41c9c5ed1 tempest-VolumesActionsTest-569015156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.513s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:50:22 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-71959d53-cfea-403a-9e0b-36c41c9c5ed1 tempest-VolumesActionsTest-569015156 None] Uploaded volume to glance image-id: 4f8cdd9d-b037-4c84-8765-d527d5b32489. {{(pid=92083) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jun 17 05:50:22 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-c8e315c4-e662-402a-b3bc-1cb2fcaaafc0 tempest-GroupSnapshotsV319Test-926347175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 15.541s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:50:22 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-c8e315c4-e662-402a-b3bc-1cb2fcaaafc0 tempest-GroupSnapshotsV319Test-926347175 None] Creating offline snapshot 0980b84f-2d5c-4348-b737-54e86a5cabe9 of volume c8faf26c-7543-405b-baf7-5d2fc666f334 {{(pid=92083) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 17 05:50:22 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-71959d53-cfea-403a-9e0b-36c41c9c5ed1 tempest-VolumesActionsTest-569015156 None] Copy volume to image completed successfully. Jun 17 05:50:22 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a34e0f-8817-4f70-a921-cc45db98f4eb]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:50:22 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c8e315c4-e662-402a-b3bc-1cb2fcaaafc0 tempest-GroupSnapshotsV319Test-926347175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c8faf26c-7543-405b-baf7-5d2fc666f334 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:50:22 devstack sudo[104014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c8faf26c-7543-405b-baf7-5d2fc666f334 Jun 17 05:50:22 devstack sudo[104014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:50:22 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-2ba2c6c6-c63e-4f29-9c60-18a47d8910ea tempest-TestMinimumBasicScenario-1217357225 None] Acquiring lock "cinder-1d586246-8205-40da-bbac-c3c9d8d3dd73-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:50:22 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-2ba2c6c6-c63e-4f29-9c60-18a47d8910ea tempest-TestMinimumBasicScenario-1217357225 None] Lock "cinder-1d586246-8205-40da-bbac-c3c9d8d3dd73-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:50:22 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-2ba2c6c6-c63e-4f29-9c60-18a47d8910ea tempest-TestMinimumBasicScenario-1217357225 None] Acquiring lock "cinder-quobyte-1d586246-8205-40da-bbac-c3c9d8d3dd73" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:50:22 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-2ba2c6c6-c63e-4f29-9c60-18a47d8910ea tempest-TestMinimumBasicScenario-1217357225 None] Lock "cinder-quobyte-1d586246-8205-40da-bbac-c3c9d8d3dd73" acquired by "delete_volume" :: waited 0.027s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:50:22 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a663f9f-75b6-44da-9eea-7eb3095f4086]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:50:22 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-2ba2c6c6-c63e-4f29-9c60-18a47d8910ea tempest-TestMinimumBasicScenario-1217357225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1d586246-8205-40da-bbac-c3c9d8d3dd73 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:50:22 devstack sudo[104016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1d586246-8205-40da-bbac-c3c9d8d3dd73 Jun 17 05:50:22 devstack sudo[104016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:50:23 devstack sudo[104014]: pam_unix(sudo:session): session closed for user root Jun 17 05:50:23 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c8e315c4-e662-402a-b3bc-1cb2fcaaafc0 tempest-GroupSnapshotsV319Test-926347175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c8faf26c-7543-405b-baf7-5d2fc666f334" returned: 0 in 0.878s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:50:23 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c8e315c4-e662-402a-b3bc-1cb2fcaaafc0 tempest-GroupSnapshotsV319Test-926347175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c8faf26c-7543-405b-baf7-5d2fc666f334,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c8faf26c-7543-405b-baf7-5d2fc666f334.0980b84f-2d5c-4348-b737-54e86a5cabe9 1G {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:50:23 devstack sudo[104021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c8faf26c-7543-405b-baf7-5d2fc666f334,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c8faf26c-7543-405b-baf7-5d2fc666f334.0980b84f-2d5c-4348-b737-54e86a5cabe9 1G Jun 17 05:50:23 devstack sudo[104021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:50:23 devstack sudo[104016]: pam_unix(sudo:session): session closed for user root Jun 17 05:50:23 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-2ba2c6c6-c63e-4f29-9c60-18a47d8910ea tempest-TestMinimumBasicScenario-1217357225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1d586246-8205-40da-bbac-c3c9d8d3dd73" returned: 0 in 0.772s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:50:23 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-2ba2c6c6-c63e-4f29-9c60-18a47d8910ea tempest-TestMinimumBasicScenario-1217357225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1d586246-8205-40da-bbac-c3c9d8d3dd73 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:50:23 devstack sudo[104027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1d586246-8205-40da-bbac-c3c9d8d3dd73 Jun 17 05:50:23 devstack sudo[104027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:50:23 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-9ddd628c-2d9b-4c2a-ae92-f2fd2e695a9c tempest-VolumesActionsTest-569015156 None] Acquiring lock "cinder-66775b65-c6d3-49ea-88d5-f86739e679d0-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:50:23 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-9ddd628c-2d9b-4c2a-ae92-f2fd2e695a9c tempest-VolumesActionsTest-569015156 None] Lock "cinder-66775b65-c6d3-49ea-88d5-f86739e679d0-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:50:24 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-9ddd628c-2d9b-4c2a-ae92-f2fd2e695a9c tempest-VolumesActionsTest-569015156 None] Acquiring lock "cinder-quobyte-66775b65-c6d3-49ea-88d5-f86739e679d0" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:50:24 devstack sudo[104021]: pam_unix(sudo:session): session closed for user root Jun 17 05:50:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c8e315c4-e662-402a-b3bc-1cb2fcaaafc0 tempest-GroupSnapshotsV319Test-926347175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c8faf26c-7543-405b-baf7-5d2fc666f334,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c8faf26c-7543-405b-baf7-5d2fc666f334.0980b84f-2d5c-4348-b737-54e86a5cabe9 1G" returned: 0 in 0.983s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:50:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c8e315c4-e662-402a-b3bc-1cb2fcaaafc0 tempest-GroupSnapshotsV319Test-926347175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8faf26c-7543-405b-baf7-5d2fc666f334 -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c8faf26c-7543-405b-baf7-5d2fc666f334.0980b84f-2d5c-4348-b737-54e86a5cabe9 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:50:24 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-9ddd628c-2d9b-4c2a-ae92-f2fd2e695a9c tempest-VolumesActionsTest-569015156 None] Lock "cinder-quobyte-66775b65-c6d3-49ea-88d5-f86739e679d0" acquired by "delete_volume" :: waited 0.031s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:50:24 devstack sudo[104033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8faf26c-7543-405b-baf7-5d2fc666f334 -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c8faf26c-7543-405b-baf7-5d2fc666f334.0980b84f-2d5c-4348-b737-54e86a5cabe9 Jun 17 05:50:24 devstack sudo[104033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:50:24 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1924a3-f9d4-4283-b33d-e0df108ad2b1]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:50:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-9ddd628c-2d9b-4c2a-ae92-f2fd2e695a9c tempest-VolumesActionsTest-569015156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-66775b65-c6d3-49ea-88d5-f86739e679d0 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:50:24 devstack sudo[104035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-66775b65-c6d3-49ea-88d5-f86739e679d0 Jun 17 05:50:24 devstack sudo[104035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:50:24 devstack sudo[104027]: pam_unix(sudo:session): session closed for user root Jun 17 05:50:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-2ba2c6c6-c63e-4f29-9c60-18a47d8910ea tempest-TestMinimumBasicScenario-1217357225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1d586246-8205-40da-bbac-c3c9d8d3dd73" returned: 0 in 0.886s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:50:24 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-2ba2c6c6-c63e-4f29-9c60-18a47d8910ea tempest-TestMinimumBasicScenario-1217357225 None] Lock "cinder-quobyte-1d586246-8205-40da-bbac-c3c9d8d3dd73" released by "delete_volume" :: held 1.708s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:50:24 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-2ba2c6c6-c63e-4f29-9c60-18a47d8910ea tempest-TestMinimumBasicScenario-1217357225 None] Created reservations ['554f4306-a2d5-4012-86e6-8f3d8af49683', '497e03d9-20c3-4dec-8f71-8ef2e1c08b17', 'ae495404-05a4-4249-9a24-cb020d842abc', 'b4aee1e5-1abd-4e9e-a19c-8fc736606e93'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:50:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-2ba2c6c6-c63e-4f29-9c60-18a47d8910ea tempest-TestMinimumBasicScenario-1217357225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:50:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-2ba2c6c6-c63e-4f29-9c60-18a47d8910ea tempest-TestMinimumBasicScenario-1217357225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:50:24 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-2ba2c6c6-c63e-4f29-9c60-18a47d8910ea tempest-TestMinimumBasicScenario-1217357225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:50:24 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-2ba2c6c6-c63e-4f29-9c60-18a47d8910ea tempest-TestMinimumBasicScenario-1217357225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:50:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-2ba2c6c6-c63e-4f29-9c60-18a47d8910ea tempest-TestMinimumBasicScenario-1217357225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:50:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-2ba2c6c6-c63e-4f29-9c60-18a47d8910ea tempest-TestMinimumBasicScenario-1217357225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:50:24 devstack sudo[104038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:50:24 devstack sudo[104038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:50:24 devstack sudo[104033]: pam_unix(sudo:session): session closed for user root Jun 17 05:50:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c8e315c4-e662-402a-b3bc-1cb2fcaaafc0 tempest-GroupSnapshotsV319Test-926347175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8faf26c-7543-405b-baf7-5d2fc666f334 -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c8faf26c-7543-405b-baf7-5d2fc666f334.0980b84f-2d5c-4348-b737-54e86a5cabe9" returned: 0 in 0.854s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:50:24 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [None req-c8e315c4-e662-402a-b3bc-1cb2fcaaafc0 tempest-GroupSnapshotsV319Test-926347175 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c8faf26c-7543-405b-baf7-5d2fc666f334.0980b84f-2d5c-4348-b737-54e86a5cabe9 is being set with open permissions: ugo+rw: NotImplementedError Jun 17 05:50:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c8e315c4-e662-402a-b3bc-1cb2fcaaafc0 tempest-GroupSnapshotsV319Test-926347175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c8faf26c-7543-405b-baf7-5d2fc666f334.0980b84f-2d5c-4348-b737-54e86a5cabe9 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:50:24 devstack sudo[104048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c8faf26c-7543-405b-baf7-5d2fc666f334.0980b84f-2d5c-4348-b737-54e86a5cabe9 Jun 17 05:50:24 devstack sudo[104048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:50:24 devstack sudo[104035]: pam_unix(sudo:session): session closed for user root Jun 17 05:50:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-9ddd628c-2d9b-4c2a-ae92-f2fd2e695a9c tempest-VolumesActionsTest-569015156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-66775b65-c6d3-49ea-88d5-f86739e679d0" returned: 0 in 0.909s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:50:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-9ddd628c-2d9b-4c2a-ae92-f2fd2e695a9c tempest-VolumesActionsTest-569015156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-66775b65-c6d3-49ea-88d5-f86739e679d0 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:50:25 devstack sudo[104050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-66775b65-c6d3-49ea-88d5-f86739e679d0 Jun 17 05:50:25 devstack sudo[104050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:50:25 devstack sudo[104038]: pam_unix(sudo:session): session closed for user root Jun 17 05:50:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-2ba2c6c6-c63e-4f29-9c60-18a47d8910ea tempest-TestMinimumBasicScenario-1217357225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.919s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:50:25 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-2ba2c6c6-c63e-4f29-9c60-18a47d8910ea tempest-TestMinimumBasicScenario-1217357225 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:50:25 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-2ba2c6c6-c63e-4f29-9c60-18a47d8910ea tempest-TestMinimumBasicScenario-1217357225 None] Deleted volume successfully. Jun 17 05:50:25 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-2ba2c6c6-c63e-4f29-9c60-18a47d8910ea tempest-TestMinimumBasicScenario-1217357225 None] Lock "cinder-1d586246-8205-40da-bbac-c3c9d8d3dd73-delete_volume" released by "delete_volume" :: held 2.929s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:50:25 devstack sudo[104048]: pam_unix(sudo:session): session closed for user root Jun 17 05:50:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c8e315c4-e662-402a-b3bc-1cb2fcaaafc0 tempest-GroupSnapshotsV319Test-926347175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c8faf26c-7543-405b-baf7-5d2fc666f334.0980b84f-2d5c-4348-b737-54e86a5cabe9" returned: 0 in 0.950s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:50:25 devstack sudo[104050]: pam_unix(sudo:session): session closed for user root Jun 17 05:50:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-9ddd628c-2d9b-4c2a-ae92-f2fd2e695a9c tempest-VolumesActionsTest-569015156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-66775b65-c6d3-49ea-88d5-f86739e679d0" returned: 0 in 0.850s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:50:25 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-9ddd628c-2d9b-4c2a-ae92-f2fd2e695a9c tempest-VolumesActionsTest-569015156 None] Lock "cinder-quobyte-66775b65-c6d3-49ea-88d5-f86739e679d0" released by "delete_volume" :: held 1.816s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:50:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c8e315c4-e662-402a-b3bc-1cb2fcaaafc0 tempest-GroupSnapshotsV319Test-926347175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c8faf26c-7543-405b-baf7-5d2fc666f334.info {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:50:25 devstack sudo[104055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c8faf26c-7543-405b-baf7-5d2fc666f334.info Jun 17 05:50:25 devstack sudo[104055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:50:25 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-9ddd628c-2d9b-4c2a-ae92-f2fd2e695a9c tempest-VolumesActionsTest-569015156 None] Created reservations ['335d43c5-d93e-4d76-b35f-abb7f2c36378', '1a28654c-987a-42f1-a469-ad8988d956bb', 'b4df2aa4-1fb9-4cfa-b0ab-e7479af05f6b', '16885077-c9e7-43e8-b3a6-270428fbf14e'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:50:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-9ddd628c-2d9b-4c2a-ae92-f2fd2e695a9c tempest-VolumesActionsTest-569015156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:50:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-9ddd628c-2d9b-4c2a-ae92-f2fd2e695a9c tempest-VolumesActionsTest-569015156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:50:25 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-9ddd628c-2d9b-4c2a-ae92-f2fd2e695a9c tempest-VolumesActionsTest-569015156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:50:26 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-9ddd628c-2d9b-4c2a-ae92-f2fd2e695a9c tempest-VolumesActionsTest-569015156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:50:26 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-9ddd628c-2d9b-4c2a-ae92-f2fd2e695a9c tempest-VolumesActionsTest-569015156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:50:26 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-9ddd628c-2d9b-4c2a-ae92-f2fd2e695a9c tempest-VolumesActionsTest-569015156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:50:26 devstack sudo[104057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:50:26 devstack sudo[104057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:50:27 devstack sudo[104055]: pam_unix(sudo:session): session closed for user root Jun 17 05:50:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c8e315c4-e662-402a-b3bc-1cb2fcaaafc0 tempest-GroupSnapshotsV319Test-926347175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c8faf26c-7543-405b-baf7-5d2fc666f334.info" returned: 0 in 1.125s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:50:27 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [None req-c8e315c4-e662-402a-b3bc-1cb2fcaaafc0 tempest-GroupSnapshotsV319Test-926347175 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c8faf26c-7543-405b-baf7-5d2fc666f334.info is being set with open permissions: ugo+rw: NotImplementedError Jun 17 05:50:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c8e315c4-e662-402a-b3bc-1cb2fcaaafc0 tempest-GroupSnapshotsV319Test-926347175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c8faf26c-7543-405b-baf7-5d2fc666f334.info {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:50:27 devstack sudo[104095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c8faf26c-7543-405b-baf7-5d2fc666f334.info Jun 17 05:50:27 devstack sudo[104095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:50:27 devstack sudo[104057]: pam_unix(sudo:session): session closed for user root Jun 17 05:50:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-9ddd628c-2d9b-4c2a-ae92-f2fd2e695a9c tempest-VolumesActionsTest-569015156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 1.087s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:50:27 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-9ddd628c-2d9b-4c2a-ae92-f2fd2e695a9c tempest-VolumesActionsTest-569015156 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:50:27 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-9ddd628c-2d9b-4c2a-ae92-f2fd2e695a9c tempest-VolumesActionsTest-569015156 None] Deleted volume successfully. Jun 17 05:50:27 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-9ddd628c-2d9b-4c2a-ae92-f2fd2e695a9c tempest-VolumesActionsTest-569015156 None] Lock "cinder-66775b65-c6d3-49ea-88d5-f86739e679d0-delete_volume" released by "delete_volume" :: held 3.200s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:50:27 devstack cinder-volume[92083]: DEBUG oslo_service.periodic_task [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92083) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 05:50:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:50:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:50:27 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:50:27 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:50:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:50:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:50:27 devstack sudo[104098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:50:27 devstack sudo[104098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:50:27 devstack sudo[104095]: pam_unix(sudo:session): session closed for user root Jun 17 05:50:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c8e315c4-e662-402a-b3bc-1cb2fcaaafc0 tempest-GroupSnapshotsV319Test-926347175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c8faf26c-7543-405b-baf7-5d2fc666f334.info" returned: 0 in 0.846s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:50:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-c8e315c4-e662-402a-b3bc-1cb2fcaaafc0 tempest-GroupSnapshotsV319Test-926347175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.770s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:50:27 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-c8e315c4-e662-402a-b3bc-1cb2fcaaafc0 tempest-GroupSnapshotsV319Test-926347175 None] group_snapshot 4ecc3b70-8adf-4a3c-9f78-0b03c3fac462: created successfully Jun 17 05:50:28 devstack sudo[104098]: pam_unix(sudo:session): session closed for user root Jun 17 05:50:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.784s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:50:28 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:50:28 devstack cinder-volume[92083]: DEBUG oslo_service.periodic_task [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running periodic task VolumeManager._thread_info {{(pid=92083) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 05:50:28 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] thread count: 28 {{(pid=92083) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 17 05:50:28 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] thread info: [<_MainThread(MainThread, started 133483869905024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92083) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 17 05:50:29 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-13056041-13fd-4a4a-9f8d-aa0f410ba6da tempest-GroupSnapshotsV319Test-926347175 None] group_snapshot 4ecc3b70-8adf-4a3c-9f78-0b03c3fac462: deleting Jun 17 05:50:29 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-13056041-13fd-4a4a-9f8d-aa0f410ba6da tempest-GroupSnapshotsV319Test-926347175 None] group_snapshot 4ecc3b70-8adf-4a3c-9f78-0b03c3fac462: deleting {{(pid=92083) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 17 05:50:29 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-13056041-13fd-4a4a-9f8d-aa0f410ba6da tempest-GroupSnapshotsV319Test-926347175 None] Acquiring lock "cinder-quobyte-c8faf26c-7543-405b-baf7-5d2fc666f334" by "delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:50:29 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-13056041-13fd-4a4a-9f8d-aa0f410ba6da tempest-GroupSnapshotsV319Test-926347175 None] Lock "cinder-quobyte-c8faf26c-7543-405b-baf7-5d2fc666f334" acquired by "delete_snapshot" :: waited 0.021s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:50:29 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-13056041-13fd-4a4a-9f8d-aa0f410ba6da tempest-GroupSnapshotsV319Test-926347175 None] Acquiring lock "cinder-quobyte-0980b84f-2d5c-4348-b737-54e86a5cabe9" by "_delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:50:29 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-13056041-13fd-4a4a-9f8d-aa0f410ba6da tempest-GroupSnapshotsV319Test-926347175 None] Lock "cinder-quobyte-0980b84f-2d5c-4348-b737-54e86a5cabe9" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:50:29 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-13056041-13fd-4a4a-9f8d-aa0f410ba6da tempest-GroupSnapshotsV319Test-926347175 None] Deleting offline snapshot 0980b84f-2d5c-4348-b737-54e86a5cabe9 of volume c8faf26c-7543-405b-baf7-5d2fc666f334 {{(pid=92083) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 17 05:50:29 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-13056041-13fd-4a4a-9f8d-aa0f410ba6da tempest-GroupSnapshotsV319Test-926347175 None] snapshot_file for this snap is: volume-c8faf26c-7543-405b-baf7-5d2fc666f334.0980b84f-2d5c-4348-b737-54e86a5cabe9 {{(pid=92083) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 17 05:50:29 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd620ddb-7dc1-4c5e-b188-5afac0e45e16]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:50:29 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-13056041-13fd-4a4a-9f8d-aa0f410ba6da tempest-GroupSnapshotsV319Test-926347175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c8faf26c-7543-405b-baf7-5d2fc666f334.0980b84f-2d5c-4348-b737-54e86a5cabe9 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:50:29 devstack sudo[104158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c8faf26c-7543-405b-baf7-5d2fc666f334.0980b84f-2d5c-4348-b737-54e86a5cabe9 Jun 17 05:50:29 devstack sudo[104158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:50:30 devstack sudo[104158]: pam_unix(sudo:session): session closed for user root Jun 17 05:50:30 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-13056041-13fd-4a4a-9f8d-aa0f410ba6da tempest-GroupSnapshotsV319Test-926347175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c8faf26c-7543-405b-baf7-5d2fc666f334.0980b84f-2d5c-4348-b737-54e86a5cabe9" returned: 0 in 0.736s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:50:30 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-13056041-13fd-4a4a-9f8d-aa0f410ba6da tempest-GroupSnapshotsV319Test-926347175 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c8faf26c-7543-405b-baf7-5d2fc666f334(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92083) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 05:50:30 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d864f2e-88b1-4148-8ff6-347a69331256]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:50:30 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-13056041-13fd-4a4a-9f8d-aa0f410ba6da tempest-GroupSnapshotsV319Test-926347175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c8faf26c-7543-405b-baf7-5d2fc666f334 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:50:30 devstack sudo[104163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c8faf26c-7543-405b-baf7-5d2fc666f334 Jun 17 05:50:30 devstack sudo[104163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:50:31 devstack sudo[104163]: pam_unix(sudo:session): session closed for user root Jun 17 05:50:31 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-13056041-13fd-4a4a-9f8d-aa0f410ba6da tempest-GroupSnapshotsV319Test-926347175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c8faf26c-7543-405b-baf7-5d2fc666f334" returned: 0 in 0.824s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:50:31 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-13056041-13fd-4a4a-9f8d-aa0f410ba6da tempest-GroupSnapshotsV319Test-926347175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c8faf26c-7543-405b-baf7-5d2fc666f334.0980b84f-2d5c-4348-b737-54e86a5cabe9 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:50:31 devstack sudo[104171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c8faf26c-7543-405b-baf7-5d2fc666f334.0980b84f-2d5c-4348-b737-54e86a5cabe9 Jun 17 05:50:31 devstack sudo[104171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:50:32 devstack sudo[104171]: pam_unix(sudo:session): session closed for user root Jun 17 05:50:32 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-13056041-13fd-4a4a-9f8d-aa0f410ba6da tempest-GroupSnapshotsV319Test-926347175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c8faf26c-7543-405b-baf7-5d2fc666f334.0980b84f-2d5c-4348-b737-54e86a5cabe9" returned: 0 in 0.821s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:50:32 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-13056041-13fd-4a4a-9f8d-aa0f410ba6da tempest-GroupSnapshotsV319Test-926347175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c8faf26c-7543-405b-baf7-5d2fc666f334.0980b84f-2d5c-4348-b737-54e86a5cabe9 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:50:32 devstack sudo[104178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c8faf26c-7543-405b-baf7-5d2fc666f334.0980b84f-2d5c-4348-b737-54e86a5cabe9 Jun 17 05:50:32 devstack sudo[104178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:50:32 devstack sudo[104178]: pam_unix(sudo:session): session closed for user root Jun 17 05:50:32 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-13056041-13fd-4a4a-9f8d-aa0f410ba6da tempest-GroupSnapshotsV319Test-926347175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c8faf26c-7543-405b-baf7-5d2fc666f334.0980b84f-2d5c-4348-b737-54e86a5cabe9" returned: 0 in 0.648s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:50:32 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-13056041-13fd-4a4a-9f8d-aa0f410ba6da tempest-GroupSnapshotsV319Test-926347175 None] Lock "cinder-quobyte-0980b84f-2d5c-4348-b737-54e86a5cabe9" released by "_delete_snapshot" :: held 3.174s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:50:32 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-13056041-13fd-4a4a-9f8d-aa0f410ba6da tempest-GroupSnapshotsV319Test-926347175 None] Lock "cinder-quobyte-c8faf26c-7543-405b-baf7-5d2fc666f334" released by "delete_snapshot" :: held 3.201s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:50:32 devstack cinder-volume[92083]: WARNING cinder.quota [None req-13056041-13fd-4a4a-9f8d-aa0f410ba6da tempest-GroupSnapshotsV319Test-926347175 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-657980965 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-657980965, it is now deprecated. Please use the default quota class for default quota. Jun 17 05:50:32 devstack cinder-volume[92083]: WARNING cinder.quota [None req-13056041-13fd-4a4a-9f8d-aa0f410ba6da tempest-GroupSnapshotsV319Test-926347175 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-657980965 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-657980965, it is now deprecated. Please use the default quota class for default quota. Jun 17 05:50:32 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-13056041-13fd-4a4a-9f8d-aa0f410ba6da tempest-GroupSnapshotsV319Test-926347175 None] Created reservations ['91447be1-9668-4f35-a5bd-65484c26fa15', 'e032c369-075b-4597-8c7d-14c3a17d323b', 'ac2bcd0e-75fd-4220-9fac-fe071146887b', '306a86a4-b108-45d1-97c1-ac189f882175'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:50:32 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-13056041-13fd-4a4a-9f8d-aa0f410ba6da tempest-GroupSnapshotsV319Test-926347175 None] group_snapshot 4ecc3b70-8adf-4a3c-9f78-0b03c3fac462: deleted successfully Jun 17 05:50:33 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-21338874-d892-4051-b06b-63a5c3c4270a tempest-VolumesCloneTest-945717238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:50:33 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-21338874-d892-4051-b06b-63a5c3c4270a tempest-VolumesCloneTest-945717238 None] Flow 'volume_create_manager' (5976f77a-acba-4e4b-a3e9-a136015eab77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:50:33 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-21338874-d892-4051-b06b-63a5c3c4270a tempest-VolumesCloneTest-945717238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02b1fd06-90f5-484f-9f93-047914851123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:50:33 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-21338874-d892-4051-b06b-63a5c3c4270a tempest-VolumesCloneTest-945717238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02b1fd06-90f5-484f-9f93-047914851123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:50:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-429425336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df257ff6-196c-4ee5-831c-1aa76265c2e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04eaaaa72de2475e9f160f81e8ecb632',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:50:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:50:34Z,use_quota=True,user_id='e706a8f0fc2745568b4276eb10c96e6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:50:33 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-21338874-d892-4051-b06b-63a5c3c4270a tempest-VolumesCloneTest-945717238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9dc1c59-88be-430c-8122-c8ed794bee8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:50:33 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-21338874-d892-4051-b06b-63a5c3c4270a tempest-VolumesCloneTest-945717238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9dc1c59-88be-430c-8122-c8ed794bee8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:50:33 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-21338874-d892-4051-b06b-63a5c3c4270a tempest-VolumesCloneTest-945717238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (222d0439-7e97-4919-9595-84f5d971bb4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:50:33 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-21338874-d892-4051-b06b-63a5c3c4270a tempest-VolumesCloneTest-945717238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (222d0439-7e97-4919-9595-84f5d971bb4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df257ff6-196c-4ee5-831c-1aa76265c2e9', 'volume_name': 'volume-df257ff6-196c-4ee5-831c-1aa76265c2e9', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:50:33 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-21338874-d892-4051-b06b-63a5c3c4270a tempest-VolumesCloneTest-945717238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa6115d8-99be-4ed0-bbc8-267b42eb4712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:50:33 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-21338874-d892-4051-b06b-63a5c3c4270a tempest-VolumesCloneTest-945717238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa6115d8-99be-4ed0-bbc8-267b42eb4712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:50:33 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-21338874-d892-4051-b06b-63a5c3c4270a tempest-VolumesCloneTest-945717238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1d695d8-8d72-44fd-9c3c-343b6b424e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:50:33 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-21338874-d892-4051-b06b-63a5c3c4270a tempest-VolumesCloneTest-945717238 None] Volume df257ff6-196c-4ee5-831c-1aa76265c2e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df257ff6-196c-4ee5-831c-1aa76265c2e9', 'volume_size': 1} Jun 17 05:50:33 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-21338874-d892-4051-b06b-63a5c3c4270a tempest-VolumesCloneTest-945717238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:50:33 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-21338874-d892-4051-b06b-63a5c3c4270a tempest-VolumesCloneTest-945717238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:50:33 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-21338874-d892-4051-b06b-63a5c3c4270a tempest-VolumesCloneTest-945717238 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:50:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-429425336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df257ff6-196c-4ee5-831c-1aa76265c2e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04eaaaa72de2475e9f160f81e8ecb632',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:50:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:50:34Z,use_quota=True,user_id='e706a8f0fc2745568b4276eb10c96e6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:50:33 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-21338874-d892-4051-b06b-63a5c3c4270a tempest-VolumesCloneTest-945717238 None] Creating volume df257ff6-196c-4ee5-831c-1aa76265c2e9 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:50:33 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-21338874-d892-4051-b06b-63a5c3c4270a tempest-VolumesCloneTest-945717238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:50:33 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-21338874-d892-4051-b06b-63a5c3c4270a tempest-VolumesCloneTest-945717238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:50:33 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-21338874-d892-4051-b06b-63a5c3c4270a tempest-VolumesCloneTest-945717238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:50:33 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-21338874-d892-4051-b06b-63a5c3c4270a tempest-VolumesCloneTest-945717238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:50:33 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-21338874-d892-4051-b06b-63a5c3c4270a tempest-VolumesCloneTest-945717238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:50:33 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-21338874-d892-4051-b06b-63a5c3c4270a tempest-VolumesCloneTest-945717238 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:50:33 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-21338874-d892-4051-b06b-63a5c3c4270a tempest-VolumesCloneTest-945717238 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:50:33 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-21338874-d892-4051-b06b-63a5c3c4270a tempest-VolumesCloneTest-945717238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-df257ff6-196c-4ee5-831c-1aa76265c2e9 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:50:34 devstack sudo[104183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-df257ff6-196c-4ee5-831c-1aa76265c2e9 1073741824 Jun 17 05:50:34 devstack sudo[104183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:50:34 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-abcc601a-1e56-4171-96ac-32e5c27b8a8b tempest-GroupSnapshotsV319Test-926347175 None] Acquiring lock "cinder-quobyte-c8faf26c-7543-405b-baf7-5d2fc666f334" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:50:34 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-abcc601a-1e56-4171-96ac-32e5c27b8a8b tempest-GroupSnapshotsV319Test-926347175 None] Lock "cinder-quobyte-c8faf26c-7543-405b-baf7-5d2fc666f334" acquired by "delete_volume" :: waited 0.014s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:50:34 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c753372-7794-4249-be1d-211a6f0be2df]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:50:34 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-abcc601a-1e56-4171-96ac-32e5c27b8a8b tempest-GroupSnapshotsV319Test-926347175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c8faf26c-7543-405b-baf7-5d2fc666f334 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:50:34 devstack sudo[104185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c8faf26c-7543-405b-baf7-5d2fc666f334 Jun 17 05:50:34 devstack sudo[104185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:50:34 devstack sudo[104183]: pam_unix(sudo:session): session closed for user root Jun 17 05:50:34 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-21338874-d892-4051-b06b-63a5c3c4270a tempest-VolumesCloneTest-945717238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-df257ff6-196c-4ee5-831c-1aa76265c2e9 1073741824" returned: 0 in 0.930s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:50:34 devstack sudo[104185]: pam_unix(sudo:session): session closed for user root Jun 17 05:50:34 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-abcc601a-1e56-4171-96ac-32e5c27b8a8b tempest-GroupSnapshotsV319Test-926347175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c8faf26c-7543-405b-baf7-5d2fc666f334" returned: 0 in 0.776s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:50:34 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-abcc601a-1e56-4171-96ac-32e5c27b8a8b tempest-GroupSnapshotsV319Test-926347175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c8faf26c-7543-405b-baf7-5d2fc666f334 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:50:34 devstack sudo[104194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c8faf26c-7543-405b-baf7-5d2fc666f334 Jun 17 05:50:34 devstack sudo[104194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:50:34 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-21338874-d892-4051-b06b-63a5c3c4270a tempest-VolumesCloneTest-945717238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-df257ff6-196c-4ee5-831c-1aa76265c2e9 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:50:35 devstack sudo[104196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-df257ff6-196c-4ee5-831c-1aa76265c2e9 Jun 17 05:50:35 devstack sudo[104196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:50:35 devstack sudo[104194]: pam_unix(sudo:session): session closed for user root Jun 17 05:50:35 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-abcc601a-1e56-4171-96ac-32e5c27b8a8b tempest-GroupSnapshotsV319Test-926347175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c8faf26c-7543-405b-baf7-5d2fc666f334" returned: 0 in 0.836s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:50:35 devstack sudo[104196]: pam_unix(sudo:session): session closed for user root Jun 17 05:50:35 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-21338874-d892-4051-b06b-63a5c3c4270a tempest-VolumesCloneTest-945717238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-df257ff6-196c-4ee5-831c-1aa76265c2e9" returned: 0 in 0.824s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:50:35 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-21338874-d892-4051-b06b-63a5c3c4270a tempest-VolumesCloneTest-945717238 None] <== create_volume: return (1822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:50:35 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-21338874-d892-4051-b06b-63a5c3c4270a tempest-VolumesCloneTest-945717238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.824s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:50:35 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-abcc601a-1e56-4171-96ac-32e5c27b8a8b tempest-GroupSnapshotsV319Test-926347175 None] Lock "cinder-quobyte-c8faf26c-7543-405b-baf7-5d2fc666f334" released by "delete_volume" :: held 1.704s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:50:35 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-21338874-d892-4051-b06b-63a5c3c4270a tempest-VolumesCloneTest-945717238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1d695d8-8d72-44fd-9c3c-343b6b424e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df257ff6-196c-4ee5-831c-1aa76265c2e9', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:50:35 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-21338874-d892-4051-b06b-63a5c3c4270a tempest-VolumesCloneTest-945717238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a30ea815-bdd1-4ff1-b980-9a4411b486e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:50:35 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-21338874-d892-4051-b06b-63a5c3c4270a tempest-VolumesCloneTest-945717238 None] Volume volume-df257ff6-196c-4ee5-831c-1aa76265c2e9 (df257ff6-196c-4ee5-831c-1aa76265c2e9): created successfully Jun 17 05:50:35 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-21338874-d892-4051-b06b-63a5c3c4270a tempest-VolumesCloneTest-945717238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a30ea815-bdd1-4ff1-b980-9a4411b486e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:50:35 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-21338874-d892-4051-b06b-63a5c3c4270a tempest-VolumesCloneTest-945717238 None] Flow 'volume_create_manager' (5976f77a-acba-4e4b-a3e9-a136015eab77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:50:35 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-21338874-d892-4051-b06b-63a5c3c4270a tempest-VolumesCloneTest-945717238 None] Created volume successfully. Jun 17 05:50:35 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-abcc601a-1e56-4171-96ac-32e5c27b8a8b tempest-GroupSnapshotsV319Test-926347175 None] Created reservations ['76041f38-18c0-487d-99ed-48289c190356'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:50:35 devstack cinder-volume[92083]: WARNING cinder.quota [None req-abcc601a-1e56-4171-96ac-32e5c27b8a8b tempest-GroupSnapshotsV319Test-926347175 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-657980965 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-657980965, it is now deprecated. Please use the default quota class for default quota. Jun 17 05:50:36 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-abcc601a-1e56-4171-96ac-32e5c27b8a8b tempest-GroupSnapshotsV319Test-926347175 None] Created reservations ['4adc11fe-5789-47f4-ab5e-862c58c8daaf', '4443e0a1-008e-438a-9bbe-568c435739ca', '7d5aa7b2-ed40-401f-990b-f945c857d807', 'b682eb9f-94e3-415f-805f-aff715905fef'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:50:36 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-abcc601a-1e56-4171-96ac-32e5c27b8a8b tempest-GroupSnapshotsV319Test-926347175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:50:36 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-abcc601a-1e56-4171-96ac-32e5c27b8a8b tempest-GroupSnapshotsV319Test-926347175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:50:36 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-abcc601a-1e56-4171-96ac-32e5c27b8a8b tempest-GroupSnapshotsV319Test-926347175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:50:36 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-abcc601a-1e56-4171-96ac-32e5c27b8a8b tempest-GroupSnapshotsV319Test-926347175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:50:36 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-abcc601a-1e56-4171-96ac-32e5c27b8a8b tempest-GroupSnapshotsV319Test-926347175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:50:36 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-abcc601a-1e56-4171-96ac-32e5c27b8a8b tempest-GroupSnapshotsV319Test-926347175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:50:36 devstack sudo[104202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:50:36 devstack sudo[104202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:50:36 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:50:36 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] Flow 'volume_create_manager' (aeb76496-0795-460c-ad98-50c6e622be88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:50:36 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26cc3fd0-bb27-4bb8-b195-8d54a608417e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:50:36 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26cc3fd0-bb27-4bb8-b195-8d54a608417e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:50:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-556501745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de53ebf7-cc4b-435c-b4af-459b16314629,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04eaaaa72de2475e9f160f81e8ecb632',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:50:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=df257ff6-196c-4ee5-831c-1aa76265c2e9,status='creating',terminated_at=None,updated_at=2026-06-17T03:50:37Z,use_quota=True,user_id='e706a8f0fc2745568b4276eb10c96e6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:50:36 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6ac94a1-bf63-48ea-9645-df0830c9fa79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:50:36 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6ac94a1-bf63-48ea-9645-df0830c9fa79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:50:36 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33fa012a-cd96-4996-ade8-2e58f6aeef36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:50:36 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33fa012a-cd96-4996-ade8-2e58f6aeef36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'de53ebf7-cc4b-435c-b4af-459b16314629', 'volume_name': 'volume-de53ebf7-cc4b-435c-b4af-459b16314629', 'volume_size': 2, 'source_volid': 'df257ff6-196c-4ee5-831c-1aa76265c2e9', 'source_volstatus': 'available'}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:50:36 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89d0d5d0-b020-441d-9cda-6ada7ea90e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:50:36 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89d0d5d0-b020-441d-9cda-6ada7ea90e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:50:36 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (518465e5-6d7c-4920-bd4f-f243c88a0030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:50:36 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] Volume de53ebf7-cc4b-435c-b4af-459b16314629: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-de53ebf7-cc4b-435c-b4af-459b16314629', 'volume_size': 2, 'source_volid': 'df257ff6-196c-4ee5-831c-1aa76265c2e9', 'source_volstatus': 'available'} Jun 17 05:50:36 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:50:36 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.003s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:50:36 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] Cloning volume df257ff6-196c-4ee5-831c-1aa76265c2e9 to volume de53ebf7-cc4b-435c-b4af-459b16314629 Jun 17 05:50:37 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] Creating offline snapshot ef9300ca-c9c4-4ccd-a136-1796a3805bde of volume df257ff6-196c-4ee5-831c-1aa76265c2e9 {{(pid=92083) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 17 05:50:37 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[2719e00c-f779-4409-8457-f70278d9199e]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:50:37 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-df257ff6-196c-4ee5-831c-1aa76265c2e9 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:50:37 devstack sudo[104202]: pam_unix(sudo:session): session closed for user root Jun 17 05:50:37 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-abcc601a-1e56-4171-96ac-32e5c27b8a8b tempest-GroupSnapshotsV319Test-926347175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 1.019s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:50:37 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-abcc601a-1e56-4171-96ac-32e5c27b8a8b tempest-GroupSnapshotsV319Test-926347175 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:50:37 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-abcc601a-1e56-4171-96ac-32e5c27b8a8b tempest-GroupSnapshotsV319Test-926347175 None] Delete group completed successfully. Jun 17 05:50:37 devstack sudo[104205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-df257ff6-196c-4ee5-831c-1aa76265c2e9 Jun 17 05:50:37 devstack sudo[104205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:50:38 devstack sudo[104205]: pam_unix(sudo:session): session closed for user root Jun 17 05:50:38 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-df257ff6-196c-4ee5-831c-1aa76265c2e9" returned: 0 in 0.957s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:50:38 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-df257ff6-196c-4ee5-831c-1aa76265c2e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-df257ff6-196c-4ee5-831c-1aa76265c2e9.ef9300ca-c9c4-4ccd-a136-1796a3805bde 1G {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:50:38 devstack sudo[104210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-df257ff6-196c-4ee5-831c-1aa76265c2e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-df257ff6-196c-4ee5-831c-1aa76265c2e9.ef9300ca-c9c4-4ccd-a136-1796a3805bde 1G Jun 17 05:50:38 devstack sudo[104210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:50:38 devstack sudo[104210]: pam_unix(sudo:session): session closed for user root Jun 17 05:50:38 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-df257ff6-196c-4ee5-831c-1aa76265c2e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-df257ff6-196c-4ee5-831c-1aa76265c2e9.ef9300ca-c9c4-4ccd-a136-1796a3805bde 1G" returned: 0 in 0.877s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:50:38 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df257ff6-196c-4ee5-831c-1aa76265c2e9 -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-df257ff6-196c-4ee5-831c-1aa76265c2e9.ef9300ca-c9c4-4ccd-a136-1796a3805bde {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:50:38 devstack sudo[104217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df257ff6-196c-4ee5-831c-1aa76265c2e9 -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-df257ff6-196c-4ee5-831c-1aa76265c2e9.ef9300ca-c9c4-4ccd-a136-1796a3805bde Jun 17 05:50:38 devstack sudo[104217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:50:39 devstack sudo[104217]: pam_unix(sudo:session): session closed for user root Jun 17 05:50:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df257ff6-196c-4ee5-831c-1aa76265c2e9 -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-df257ff6-196c-4ee5-831c-1aa76265c2e9.ef9300ca-c9c4-4ccd-a136-1796a3805bde" returned: 0 in 0.758s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:50:39 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-df257ff6-196c-4ee5-831c-1aa76265c2e9.ef9300ca-c9c4-4ccd-a136-1796a3805bde is being set with open permissions: ugo+rw Jun 17 05:50:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-df257ff6-196c-4ee5-831c-1aa76265c2e9.ef9300ca-c9c4-4ccd-a136-1796a3805bde {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:50:39 devstack sudo[104224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-df257ff6-196c-4ee5-831c-1aa76265c2e9.ef9300ca-c9c4-4ccd-a136-1796a3805bde Jun 17 05:50:39 devstack sudo[104224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:50:40 devstack sudo[104224]: pam_unix(sudo:session): session closed for user root Jun 17 05:50:40 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-df257ff6-196c-4ee5-831c-1aa76265c2e9.ef9300ca-c9c4-4ccd-a136-1796a3805bde" returned: 0 in 0.707s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:50:40 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-df257ff6-196c-4ee5-831c-1aa76265c2e9.info {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:50:40 devstack sudo[104227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-df257ff6-196c-4ee5-831c-1aa76265c2e9.info Jun 17 05:50:40 devstack sudo[104227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:50:41 devstack sudo[104227]: pam_unix(sudo:session): session closed for user root Jun 17 05:50:41 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-df257ff6-196c-4ee5-831c-1aa76265c2e9.info" returned: 0 in 0.750s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:50:41 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-df257ff6-196c-4ee5-831c-1aa76265c2e9.info is being set with open permissions: ugo+rw Jun 17 05:50:41 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-df257ff6-196c-4ee5-831c-1aa76265c2e9.info {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:50:41 devstack sudo[104233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-df257ff6-196c-4ee5-831c-1aa76265c2e9.info Jun 17 05:50:41 devstack sudo[104233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:50:41 devstack sudo[104233]: pam_unix(sudo:session): session closed for user root Jun 17 05:50:41 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-df257ff6-196c-4ee5-831c-1aa76265c2e9.info" returned: 0 in 0.735s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:50:41 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] Acquiring lock "cinder-quobyte-de53ebf7-cc4b-435c-b4af-459b16314629" by "_copy_volume_from_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:50:41 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] Lock "cinder-quobyte-de53ebf7-cc4b-435c-b4af-459b16314629" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:50:41 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] snapshot: ef9300ca-c9c4-4ccd-a136-1796a3805bde, volume: de53ebf7-cc4b-435c-b4af-459b16314629, {{(pid=92083) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 17 05:50:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:50:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:50:42 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:50:42 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:50:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:50:42 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[f671091e-1b37-44b7-a543-0427f592f4b1]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:50:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-df257ff6-196c-4ee5-831c-1aa76265c2e9.ef9300ca-c9c4-4ccd-a136-1796a3805bde {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:50:42 devstack sudo[104236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-df257ff6-196c-4ee5-831c-1aa76265c2e9.ef9300ca-c9c4-4ccd-a136-1796a3805bde Jun 17 05:50:42 devstack sudo[104236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:50:42 devstack sudo[104236]: pam_unix(sudo:session): session closed for user root Jun 17 05:50:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-df257ff6-196c-4ee5-831c-1aa76265c2e9.ef9300ca-c9c4-4ccd-a136-1796a3805bde" returned: 0 in 0.831s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:50:42 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df257ff6-196c-4ee5-831c-1aa76265c2e9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92083) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 05:50:42 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] will copy from snapshot at /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-df257ff6-196c-4ee5-831c-1aa76265c2e9 {{(pid=92083) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 17 05:50:42 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] Creating direct copy from snapshot {{(pid=92083) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 17 05:50:42 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[26cff7b7-4069-41ca-bc77-e7c7d38a255a]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:50:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-df257ff6-196c-4ee5-831c-1aa76265c2e9 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:50:43 devstack sudo[104241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-df257ff6-196c-4ee5-831c-1aa76265c2e9 Jun 17 05:50:43 devstack sudo[104241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:50:43 devstack sudo[104241]: pam_unix(sudo:session): session closed for user root Jun 17 05:50:43 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-df257ff6-196c-4ee5-831c-1aa76265c2e9" returned: 0 in 0.766s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:50:43 devstack cinder-volume[92083]: DEBUG cinder.utils [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] Path /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-de53ebf7-cc4b-435c-b4af-459b16314629 not found in is_blk_device check {{(pid=92083) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 17 05:50:43 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-df257ff6-196c-4ee5-831c-1aa76265c2e9 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-de53ebf7-cc4b-435c-b4af-459b16314629 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:50:43 devstack sudo[104246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-df257ff6-196c-4ee5-831c-1aa76265c2e9 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-de53ebf7-cc4b-435c-b4af-459b16314629 Jun 17 05:50:43 devstack sudo[104246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:50:45 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-341241bb-3f91-48d7-919f-47359842d248 req-4dcd935b-7c43-4351-9af1-db9267b27d9f tempest-TestServerVolumeAttachmentScenario-875878610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:50:49 devstack sudo[104246]: pam_unix(sudo:session): session closed for user root Jun 17 05:50:49 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-df257ff6-196c-4ee5-831c-1aa76265c2e9 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-de53ebf7-cc4b-435c-b4af-459b16314629" returned: 0 in 5.578s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:50:49 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1f8e99-62c7-4bd9-a5d3-b367c79e33b8]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:50:49 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-df257ff6-196c-4ee5-831c-1aa76265c2e9 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:50:49 devstack sudo[104268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-df257ff6-196c-4ee5-831c-1aa76265c2e9 Jun 17 05:50:49 devstack sudo[104268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:50:50 devstack sudo[104268]: pam_unix(sudo:session): session closed for user root Jun 17 05:50:50 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-df257ff6-196c-4ee5-831c-1aa76265c2e9" returned: 0 in 0.880s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:50:50 devstack cinder-volume[92083]: DEBUG cinder.image.image_utils [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] Image conversion details: src /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-df257ff6-196c-4ee5-831c-1aa76265c2e9, size 1024.00 MB, duration 5.58 sec, destination /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-de53ebf7-cc4b-435c-b4af-459b16314629 {{(pid=92083) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 17 05:50:50 devstack cinder-volume[92083]: INFO cinder.image.image_utils [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] Converted 1024.00 MB image at 183.54 MB/s Jun 17 05:50:50 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-de53ebf7-cc4b-435c-b4af-459b16314629 is being set with open permissions: ugo+rw Jun 17 05:50:50 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-de53ebf7-cc4b-435c-b4af-459b16314629 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:50:50 devstack sudo[104274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-de53ebf7-cc4b-435c-b4af-459b16314629 Jun 17 05:50:50 devstack sudo[104274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:50:50 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-391c1f48-9d15-4a05-b12a-12dadacf8b14 tempest-GroupsV314Test-549425539 None] Group tempest-GroupsV314Test-Group-1965339064: creating Jun 17 05:50:50 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-391c1f48-9d15-4a05-b12a-12dadacf8b14 tempest-GroupsV314Test-549425539 None] Group tempest-GroupsV314Test-Group-1965339064: created successfully Jun 17 05:50:50 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-391c1f48-9d15-4a05-b12a-12dadacf8b14 tempest-GroupsV314Test-549425539 None] Create group completed successfully. Jun 17 05:50:50 devstack sudo[104274]: pam_unix(sudo:session): session closed for user root Jun 17 05:50:50 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-de53ebf7-cc4b-435c-b4af-459b16314629" returned: 0 in 0.602s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:50:50 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] Lock "cinder-quobyte-de53ebf7-cc4b-435c-b4af-459b16314629" released by "_copy_volume_from_snapshot" :: held 8.787s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:50:50 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] Acquiring lock "cinder-quobyte-ef9300ca-c9c4-4ccd-a136-1796a3805bde" by "_delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:50:50 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] Lock "cinder-quobyte-ef9300ca-c9c4-4ccd-a136-1796a3805bde" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:50:50 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] Deleting offline snapshot ef9300ca-c9c4-4ccd-a136-1796a3805bde of volume df257ff6-196c-4ee5-831c-1aa76265c2e9 {{(pid=92083) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 17 05:50:50 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] snapshot_file for this snap is: volume-df257ff6-196c-4ee5-831c-1aa76265c2e9.ef9300ca-c9c4-4ccd-a136-1796a3805bde {{(pid=92083) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 17 05:50:50 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[773304f0-4fe0-4580-af4e-47b7b33ed620]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:50:50 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-df257ff6-196c-4ee5-831c-1aa76265c2e9.ef9300ca-c9c4-4ccd-a136-1796a3805bde {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:50:50 devstack sudo[104277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-df257ff6-196c-4ee5-831c-1aa76265c2e9.ef9300ca-c9c4-4ccd-a136-1796a3805bde Jun 17 05:50:50 devstack sudo[104277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:50:51 devstack sudo[104277]: pam_unix(sudo:session): session closed for user root Jun 17 05:50:51 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-df257ff6-196c-4ee5-831c-1aa76265c2e9.ef9300ca-c9c4-4ccd-a136-1796a3805bde" returned: 0 in 0.697s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:50:51 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df257ff6-196c-4ee5-831c-1aa76265c2e9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92083) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 05:50:51 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[0170fae9-191a-450c-9880-1c574355f423]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:50:51 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-df257ff6-196c-4ee5-831c-1aa76265c2e9 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:50:51 devstack sudo[104282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-df257ff6-196c-4ee5-831c-1aa76265c2e9 Jun 17 05:50:51 devstack sudo[104282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:50:51 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6beb126-7aca-4fe0-b7be-ffd183f5c625 tempest-GroupsV314Test-549425539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:50:51 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e6beb126-7aca-4fe0-b7be-ffd183f5c625 tempest-GroupsV314Test-549425539 None] Flow 'volume_create_manager' (0c8a3d05-9933-485d-a729-cfbe2d1fae24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:50:51 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e6beb126-7aca-4fe0-b7be-ffd183f5c625 tempest-GroupsV314Test-549425539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (038aeda6-b674-4e20-b33f-614eea2931c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:50:51 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e6beb126-7aca-4fe0-b7be-ffd183f5c625 tempest-GroupsV314Test-549425539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (038aeda6-b674-4e20-b33f-614eea2931c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:50:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1247317634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d3e91cda-1702-40ca-aa5a-1a5279883f77,host='devstack@QuobyteHD#QuobyteHD',id=336af048-c51c-4c42-9d98-c85b28b6b5e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a63b3df5404248eb962e7679f7a2f39a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:50:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:50:52Z,use_quota=True,user_id='41885d67d86a42f6ad5b4ddc62fb50f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(014a7dcd-d108-4d16-b644-b99db0a80d37),volume_type_id=014a7dcd-d108-4d16-b644-b99db0a80d37)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:50:51 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e6beb126-7aca-4fe0-b7be-ffd183f5c625 tempest-GroupsV314Test-549425539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a44eea0-341e-4b04-bdba-8ba067a01562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:50:51 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e6beb126-7aca-4fe0-b7be-ffd183f5c625 tempest-GroupsV314Test-549425539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a44eea0-341e-4b04-bdba-8ba067a01562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:50:51 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e6beb126-7aca-4fe0-b7be-ffd183f5c625 tempest-GroupsV314Test-549425539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9db19f26-63da-4962-b56d-23dc23f2235c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:50:51 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e6beb126-7aca-4fe0-b7be-ffd183f5c625 tempest-GroupsV314Test-549425539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9db19f26-63da-4962-b56d-23dc23f2235c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '336af048-c51c-4c42-9d98-c85b28b6b5e0', 'volume_name': 'volume-336af048-c51c-4c42-9d98-c85b28b6b5e0', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:50:51 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e6beb126-7aca-4fe0-b7be-ffd183f5c625 tempest-GroupsV314Test-549425539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c070f88d-983a-4dc9-ae0a-c54511b406a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:50:51 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e6beb126-7aca-4fe0-b7be-ffd183f5c625 tempest-GroupsV314Test-549425539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c070f88d-983a-4dc9-ae0a-c54511b406a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:50:51 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e6beb126-7aca-4fe0-b7be-ffd183f5c625 tempest-GroupsV314Test-549425539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64cf1aca-6b53-4e9e-b74c-dab149065c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:50:51 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-e6beb126-7aca-4fe0-b7be-ffd183f5c625 tempest-GroupsV314Test-549425539 None] Volume 336af048-c51c-4c42-9d98-c85b28b6b5e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-336af048-c51c-4c42-9d98-c85b28b6b5e0', 'volume_size': 1} Jun 17 05:50:51 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e6beb126-7aca-4fe0-b7be-ffd183f5c625 tempest-GroupsV314Test-549425539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:50:52 devstack sudo[104282]: pam_unix(sudo:session): session closed for user root Jun 17 05:50:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-df257ff6-196c-4ee5-831c-1aa76265c2e9" returned: 0 in 0.705s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:50:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-df257ff6-196c-4ee5-831c-1aa76265c2e9.ef9300ca-c9c4-4ccd-a136-1796a3805bde {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:50:52 devstack sudo[104287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-df257ff6-196c-4ee5-831c-1aa76265c2e9.ef9300ca-c9c4-4ccd-a136-1796a3805bde Jun 17 05:50:52 devstack sudo[104287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:50:52 devstack sudo[104287]: pam_unix(sudo:session): session closed for user root Jun 17 05:50:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-df257ff6-196c-4ee5-831c-1aa76265c2e9.ef9300ca-c9c4-4ccd-a136-1796a3805bde" returned: 0 in 0.694s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:50:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-df257ff6-196c-4ee5-831c-1aa76265c2e9.ef9300ca-c9c4-4ccd-a136-1796a3805bde {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:50:52 devstack sudo[104293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-df257ff6-196c-4ee5-831c-1aa76265c2e9.ef9300ca-c9c4-4ccd-a136-1796a3805bde Jun 17 05:50:52 devstack sudo[104293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:50:53 devstack sudo[104293]: pam_unix(sudo:session): session closed for user root Jun 17 05:50:53 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-df257ff6-196c-4ee5-831c-1aa76265c2e9.ef9300ca-c9c4-4ccd-a136-1796a3805bde" returned: 0 in 0.603s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:50:53 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] Lock "cinder-quobyte-ef9300ca-c9c4-4ccd-a136-1796a3805bde" released by "_delete_snapshot" :: held 2.801s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:50:53 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.632s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:50:53 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-341241bb-3f91-48d7-919f-47359842d248 req-4dcd935b-7c43-4351-9af1-db9267b27d9f tempest-TestServerVolumeAttachmentScenario-875878610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 8.216s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:50:53 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (518465e5-6d7c-4920-bd4f-f243c88a0030) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de53ebf7-cc4b-435c-b4af-459b16314629', 'volume_size': 2, 'source_volid': 'df257ff6-196c-4ee5-831c-1aa76265c2e9', 'source_volstatus': 'available'}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:50:53 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e5a54e6-4096-4a35-a904-ea0e7ba37414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:50:53 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f787a12-1a20-4b38-805f-55d3c277c5d5]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:50:53 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-341241bb-3f91-48d7-919f-47359842d248 req-4dcd935b-7c43-4351-9af1-db9267b27d9f tempest-TestServerVolumeAttachmentScenario-875878610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-fa25d0a5-e5bb-4bce-a035-5989951230bd {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:50:53 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] Volume volume-de53ebf7-cc4b-435c-b4af-459b16314629 (de53ebf7-cc4b-435c-b4af-459b16314629): created successfully Jun 17 05:50:53 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e5a54e6-4096-4a35-a904-ea0e7ba37414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:50:53 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] Flow 'volume_create_manager' (aeb76496-0795-460c-ad98-50c6e622be88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:50:53 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-8d55b5b5-a1f1-43a7-ada1-d2a2c30cdb08 tempest-VolumesCloneTest-945717238 None] Created volume successfully. Jun 17 05:50:53 devstack sudo[104296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-fa25d0a5-e5bb-4bce-a035-5989951230bd Jun 17 05:50:53 devstack sudo[104296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:50:54 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-f274c127-e78c-4d90-a801-489367866285 tempest-VolumesCloneTest-945717238 None] Acquiring lock "cinder-de53ebf7-cc4b-435c-b4af-459b16314629-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:50:54 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-f274c127-e78c-4d90-a801-489367866285 tempest-VolumesCloneTest-945717238 None] Lock "cinder-de53ebf7-cc4b-435c-b4af-459b16314629-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:50:54 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-f274c127-e78c-4d90-a801-489367866285 tempest-VolumesCloneTest-945717238 None] Acquiring lock "cinder-quobyte-de53ebf7-cc4b-435c-b4af-459b16314629" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:50:54 devstack sudo[104296]: pam_unix(sudo:session): session closed for user root Jun 17 05:50:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-341241bb-3f91-48d7-919f-47359842d248 req-4dcd935b-7c43-4351-9af1-db9267b27d9f tempest-TestServerVolumeAttachmentScenario-875878610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-fa25d0a5-e5bb-4bce-a035-5989951230bd" returned: 0 in 0.734s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:50:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-341241bb-3f91-48d7-919f-47359842d248 req-4dcd935b-7c43-4351-9af1-db9267b27d9f tempest-TestServerVolumeAttachmentScenario-875878610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.760s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:50:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e6beb126-7aca-4fe0-b7be-ffd183f5c625 tempest-GroupsV314Test-549425539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.457s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:50:54 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-e6beb126-7aca-4fe0-b7be-ffd183f5c625 tempest-GroupsV314Test-549425539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d3e91cda-1702-40ca-aa5a-1a5279883f77,created_at=2026-06-17T03:50:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1247317634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d3e91cda-1702-40ca-aa5a-1a5279883f77,host='devstack@QuobyteHD#QuobyteHD',id=336af048-c51c-4c42-9d98-c85b28b6b5e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a63b3df5404248eb962e7679f7a2f39a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:50:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:50:52Z,use_quota=True,user_id='41885d67d86a42f6ad5b4ddc62fb50f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(014a7dcd-d108-4d16-b644-b99db0a80d37),volume_type_id=014a7dcd-d108-4d16-b644-b99db0a80d37)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:50:54 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-e6beb126-7aca-4fe0-b7be-ffd183f5c625 tempest-GroupsV314Test-549425539 None] Creating volume 336af048-c51c-4c42-9d98-c85b28b6b5e0 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:50:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e6beb126-7aca-4fe0-b7be-ffd183f5c625 tempest-GroupsV314Test-549425539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:50:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e6beb126-7aca-4fe0-b7be-ffd183f5c625 tempest-GroupsV314Test-549425539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:50:54 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-e6beb126-7aca-4fe0-b7be-ffd183f5c625 tempest-GroupsV314Test-549425539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:50:54 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-e6beb126-7aca-4fe0-b7be-ffd183f5c625 tempest-GroupsV314Test-549425539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:50:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e6beb126-7aca-4fe0-b7be-ffd183f5c625 tempest-GroupsV314Test-549425539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:50:54 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-e6beb126-7aca-4fe0-b7be-ffd183f5c625 tempest-GroupsV314Test-549425539 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:50:54 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-e6beb126-7aca-4fe0-b7be-ffd183f5c625 tempest-GroupsV314Test-549425539 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:50:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e6beb126-7aca-4fe0-b7be-ffd183f5c625 tempest-GroupsV314Test-549425539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-336af048-c51c-4c42-9d98-c85b28b6b5e0 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:50:54 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-f274c127-e78c-4d90-a801-489367866285 tempest-VolumesCloneTest-945717238 None] Lock "cinder-quobyte-de53ebf7-cc4b-435c-b4af-459b16314629" acquired by "delete_volume" :: waited 0.071s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:50:54 devstack sudo[104308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-336af048-c51c-4c42-9d98-c85b28b6b5e0 1073741824 Jun 17 05:50:54 devstack sudo[104308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:50:54 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c63e056-7a65-42f4-8b20-0cbc6585c86a]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:50:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f274c127-e78c-4d90-a801-489367866285 tempest-VolumesCloneTest-945717238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-de53ebf7-cc4b-435c-b4af-459b16314629 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:50:54 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [req-341241bb-3f91-48d7-919f-47359842d248 req-4dcd935b-7c43-4351-9af1-db9267b27d9f tempest-TestServerVolumeAttachmentScenario-875878610 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f', 'name': 'volume-fa25d0a5-e5bb-4bce-a035-5989951230bd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '518e2455-a8fa-4d04-8e15-68eba94d0341', 'enforce_multipath': True} {{(pid=92083) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 17 05:50:54 devstack cinder-volume[92083]: INFO cinder.volume.manager [req-341241bb-3f91-48d7-919f-47359842d248 req-4dcd935b-7c43-4351-9af1-db9267b27d9f tempest-TestServerVolumeAttachmentScenario-875878610 None] attachment_update completed successfully. Jun 17 05:50:54 devstack sudo[104310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-de53ebf7-cc4b-435c-b4af-459b16314629 Jun 17 05:50:54 devstack sudo[104310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:50:55 devstack sudo[104310]: pam_unix(sudo:session): session closed for user root Jun 17 05:50:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f274c127-e78c-4d90-a801-489367866285 tempest-VolumesCloneTest-945717238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-de53ebf7-cc4b-435c-b4af-459b16314629" returned: 0 in 0.792s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:50:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f274c127-e78c-4d90-a801-489367866285 tempest-VolumesCloneTest-945717238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-de53ebf7-cc4b-435c-b4af-459b16314629 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:50:55 devstack sudo[104387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-de53ebf7-cc4b-435c-b4af-459b16314629 Jun 17 05:50:55 devstack sudo[104387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:50:55 devstack sudo[104308]: pam_unix(sudo:session): session closed for user root Jun 17 05:50:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e6beb126-7aca-4fe0-b7be-ffd183f5c625 tempest-GroupsV314Test-549425539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-336af048-c51c-4c42-9d98-c85b28b6b5e0 1073741824" returned: 0 in 0.885s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:50:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e6beb126-7aca-4fe0-b7be-ffd183f5c625 tempest-GroupsV314Test-549425539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-336af048-c51c-4c42-9d98-c85b28b6b5e0 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:50:55 devstack sudo[104389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-336af048-c51c-4c42-9d98-c85b28b6b5e0 Jun 17 05:50:55 devstack sudo[104389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:50:55 devstack sudo[104387]: pam_unix(sudo:session): session closed for user root Jun 17 05:50:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f274c127-e78c-4d90-a801-489367866285 tempest-VolumesCloneTest-945717238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-de53ebf7-cc4b-435c-b4af-459b16314629" returned: 0 in 0.619s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:50:55 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-f274c127-e78c-4d90-a801-489367866285 tempest-VolumesCloneTest-945717238 None] Lock "cinder-quobyte-de53ebf7-cc4b-435c-b4af-459b16314629" released by "delete_volume" :: held 1.459s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:50:55 devstack sudo[104389]: pam_unix(sudo:session): session closed for user root Jun 17 05:50:55 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-f274c127-e78c-4d90-a801-489367866285 tempest-VolumesCloneTest-945717238 None] Created reservations ['13886ab8-8f39-4e5d-b40d-acd31f5488a8', '307e888d-bb3a-44f9-a627-931e3154b628', 'c16af580-a30c-4f5d-983e-779d383684ea', '7d77c0cc-60c8-4988-bd8f-f4d9dbeed099'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:50:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e6beb126-7aca-4fe0-b7be-ffd183f5c625 tempest-GroupsV314Test-549425539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-336af048-c51c-4c42-9d98-c85b28b6b5e0" returned: 0 in 0.684s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:50:55 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-e6beb126-7aca-4fe0-b7be-ffd183f5c625 tempest-GroupsV314Test-549425539 None] <== create_volume: return (1613ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:50:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e6beb126-7aca-4fe0-b7be-ffd183f5c625 tempest-GroupsV314Test-549425539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.616s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:50:56 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e6beb126-7aca-4fe0-b7be-ffd183f5c625 tempest-GroupsV314Test-549425539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64cf1aca-6b53-4e9e-b74c-dab149065c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-336af048-c51c-4c42-9d98-c85b28b6b5e0', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:50:56 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e6beb126-7aca-4fe0-b7be-ffd183f5c625 tempest-GroupsV314Test-549425539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (376cb5bc-00b7-46fa-908b-1575d60f1d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:50:56 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-e6beb126-7aca-4fe0-b7be-ffd183f5c625 tempest-GroupsV314Test-549425539 None] Volume volume-336af048-c51c-4c42-9d98-c85b28b6b5e0 (336af048-c51c-4c42-9d98-c85b28b6b5e0): created successfully Jun 17 05:50:56 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e6beb126-7aca-4fe0-b7be-ffd183f5c625 tempest-GroupsV314Test-549425539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (376cb5bc-00b7-46fa-908b-1575d60f1d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:50:56 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e6beb126-7aca-4fe0-b7be-ffd183f5c625 tempest-GroupsV314Test-549425539 None] Flow 'volume_create_manager' (0c8a3d05-9933-485d-a729-cfbe2d1fae24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:50:56 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-e6beb126-7aca-4fe0-b7be-ffd183f5c625 tempest-GroupsV314Test-549425539 None] Created volume successfully. Jun 17 05:50:56 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-f274c127-e78c-4d90-a801-489367866285 tempest-VolumesCloneTest-945717238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:50:56 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-f274c127-e78c-4d90-a801-489367866285 tempest-VolumesCloneTest-945717238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:50:56 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-f274c127-e78c-4d90-a801-489367866285 tempest-VolumesCloneTest-945717238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:50:56 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-f274c127-e78c-4d90-a801-489367866285 tempest-VolumesCloneTest-945717238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:50:56 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-f274c127-e78c-4d90-a801-489367866285 tempest-VolumesCloneTest-945717238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:50:56 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f274c127-e78c-4d90-a801-489367866285 tempest-VolumesCloneTest-945717238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:50:56 devstack sudo[104709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:50:56 devstack sudo[104709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:50:56 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-285c0a8f-6c95-48a4-ac3b-e91d64814e61 tempest-VolumesCloneTest-945717238 None] Acquiring lock "cinder-df257ff6-196c-4ee5-831c-1aa76265c2e9-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:50:56 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-285c0a8f-6c95-48a4-ac3b-e91d64814e61 tempest-VolumesCloneTest-945717238 None] Lock "cinder-df257ff6-196c-4ee5-831c-1aa76265c2e9-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:50:56 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-285c0a8f-6c95-48a4-ac3b-e91d64814e61 tempest-VolumesCloneTest-945717238 None] Acquiring lock "cinder-quobyte-df257ff6-196c-4ee5-831c-1aa76265c2e9" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:50:56 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-285c0a8f-6c95-48a4-ac3b-e91d64814e61 tempest-VolumesCloneTest-945717238 None] Lock "cinder-quobyte-df257ff6-196c-4ee5-831c-1aa76265c2e9" acquired by "delete_volume" :: waited 0.015s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:50:56 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[51975761-63d4-488a-b954-86d1a7efd2c0]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:50:56 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-285c0a8f-6c95-48a4-ac3b-e91d64814e61 tempest-VolumesCloneTest-945717238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-df257ff6-196c-4ee5-831c-1aa76265c2e9 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:50:56 devstack sudo[104709]: pam_unix(sudo:session): session closed for user root Jun 17 05:50:56 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f274c127-e78c-4d90-a801-489367866285 tempest-VolumesCloneTest-945717238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.635s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:50:56 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-f274c127-e78c-4d90-a801-489367866285 tempest-VolumesCloneTest-945717238 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:50:56 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-f274c127-e78c-4d90-a801-489367866285 tempest-VolumesCloneTest-945717238 None] Deleted volume successfully. Jun 17 05:50:56 devstack sudo[104712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-df257ff6-196c-4ee5-831c-1aa76265c2e9 Jun 17 05:50:56 devstack sudo[104712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:50:56 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-f274c127-e78c-4d90-a801-489367866285 tempest-VolumesCloneTest-945717238 None] Lock "cinder-de53ebf7-cc4b-435c-b4af-459b16314629-delete_volume" released by "delete_volume" :: held 2.519s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:50:57 devstack cinder-volume[92083]: DEBUG dbcounter [-] [92083] Writing DB stats cinder:SELECT=68,cinder:UPDATE=61,cinder:INSERT=16,cinder:DELETE=4 {{(pid=92083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:50:57 devstack cinder-volume[92083]: DEBUG dbcounter [-] [92083] Writing DB stats cinder:UPDATE=72,cinder:SELECT=58,cinder:DELETE=5,cinder:INSERT=14 {{(pid=92083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:50:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e4cb091e-54d6-4359-b4e3-9ed07b547faa tempest-GroupsV314Test-549425539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:50:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e4cb091e-54d6-4359-b4e3-9ed07b547faa tempest-GroupsV314Test-549425539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:50:57 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-e4cb091e-54d6-4359-b4e3-9ed07b547faa tempest-GroupsV314Test-549425539 None] Cloning volume 336af048-c51c-4c42-9d98-c85b28b6b5e0 to volume 366c5a24-e9be-4c15-bba8-762017247ab9 Jun 17 05:50:57 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-e4cb091e-54d6-4359-b4e3-9ed07b547faa tempest-GroupsV314Test-549425539 None] Creating offline snapshot 57a1dc8d-5289-495c-88bb-902e513d966d of volume 336af048-c51c-4c42-9d98-c85b28b6b5e0 {{(pid=92083) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 17 05:50:57 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[db52cce7-9803-4d8d-8b05-be1bc0c4237f]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:50:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e4cb091e-54d6-4359-b4e3-9ed07b547faa tempest-GroupsV314Test-549425539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-336af048-c51c-4c42-9d98-c85b28b6b5e0 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:50:57 devstack sudo[104717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-336af048-c51c-4c42-9d98-c85b28b6b5e0 Jun 17 05:50:57 devstack sudo[104717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:50:57 devstack sudo[104712]: pam_unix(sudo:session): session closed for user root Jun 17 05:50:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-285c0a8f-6c95-48a4-ac3b-e91d64814e61 tempest-VolumesCloneTest-945717238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-df257ff6-196c-4ee5-831c-1aa76265c2e9" returned: 0 in 0.767s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:50:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-285c0a8f-6c95-48a4-ac3b-e91d64814e61 tempest-VolumesCloneTest-945717238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-df257ff6-196c-4ee5-831c-1aa76265c2e9 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:50:57 devstack sudo[104719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-df257ff6-196c-4ee5-831c-1aa76265c2e9 Jun 17 05:50:57 devstack sudo[104719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:50:58 devstack sudo[104719]: pam_unix(sudo:session): session closed for user root Jun 17 05:50:58 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-285c0a8f-6c95-48a4-ac3b-e91d64814e61 tempest-VolumesCloneTest-945717238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-df257ff6-196c-4ee5-831c-1aa76265c2e9" returned: 0 in 0.587s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:50:58 devstack sudo[104717]: pam_unix(sudo:session): session closed for user root Jun 17 05:50:58 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-285c0a8f-6c95-48a4-ac3b-e91d64814e61 tempest-VolumesCloneTest-945717238 None] Lock "cinder-quobyte-df257ff6-196c-4ee5-831c-1aa76265c2e9" released by "delete_volume" :: held 1.415s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:50:58 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e4cb091e-54d6-4359-b4e3-9ed07b547faa tempest-GroupsV314Test-549425539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-336af048-c51c-4c42-9d98-c85b28b6b5e0" returned: 0 in 0.734s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:50:58 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e4cb091e-54d6-4359-b4e3-9ed07b547faa tempest-GroupsV314Test-549425539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-336af048-c51c-4c42-9d98-c85b28b6b5e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-336af048-c51c-4c42-9d98-c85b28b6b5e0.57a1dc8d-5289-495c-88bb-902e513d966d 1G {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:50:58 devstack sudo[104725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-336af048-c51c-4c42-9d98-c85b28b6b5e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-336af048-c51c-4c42-9d98-c85b28b6b5e0.57a1dc8d-5289-495c-88bb-902e513d966d 1G Jun 17 05:50:58 devstack sudo[104725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:50:58 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-285c0a8f-6c95-48a4-ac3b-e91d64814e61 tempest-VolumesCloneTest-945717238 None] Created reservations ['d9349a95-96c2-4ae4-9766-7fcaf97eed67', 'ea6f827e-06ac-4c79-b25f-47693b29a254', '369bd882-9e1a-411a-8cf2-7a6318aaf4a4', '09aece71-4a39-4067-9066-e3d8f94147d4'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:50:58 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-285c0a8f-6c95-48a4-ac3b-e91d64814e61 tempest-VolumesCloneTest-945717238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:50:58 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-285c0a8f-6c95-48a4-ac3b-e91d64814e61 tempest-VolumesCloneTest-945717238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:50:58 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-285c0a8f-6c95-48a4-ac3b-e91d64814e61 tempest-VolumesCloneTest-945717238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:50:58 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-285c0a8f-6c95-48a4-ac3b-e91d64814e61 tempest-VolumesCloneTest-945717238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:50:58 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-285c0a8f-6c95-48a4-ac3b-e91d64814e61 tempest-VolumesCloneTest-945717238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:50:58 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-285c0a8f-6c95-48a4-ac3b-e91d64814e61 tempest-VolumesCloneTest-945717238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:50:58 devstack sudo[104727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:50:58 devstack sudo[104727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:50:58 devstack sudo[104727]: pam_unix(sudo:session): session closed for user root Jun 17 05:50:58 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-285c0a8f-6c95-48a4-ac3b-e91d64814e61 tempest-VolumesCloneTest-945717238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.626s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:50:58 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-285c0a8f-6c95-48a4-ac3b-e91d64814e61 tempest-VolumesCloneTest-945717238 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:50:58 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-285c0a8f-6c95-48a4-ac3b-e91d64814e61 tempest-VolumesCloneTest-945717238 None] Deleted volume successfully. Jun 17 05:50:58 devstack sudo[104725]: pam_unix(sudo:session): session closed for user root Jun 17 05:50:58 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e4cb091e-54d6-4359-b4e3-9ed07b547faa tempest-GroupsV314Test-549425539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-336af048-c51c-4c42-9d98-c85b28b6b5e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-336af048-c51c-4c42-9d98-c85b28b6b5e0.57a1dc8d-5289-495c-88bb-902e513d966d 1G" returned: 0 in 0.790s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:50:58 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-285c0a8f-6c95-48a4-ac3b-e91d64814e61 tempest-VolumesCloneTest-945717238 None] Lock "cinder-df257ff6-196c-4ee5-831c-1aa76265c2e9-delete_volume" released by "delete_volume" :: held 2.261s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:50:58 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e4cb091e-54d6-4359-b4e3-9ed07b547faa tempest-GroupsV314Test-549425539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-336af048-c51c-4c42-9d98-c85b28b6b5e0 -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-336af048-c51c-4c42-9d98-c85b28b6b5e0.57a1dc8d-5289-495c-88bb-902e513d966d {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:50:58 devstack sudo[104733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-336af048-c51c-4c42-9d98-c85b28b6b5e0 -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-336af048-c51c-4c42-9d98-c85b28b6b5e0.57a1dc8d-5289-495c-88bb-902e513d966d Jun 17 05:50:58 devstack sudo[104733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:50:59 devstack sudo[104733]: pam_unix(sudo:session): session closed for user root Jun 17 05:50:59 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e4cb091e-54d6-4359-b4e3-9ed07b547faa tempest-GroupsV314Test-549425539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-336af048-c51c-4c42-9d98-c85b28b6b5e0 -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-336af048-c51c-4c42-9d98-c85b28b6b5e0.57a1dc8d-5289-495c-88bb-902e513d966d" returned: 0 in 0.722s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:50:59 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [None req-e4cb091e-54d6-4359-b4e3-9ed07b547faa tempest-GroupsV314Test-549425539 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-336af048-c51c-4c42-9d98-c85b28b6b5e0.57a1dc8d-5289-495c-88bb-902e513d966d is being set with open permissions: ugo+rw: NotImplementedError Jun 17 05:50:59 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e4cb091e-54d6-4359-b4e3-9ed07b547faa tempest-GroupsV314Test-549425539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-336af048-c51c-4c42-9d98-c85b28b6b5e0.57a1dc8d-5289-495c-88bb-902e513d966d {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:50:59 devstack sudo[104739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-336af048-c51c-4c42-9d98-c85b28b6b5e0.57a1dc8d-5289-495c-88bb-902e513d966d Jun 17 05:50:59 devstack sudo[104739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:00 devstack sudo[104739]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:00 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e4cb091e-54d6-4359-b4e3-9ed07b547faa tempest-GroupsV314Test-549425539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-336af048-c51c-4c42-9d98-c85b28b6b5e0.57a1dc8d-5289-495c-88bb-902e513d966d" returned: 0 in 0.649s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:00 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e4cb091e-54d6-4359-b4e3-9ed07b547faa tempest-GroupsV314Test-549425539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-336af048-c51c-4c42-9d98-c85b28b6b5e0.info {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:00 devstack sudo[104742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-336af048-c51c-4c42-9d98-c85b28b6b5e0.info Jun 17 05:51:00 devstack sudo[104742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:00 devstack sudo[104742]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:00 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e4cb091e-54d6-4359-b4e3-9ed07b547faa tempest-GroupsV314Test-549425539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-336af048-c51c-4c42-9d98-c85b28b6b5e0.info" returned: 0 in 0.627s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:00 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [None req-e4cb091e-54d6-4359-b4e3-9ed07b547faa tempest-GroupsV314Test-549425539 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-336af048-c51c-4c42-9d98-c85b28b6b5e0.info is being set with open permissions: ugo+rw: NotImplementedError Jun 17 05:51:00 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e4cb091e-54d6-4359-b4e3-9ed07b547faa tempest-GroupsV314Test-549425539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-336af048-c51c-4c42-9d98-c85b28b6b5e0.info {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:00 devstack sudo[104745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-336af048-c51c-4c42-9d98-c85b28b6b5e0.info Jun 17 05:51:00 devstack sudo[104745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:01 devstack sudo[104745]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:01 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e4cb091e-54d6-4359-b4e3-9ed07b547faa tempest-GroupsV314Test-549425539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-336af048-c51c-4c42-9d98-c85b28b6b5e0.info" returned: 0 in 0.614s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:01 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-e4cb091e-54d6-4359-b4e3-9ed07b547faa tempest-GroupsV314Test-549425539 None] Acquiring lock "cinder-quobyte-366c5a24-e9be-4c15-bba8-762017247ab9" by "_copy_volume_from_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:51:01 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-e4cb091e-54d6-4359-b4e3-9ed07b547faa tempest-GroupsV314Test-549425539 None] Lock "cinder-quobyte-366c5a24-e9be-4c15-bba8-762017247ab9" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:51:01 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-e4cb091e-54d6-4359-b4e3-9ed07b547faa tempest-GroupsV314Test-549425539 None] snapshot: 57a1dc8d-5289-495c-88bb-902e513d966d, volume: 366c5a24-e9be-4c15-bba8-762017247ab9, {{(pid=92083) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 17 05:51:01 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e4cb091e-54d6-4359-b4e3-9ed07b547faa tempest-GroupsV314Test-549425539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:51:01 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e4cb091e-54d6-4359-b4e3-9ed07b547faa tempest-GroupsV314Test-549425539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:51:01 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-e4cb091e-54d6-4359-b4e3-9ed07b547faa tempest-GroupsV314Test-549425539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:51:01 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-e4cb091e-54d6-4359-b4e3-9ed07b547faa tempest-GroupsV314Test-549425539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:51:01 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e4cb091e-54d6-4359-b4e3-9ed07b547faa tempest-GroupsV314Test-549425539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:51:01 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[a751be00-f4e7-4946-9a87-ee58ddf6c396]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:51:01 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e4cb091e-54d6-4359-b4e3-9ed07b547faa tempest-GroupsV314Test-549425539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-336af048-c51c-4c42-9d98-c85b28b6b5e0.57a1dc8d-5289-495c-88bb-902e513d966d {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:01 devstack sudo[104748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-336af048-c51c-4c42-9d98-c85b28b6b5e0.57a1dc8d-5289-495c-88bb-902e513d966d Jun 17 05:51:01 devstack sudo[104748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:02 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-da014f82-639a-4195-803d-e1c28cf792e2 tempest-VolumesExtendTest-1772209352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:51:02 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-da014f82-639a-4195-803d-e1c28cf792e2 tempest-VolumesExtendTest-1772209352 None] Flow 'volume_create_manager' (4cbda567-8789-41f3-91d8-0a122844ddae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:51:02 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-da014f82-639a-4195-803d-e1c28cf792e2 tempest-VolumesExtendTest-1772209352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c78652c8-fddd-496b-8476-00709d73f8cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:51:02 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-da014f82-639a-4195-803d-e1c28cf792e2 tempest-VolumesExtendTest-1772209352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c78652c8-fddd-496b-8476-00709d73f8cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:51:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-470690871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c20ba84-2fb8-46bd-b149-48b5fcde2faa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8f9befcec2644509202bd6b3045c710',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:51:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:51:02Z,use_quota=True,user_id='7f9b6f6bfab64f0fa5c665e4c590dae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:51:02 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-da014f82-639a-4195-803d-e1c28cf792e2 tempest-VolumesExtendTest-1772209352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c4f6fcd-9dce-42e5-b15d-ae38f3032801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:51:02 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-da014f82-639a-4195-803d-e1c28cf792e2 tempest-VolumesExtendTest-1772209352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c4f6fcd-9dce-42e5-b15d-ae38f3032801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:51:02 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-da014f82-639a-4195-803d-e1c28cf792e2 tempest-VolumesExtendTest-1772209352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0fdd853-43af-4f31-9ebb-a91a4ac67da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:51:02 devstack cinder-volume[92083]: DEBUG cinder.image.glance [None req-da014f82-639a-4195-803d-e1c28cf792e2 tempest-VolumesExtendTest-1772209352 None] Creating Keystone auth plugin from conf {{(pid=92083) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 17 05:51:02 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-da014f82-639a-4195-803d-e1c28cf792e2 tempest-VolumesExtendTest-1772209352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0fdd853-43af-4f31-9ebb-a91a4ac67da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7c20ba84-2fb8-46bd-b149-48b5fcde2faa', 'volume_name': 'volume-7c20ba84-2fb8-46bd-b149-48b5fcde2faa', 'volume_size': 1, 'image_id': '3a392502-bf92-4019-8ad1-5b48db42b20f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3a392502-bf92-4019-8ad1-5b48db42b20f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd68ea14f86c14b8aac202e298736b075', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3a392502-bf92-4019-8ad1-5b48db42b20f', 'created_at': datetime.datetime(2026, 6, 17, 3, 31, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 3, 31, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3a392502-bf92-4019-8ad1-5b48db42b20f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:51:02 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-da014f82-639a-4195-803d-e1c28cf792e2 tempest-VolumesExtendTest-1772209352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ce0494e-4adf-41a1-80a0-76fb0ac8e638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:51:02 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-da014f82-639a-4195-803d-e1c28cf792e2 tempest-VolumesExtendTest-1772209352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ce0494e-4adf-41a1-80a0-76fb0ac8e638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:51:02 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-da014f82-639a-4195-803d-e1c28cf792e2 tempest-VolumesExtendTest-1772209352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (629ab2a2-8057-4661-a2b7-a98c4f18ace2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:51:02 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-da014f82-639a-4195-803d-e1c28cf792e2 tempest-VolumesExtendTest-1772209352 None] Volume 7c20ba84-2fb8-46bd-b149-48b5fcde2faa: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7c20ba84-2fb8-46bd-b149-48b5fcde2faa', 'volume_size': 1, 'image_id': '3a392502-bf92-4019-8ad1-5b48db42b20f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3a392502-bf92-4019-8ad1-5b48db42b20f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd68ea14f86c14b8aac202e298736b075', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3a392502-bf92-4019-8ad1-5b48db42b20f', 'created_at': datetime.datetime(2026, 6, 17, 3, 31, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 3, 31, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3a392502-bf92-4019-8ad1-5b48db42b20f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 17 05:51:02 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-da014f82-639a-4195-803d-e1c28cf792e2 tempest-VolumesExtendTest-1772209352 None] Trying to clone 7c20ba84-2fb8-46bd-b149-48b5fcde2faa from image 3a392502-bf92-4019-8ad1-5b48db42b20f at location (None, [{'url': 'file:///opt/stack/data/glance/images/3a392502-bf92-4019-8ad1-5b48db42b20f', 'metadata': {}}]). {{(pid=92083) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 17 05:51:02 devstack sudo[104748]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:02 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e4cb091e-54d6-4359-b4e3-9ed07b547faa tempest-GroupsV314Test-549425539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-336af048-c51c-4c42-9d98-c85b28b6b5e0.57a1dc8d-5289-495c-88bb-902e513d966d" returned: 0 in 0.851s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:02 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-e4cb091e-54d6-4359-b4e3-9ed07b547faa tempest-GroupsV314Test-549425539 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-336af048-c51c-4c42-9d98-c85b28b6b5e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92083) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 05:51:02 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-e4cb091e-54d6-4359-b4e3-9ed07b547faa tempest-GroupsV314Test-549425539 None] will copy from snapshot at /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-336af048-c51c-4c42-9d98-c85b28b6b5e0 {{(pid=92083) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 17 05:51:02 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-e4cb091e-54d6-4359-b4e3-9ed07b547faa tempest-GroupsV314Test-549425539 None] Creating direct copy from snapshot {{(pid=92083) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 17 05:51:02 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[057f87d9-7138-4173-8dee-82e6319aacaa]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:51:02 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e4cb091e-54d6-4359-b4e3-9ed07b547faa tempest-GroupsV314Test-549425539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-336af048-c51c-4c42-9d98-c85b28b6b5e0 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:02 devstack sudo[104753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-336af048-c51c-4c42-9d98-c85b28b6b5e0 Jun 17 05:51:02 devstack sudo[104753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:02 devstack cinder-volume[92083]: DEBUG cinder.image.image_utils [None req-da014f82-639a-4195-803d-e1c28cf792e2 tempest-VolumesExtendTest-1772209352 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3a392502-bf92-4019-8ad1-5b48db42b20f_dydqjlkgdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=92083) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 17 05:51:02 devstack cinder-volume[92083]: INFO cinder.image.image_utils [None req-da014f82-639a-4195-803d-e1c28cf792e2 tempest-VolumesExtendTest-1772209352 None] Image download 20.69 MB at 20.69 MB/s Jun 17 05:51:02 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[775084c2-a679-4fbc-aad0-38fc953b0f6e]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:51:02 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-da014f82-639a-4195-803d-e1c28cf792e2 tempest-VolumesExtendTest-1772209352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a392502-bf92-4019-8ad1-5b48db42b20f_dydqjlkgdevstack@QuobyteHD {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:02 devstack sudo[104756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a392502-bf92-4019-8ad1-5b48db42b20f_dydqjlkgdevstack@QuobyteHD Jun 17 05:51:02 devstack sudo[104756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:03 devstack sudo[104753]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:03 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e4cb091e-54d6-4359-b4e3-9ed07b547faa tempest-GroupsV314Test-549425539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-336af048-c51c-4c42-9d98-c85b28b6b5e0" returned: 0 in 0.789s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:03 devstack cinder-volume[92083]: DEBUG cinder.utils [None req-e4cb091e-54d6-4359-b4e3-9ed07b547faa tempest-GroupsV314Test-549425539 None] Path /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-366c5a24-e9be-4c15-bba8-762017247ab9 not found in is_blk_device check {{(pid=92083) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 17 05:51:03 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e4cb091e-54d6-4359-b4e3-9ed07b547faa tempest-GroupsV314Test-549425539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-336af048-c51c-4c42-9d98-c85b28b6b5e0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-366c5a24-e9be-4c15-bba8-762017247ab9 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:03 devstack sudo[104761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-336af048-c51c-4c42-9d98-c85b28b6b5e0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-366c5a24-e9be-4c15-bba8-762017247ab9 Jun 17 05:51:03 devstack sudo[104761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:03 devstack sudo[104756]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:03 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-da014f82-639a-4195-803d-e1c28cf792e2 tempest-VolumesExtendTest-1772209352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a392502-bf92-4019-8ad1-5b48db42b20f_dydqjlkgdevstack@QuobyteHD" returned: 0 in 0.744s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:03 devstack cinder-volume[92083]: DEBUG cinder.image.image_utils [None req-da014f82-639a-4195-803d-e1c28cf792e2 tempest-VolumesExtendTest-1772209352 None] Temporary image 3a392502-bf92-4019-8ad1-5b48db42b20f is fetched for user 7f9b6f6bfab64f0fa5c665e4c590dae6. {{(pid=92083) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 17 05:51:03 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[712359ef-8aaa-4983-a51b-1a6f5a50588e]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:51:03 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-da014f82-639a-4195-803d-e1c28cf792e2 tempest-VolumesExtendTest-1772209352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a392502-bf92-4019-8ad1-5b48db42b20f_dydqjlkgdevstack@QuobyteHD {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:03 devstack sudo[104766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a392502-bf92-4019-8ad1-5b48db42b20f_dydqjlkgdevstack@QuobyteHD Jun 17 05:51:03 devstack sudo[104766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:04 devstack sudo[104766]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:04 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-da014f82-639a-4195-803d-e1c28cf792e2 tempest-VolumesExtendTest-1772209352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a392502-bf92-4019-8ad1-5b48db42b20f_dydqjlkgdevstack@QuobyteHD" returned: 0 in 1.330s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:04 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-da014f82-639a-4195-803d-e1c28cf792e2 tempest-VolumesExtendTest-1772209352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:51:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-ecd4463c-89c2-417f-898f-2b446a5c7697 req-d048d037-4453-4946-85ba-a831dc179e40 tempest-TestServerVolumeAttachmentScenario-875878610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:51:08 devstack sudo[104761]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e4cb091e-54d6-4359-b4e3-9ed07b547faa tempest-GroupsV314Test-549425539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-336af048-c51c-4c42-9d98-c85b28b6b5e0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-366c5a24-e9be-4c15-bba8-762017247ab9" returned: 0 in 4.901s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:08 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a8b3a1-e643-435b-b045-7e802423fefa]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:51:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e4cb091e-54d6-4359-b4e3-9ed07b547faa tempest-GroupsV314Test-549425539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-336af048-c51c-4c42-9d98-c85b28b6b5e0 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:08 devstack sudo[104790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-336af048-c51c-4c42-9d98-c85b28b6b5e0 Jun 17 05:51:08 devstack sudo[104790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:09 devstack sudo[104790]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e4cb091e-54d6-4359-b4e3-9ed07b547faa tempest-GroupsV314Test-549425539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-336af048-c51c-4c42-9d98-c85b28b6b5e0" returned: 0 in 0.862s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:09 devstack cinder-volume[92083]: DEBUG cinder.image.image_utils [None req-e4cb091e-54d6-4359-b4e3-9ed07b547faa tempest-GroupsV314Test-549425539 None] Image conversion details: src /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-336af048-c51c-4c42-9d98-c85b28b6b5e0, size 1024.00 MB, duration 4.90 sec, destination /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-366c5a24-e9be-4c15-bba8-762017247ab9 {{(pid=92083) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 17 05:51:09 devstack cinder-volume[92083]: INFO cinder.image.image_utils [None req-e4cb091e-54d6-4359-b4e3-9ed07b547faa tempest-GroupsV314Test-549425539 None] Converted 1024.00 MB image at 208.90 MB/s Jun 17 05:51:09 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [None req-e4cb091e-54d6-4359-b4e3-9ed07b547faa tempest-GroupsV314Test-549425539 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-366c5a24-e9be-4c15-bba8-762017247ab9 is being set with open permissions: ugo+rw: NotImplementedError Jun 17 05:51:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e4cb091e-54d6-4359-b4e3-9ed07b547faa tempest-GroupsV314Test-549425539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-366c5a24-e9be-4c15-bba8-762017247ab9 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:09 devstack sudo[104797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-366c5a24-e9be-4c15-bba8-762017247ab9 Jun 17 05:51:09 devstack sudo[104797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:09 devstack sudo[104797]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e4cb091e-54d6-4359-b4e3-9ed07b547faa tempest-GroupsV314Test-549425539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-366c5a24-e9be-4c15-bba8-762017247ab9" returned: 0 in 0.573s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:09 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-e4cb091e-54d6-4359-b4e3-9ed07b547faa tempest-GroupsV314Test-549425539 None] Lock "cinder-quobyte-366c5a24-e9be-4c15-bba8-762017247ab9" released by "_copy_volume_from_snapshot" :: held 8.082s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:51:09 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-e4cb091e-54d6-4359-b4e3-9ed07b547faa tempest-GroupsV314Test-549425539 None] Acquiring lock "cinder-quobyte-57a1dc8d-5289-495c-88bb-902e513d966d" by "_delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:51:09 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-e4cb091e-54d6-4359-b4e3-9ed07b547faa tempest-GroupsV314Test-549425539 None] Lock "cinder-quobyte-57a1dc8d-5289-495c-88bb-902e513d966d" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:51:09 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-e4cb091e-54d6-4359-b4e3-9ed07b547faa tempest-GroupsV314Test-549425539 None] Deleting offline snapshot 57a1dc8d-5289-495c-88bb-902e513d966d of volume 336af048-c51c-4c42-9d98-c85b28b6b5e0 {{(pid=92083) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 17 05:51:09 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-e4cb091e-54d6-4359-b4e3-9ed07b547faa tempest-GroupsV314Test-549425539 None] snapshot_file for this snap is: volume-336af048-c51c-4c42-9d98-c85b28b6b5e0.57a1dc8d-5289-495c-88bb-902e513d966d {{(pid=92083) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 17 05:51:09 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[152352fa-d8ac-4f74-8f48-6f903a7195d1]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:51:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e4cb091e-54d6-4359-b4e3-9ed07b547faa tempest-GroupsV314Test-549425539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-336af048-c51c-4c42-9d98-c85b28b6b5e0.57a1dc8d-5289-495c-88bb-902e513d966d {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:09 devstack sudo[104800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-336af048-c51c-4c42-9d98-c85b28b6b5e0.57a1dc8d-5289-495c-88bb-902e513d966d Jun 17 05:51:09 devstack sudo[104800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:10 devstack sudo[104800]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e4cb091e-54d6-4359-b4e3-9ed07b547faa tempest-GroupsV314Test-549425539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-336af048-c51c-4c42-9d98-c85b28b6b5e0.57a1dc8d-5289-495c-88bb-902e513d966d" returned: 0 in 0.688s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:10 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-e4cb091e-54d6-4359-b4e3-9ed07b547faa tempest-GroupsV314Test-549425539 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-336af048-c51c-4c42-9d98-c85b28b6b5e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92083) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 05:51:10 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50bb426-0295-44b9-966a-795a4ca0c6e5]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:51:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e4cb091e-54d6-4359-b4e3-9ed07b547faa tempest-GroupsV314Test-549425539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-336af048-c51c-4c42-9d98-c85b28b6b5e0 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:10 devstack sudo[104805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-336af048-c51c-4c42-9d98-c85b28b6b5e0 Jun 17 05:51:10 devstack sudo[104805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:11 devstack sudo[104805]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e4cb091e-54d6-4359-b4e3-9ed07b547faa tempest-GroupsV314Test-549425539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-336af048-c51c-4c42-9d98-c85b28b6b5e0" returned: 0 in 0.706s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e4cb091e-54d6-4359-b4e3-9ed07b547faa tempest-GroupsV314Test-549425539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-336af048-c51c-4c42-9d98-c85b28b6b5e0.57a1dc8d-5289-495c-88bb-902e513d966d {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:11 devstack sudo[104810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-336af048-c51c-4c42-9d98-c85b28b6b5e0.57a1dc8d-5289-495c-88bb-902e513d966d Jun 17 05:51:11 devstack sudo[104810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:11 devstack sudo[104810]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e4cb091e-54d6-4359-b4e3-9ed07b547faa tempest-GroupsV314Test-549425539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-336af048-c51c-4c42-9d98-c85b28b6b5e0.57a1dc8d-5289-495c-88bb-902e513d966d" returned: 0 in 0.661s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e4cb091e-54d6-4359-b4e3-9ed07b547faa tempest-GroupsV314Test-549425539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-336af048-c51c-4c42-9d98-c85b28b6b5e0.57a1dc8d-5289-495c-88bb-902e513d966d {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:11 devstack sudo[104815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-336af048-c51c-4c42-9d98-c85b28b6b5e0.57a1dc8d-5289-495c-88bb-902e513d966d Jun 17 05:51:11 devstack sudo[104815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:12 devstack sudo[104815]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e4cb091e-54d6-4359-b4e3-9ed07b547faa tempest-GroupsV314Test-549425539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-336af048-c51c-4c42-9d98-c85b28b6b5e0.57a1dc8d-5289-495c-88bb-902e513d966d" returned: 0 in 0.578s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:12 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-e4cb091e-54d6-4359-b4e3-9ed07b547faa tempest-GroupsV314Test-549425539 None] Lock "cinder-quobyte-57a1dc8d-5289-495c-88bb-902e513d966d" released by "_delete_snapshot" :: held 2.712s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:51:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e4cb091e-54d6-4359-b4e3-9ed07b547faa tempest-GroupsV314Test-549425539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.119s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:51:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-da014f82-639a-4195-803d-e1c28cf792e2 tempest-VolumesExtendTest-1772209352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.421s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:51:12 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-da014f82-639a-4195-803d-e1c28cf792e2 tempest-VolumesExtendTest-1772209352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:51:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-470690871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c20ba84-2fb8-46bd-b149-48b5fcde2faa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8f9befcec2644509202bd6b3045c710',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:51:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:51:02Z,use_quota=True,user_id='7f9b6f6bfab64f0fa5c665e4c590dae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:51:12 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-da014f82-639a-4195-803d-e1c28cf792e2 tempest-VolumesExtendTest-1772209352 None] Creating volume 7c20ba84-2fb8-46bd-b149-48b5fcde2faa {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:51:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-da014f82-639a-4195-803d-e1c28cf792e2 tempest-VolumesExtendTest-1772209352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:51:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-da014f82-639a-4195-803d-e1c28cf792e2 tempest-VolumesExtendTest-1772209352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:51:12 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-da014f82-639a-4195-803d-e1c28cf792e2 tempest-VolumesExtendTest-1772209352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:51:12 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-da014f82-639a-4195-803d-e1c28cf792e2 tempest-VolumesExtendTest-1772209352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:51:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-da014f82-639a-4195-803d-e1c28cf792e2 tempest-VolumesExtendTest-1772209352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:51:12 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-da014f82-639a-4195-803d-e1c28cf792e2 tempest-VolumesExtendTest-1772209352 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:51:12 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-da014f82-639a-4195-803d-e1c28cf792e2 tempest-VolumesExtendTest-1772209352 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:51:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-da014f82-639a-4195-803d-e1c28cf792e2 tempest-VolumesExtendTest-1772209352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7c20ba84-2fb8-46bd-b149-48b5fcde2faa 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:12 devstack sudo[104818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7c20ba84-2fb8-46bd-b149-48b5fcde2faa 1073741824 Jun 17 05:51:12 devstack sudo[104818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:12 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-e4cb091e-54d6-4359-b4e3-9ed07b547faa tempest-GroupsV314Test-549425539 None] Create group from source-group-d3e91cda-1702-40ca-aa5a-1a5279883f77 completed successfully. Jun 17 05:51:13 devstack sudo[104818]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:13 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-da014f82-639a-4195-803d-e1c28cf792e2 tempest-VolumesExtendTest-1772209352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7c20ba84-2fb8-46bd-b149-48b5fcde2faa 1073741824" returned: 0 in 0.770s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:13 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-da014f82-639a-4195-803d-e1c28cf792e2 tempest-VolumesExtendTest-1772209352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7c20ba84-2fb8-46bd-b149-48b5fcde2faa {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:13 devstack sudo[104823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7c20ba84-2fb8-46bd-b149-48b5fcde2faa Jun 17 05:51:13 devstack sudo[104823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:13 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-8f5840a9-4d3b-4cd9-98cd-696c9fcbad8d tempest-GroupsV314Test-549425539 None] Acquiring lock "cinder-quobyte-366c5a24-e9be-4c15-bba8-762017247ab9" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:51:13 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-8f5840a9-4d3b-4cd9-98cd-696c9fcbad8d tempest-GroupsV314Test-549425539 None] Lock "cinder-quobyte-366c5a24-e9be-4c15-bba8-762017247ab9" acquired by "delete_volume" :: waited 0.015s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:51:13 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[7efad6b0-8155-437a-9eb5-f98b688f4ab7]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:51:13 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8f5840a9-4d3b-4cd9-98cd-696c9fcbad8d tempest-GroupsV314Test-549425539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-366c5a24-e9be-4c15-bba8-762017247ab9 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:13 devstack sudo[104825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-366c5a24-e9be-4c15-bba8-762017247ab9 Jun 17 05:51:13 devstack sudo[104825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:13 devstack sudo[104823]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:13 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-da014f82-639a-4195-803d-e1c28cf792e2 tempest-VolumesExtendTest-1772209352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7c20ba84-2fb8-46bd-b149-48b5fcde2faa" returned: 0 in 0.586s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:13 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-da014f82-639a-4195-803d-e1c28cf792e2 tempest-VolumesExtendTest-1772209352 None] <== create_volume: return (1394ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:51:13 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-da014f82-639a-4195-803d-e1c28cf792e2 tempest-VolumesExtendTest-1772209352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.398s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:51:13 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-ecd4463c-89c2-417f-898f-2b446a5c7697 req-d048d037-4453-4946-85ba-a831dc179e40 tempest-TestServerVolumeAttachmentScenario-875878610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.962s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:51:13 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[3379afbf-ee1e-4e5d-a42b-1c710df43504]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:51:13 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-ecd4463c-89c2-417f-898f-2b446a5c7697 req-d048d037-4453-4946-85ba-a831dc179e40 tempest-TestServerVolumeAttachmentScenario-875878610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-519f9e31-8efb-498c-a677-2da62211f5c8 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:13 devstack cinder-volume[92083]: DEBUG cinder.volume.volume_utils [None req-da014f82-639a-4195-803d-e1c28cf792e2 tempest-VolumesExtendTest-1772209352 None] Attempting download of 3a392502-bf92-4019-8ad1-5b48db42b20f ((None, [{'url': 'file:///opt/stack/data/glance/images/3a392502-bf92-4019-8ad1-5b48db42b20f', 'metadata': {}}])) to volume 7c20ba84-2fb8-46bd-b149-48b5fcde2faa. {{(pid=92083) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 17 05:51:13 devstack sudo[104828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-519f9e31-8efb-498c-a677-2da62211f5c8 Jun 17 05:51:13 devstack sudo[104828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:13 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b7e13f-ff24-475a-80b1-e82832d78383]: (4, 'raw') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:51:13 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-da014f82-639a-4195-803d-e1c28cf792e2 tempest-VolumesExtendTest-1772209352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3a392502-bf92-4019-8ad1-5b48db42b20f_2lqv3p23 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:14 devstack sudo[104830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3a392502-bf92-4019-8ad1-5b48db42b20f_2lqv3p23 Jun 17 05:51:14 devstack sudo[104830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:14 devstack sudo[104825]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8f5840a9-4d3b-4cd9-98cd-696c9fcbad8d tempest-GroupsV314Test-549425539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-366c5a24-e9be-4c15-bba8-762017247ab9" returned: 0 in 0.729s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8f5840a9-4d3b-4cd9-98cd-696c9fcbad8d tempest-GroupsV314Test-549425539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-366c5a24-e9be-4c15-bba8-762017247ab9 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:14 devstack sudo[104835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-366c5a24-e9be-4c15-bba8-762017247ab9 Jun 17 05:51:14 devstack sudo[104835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:14 devstack sudo[104828]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-ecd4463c-89c2-417f-898f-2b446a5c7697 req-d048d037-4453-4946-85ba-a831dc179e40 tempest-TestServerVolumeAttachmentScenario-875878610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-519f9e31-8efb-498c-a677-2da62211f5c8" returned: 0 in 0.761s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-ecd4463c-89c2-417f-898f-2b446a5c7697 req-d048d037-4453-4946-85ba-a831dc179e40 tempest-TestServerVolumeAttachmentScenario-875878610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.781s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:51:14 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [req-ecd4463c-89c2-417f-898f-2b446a5c7697 req-d048d037-4453-4946-85ba-a831dc179e40 tempest-TestServerVolumeAttachmentScenario-875878610 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f', 'name': 'volume-519f9e31-8efb-498c-a677-2da62211f5c8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ad91a5ae-01a8-42ff-9489-eec484888c6c', 'enforce_multipath': True} {{(pid=92083) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 17 05:51:14 devstack cinder-volume[92083]: INFO cinder.volume.manager [req-ecd4463c-89c2-417f-898f-2b446a5c7697 req-d048d037-4453-4946-85ba-a831dc179e40 tempest-TestServerVolumeAttachmentScenario-875878610 None] attachment_update completed successfully. Jun 17 05:51:14 devstack sudo[104830]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-da014f82-639a-4195-803d-e1c28cf792e2 tempest-VolumesExtendTest-1772209352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3a392502-bf92-4019-8ad1-5b48db42b20f_2lqv3p23" returned: 0 in 0.743s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-da014f82-639a-4195-803d-e1c28cf792e2 tempest-VolumesExtendTest-1772209352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3a392502-bf92-4019-8ad1-5b48db42b20f_2lqv3p23 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:14 devstack sudo[104842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3a392502-bf92-4019-8ad1-5b48db42b20f_2lqv3p23 Jun 17 05:51:14 devstack sudo[104842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:14 devstack sudo[104835]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8f5840a9-4d3b-4cd9-98cd-696c9fcbad8d tempest-GroupsV314Test-549425539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-366c5a24-e9be-4c15-bba8-762017247ab9" returned: 0 in 0.627s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:14 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-8f5840a9-4d3b-4cd9-98cd-696c9fcbad8d tempest-GroupsV314Test-549425539 None] Lock "cinder-quobyte-366c5a24-e9be-4c15-bba8-762017247ab9" released by "delete_volume" :: held 1.415s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:51:14 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-8f5840a9-4d3b-4cd9-98cd-696c9fcbad8d tempest-GroupsV314Test-549425539 None] Created reservations ['c35cae74-0776-4252-a780-a19d18ccb8e1'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:51:15 devstack cinder-volume[92083]: WARNING cinder.quota [None req-8f5840a9-4d3b-4cd9-98cd-696c9fcbad8d tempest-GroupsV314Test-549425539 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1850903412 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1850903412, it is now deprecated. Please use the default quota class for default quota. Jun 17 05:51:15 devstack cinder-volume[92083]: WARNING cinder.quota [None req-8f5840a9-4d3b-4cd9-98cd-696c9fcbad8d tempest-GroupsV314Test-549425539 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1850903412 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1850903412, it is now deprecated. Please use the default quota class for default quota. Jun 17 05:51:15 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-8f5840a9-4d3b-4cd9-98cd-696c9fcbad8d tempest-GroupsV314Test-549425539 None] Created reservations ['2f93f068-5404-4a86-9262-b62c70711dff', '318fe964-6dcc-4208-aa45-ec22fecf4828', 'a2441974-e6a8-48c8-aaf9-6316866c64ca', '9bfcadbb-f54d-4893-a2b0-6b26e36ab143'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:51:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-8f5840a9-4d3b-4cd9-98cd-696c9fcbad8d tempest-GroupsV314Test-549425539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:51:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-8f5840a9-4d3b-4cd9-98cd-696c9fcbad8d tempest-GroupsV314Test-549425539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:51:15 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-8f5840a9-4d3b-4cd9-98cd-696c9fcbad8d tempest-GroupsV314Test-549425539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:51:15 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-8f5840a9-4d3b-4cd9-98cd-696c9fcbad8d tempest-GroupsV314Test-549425539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:51:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-8f5840a9-4d3b-4cd9-98cd-696c9fcbad8d tempest-GroupsV314Test-549425539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:51:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8f5840a9-4d3b-4cd9-98cd-696c9fcbad8d tempest-GroupsV314Test-549425539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:15 devstack sudo[104871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:51:15 devstack sudo[104871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:15 devstack sudo[104842]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-da014f82-639a-4195-803d-e1c28cf792e2 tempest-VolumesExtendTest-1772209352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3a392502-bf92-4019-8ad1-5b48db42b20f_2lqv3p23" returned: 1 in 0.747s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-da014f82-639a-4195-803d-e1c28cf792e2 tempest-VolumesExtendTest-1772209352 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3a392502-bf92-4019-8ad1-5b48db42b20f_2lqv3p23' failed. Not Retrying. {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 05:51:15 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[90744b87-8c9c-4fb7-9885-421f4d834e1e]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:51:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-da014f82-639a-4195-803d-e1c28cf792e2 tempest-VolumesExtendTest-1772209352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a392502-bf92-4019-8ad1-5b48db42b20f_dydqjlkgdevstack@QuobyteHD {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:15 devstack sudo[104877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a392502-bf92-4019-8ad1-5b48db42b20f_dydqjlkgdevstack@QuobyteHD Jun 17 05:51:15 devstack sudo[104877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:15 devstack sudo[104871]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8f5840a9-4d3b-4cd9-98cd-696c9fcbad8d tempest-GroupsV314Test-549425539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.705s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:15 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-8f5840a9-4d3b-4cd9-98cd-696c9fcbad8d tempest-GroupsV314Test-549425539 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:51:15 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-8f5840a9-4d3b-4cd9-98cd-696c9fcbad8d tempest-GroupsV314Test-549425539 None] Delete group completed successfully. Jun 17 05:51:15 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-0266c1c5-e8fa-4c53-bca4-11c19a9e9d33 tempest-GroupsV314Test-549425539 None] Acquiring lock "cinder-quobyte-336af048-c51c-4c42-9d98-c85b28b6b5e0" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:51:15 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-0266c1c5-e8fa-4c53-bca4-11c19a9e9d33 tempest-GroupsV314Test-549425539 None] Lock "cinder-quobyte-336af048-c51c-4c42-9d98-c85b28b6b5e0" acquired by "delete_volume" :: waited 0.015s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:51:16 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9e0337-af06-4d77-a668-c71dfadad36a]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:51:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0266c1c5-e8fa-4c53-bca4-11c19a9e9d33 tempest-GroupsV314Test-549425539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-336af048-c51c-4c42-9d98-c85b28b6b5e0 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:16 devstack sudo[104886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-336af048-c51c-4c42-9d98-c85b28b6b5e0 Jun 17 05:51:16 devstack sudo[104886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:16 devstack sudo[104877]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-da014f82-639a-4195-803d-e1c28cf792e2 tempest-VolumesExtendTest-1772209352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a392502-bf92-4019-8ad1-5b48db42b20f_dydqjlkgdevstack@QuobyteHD" returned: 0 in 0.766s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:16 devstack cinder-volume[92083]: DEBUG cinder.image.image_utils [None req-da014f82-639a-4195-803d-e1c28cf792e2 tempest-VolumesExtendTest-1772209352 None] 3a392502-bf92-4019-8ad1-5b48db42b20f was qcow2, converting to raw {{(pid=92083) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 17 05:51:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-da014f82-639a-4195-803d-e1c28cf792e2 tempest-VolumesExtendTest-1772209352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3a392502-bf92-4019-8ad1-5b48db42b20f_dydqjlkgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7c20ba84-2fb8-46bd-b149-48b5fcde2faa {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:16 devstack sudo[104891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3a392502-bf92-4019-8ad1-5b48db42b20f_dydqjlkgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7c20ba84-2fb8-46bd-b149-48b5fcde2faa Jun 17 05:51:16 devstack sudo[104891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:16 devstack sudo[104886]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0266c1c5-e8fa-4c53-bca4-11c19a9e9d33 tempest-GroupsV314Test-549425539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-336af048-c51c-4c42-9d98-c85b28b6b5e0" returned: 0 in 0.754s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0266c1c5-e8fa-4c53-bca4-11c19a9e9d33 tempest-GroupsV314Test-549425539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-336af048-c51c-4c42-9d98-c85b28b6b5e0 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:16 devstack sudo[104899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-336af048-c51c-4c42-9d98-c85b28b6b5e0 Jun 17 05:51:16 devstack sudo[104899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:17 devstack sudo[104899]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0266c1c5-e8fa-4c53-bca4-11c19a9e9d33 tempest-GroupsV314Test-549425539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-336af048-c51c-4c42-9d98-c85b28b6b5e0" returned: 0 in 0.626s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:17 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-0266c1c5-e8fa-4c53-bca4-11c19a9e9d33 tempest-GroupsV314Test-549425539 None] Lock "cinder-quobyte-336af048-c51c-4c42-9d98-c85b28b6b5e0" released by "delete_volume" :: held 1.455s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:51:17 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-0266c1c5-e8fa-4c53-bca4-11c19a9e9d33 tempest-GroupsV314Test-549425539 None] Created reservations ['27b5cd65-4676-4630-928e-a4f2c54a5c26'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:51:17 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-0266c1c5-e8fa-4c53-bca4-11c19a9e9d33 tempest-GroupsV314Test-549425539 None] Created reservations ['023360f0-e208-47b3-ab38-7a09ec76d846', '688025b0-54a4-456b-95d1-f7d22d9dfd9c', 'e15f7e0e-734a-4469-8246-17e0bc61231e', '50004ccc-bd30-4b86-81dc-89d1429cdcf1'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:51:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-0266c1c5-e8fa-4c53-bca4-11c19a9e9d33 tempest-GroupsV314Test-549425539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:51:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-0266c1c5-e8fa-4c53-bca4-11c19a9e9d33 tempest-GroupsV314Test-549425539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:51:17 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-0266c1c5-e8fa-4c53-bca4-11c19a9e9d33 tempest-GroupsV314Test-549425539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:51:17 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-0266c1c5-e8fa-4c53-bca4-11c19a9e9d33 tempest-GroupsV314Test-549425539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:51:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-0266c1c5-e8fa-4c53-bca4-11c19a9e9d33 tempest-GroupsV314Test-549425539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:51:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0266c1c5-e8fa-4c53-bca4-11c19a9e9d33 tempest-GroupsV314Test-549425539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:17 devstack sudo[104909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:51:17 devstack sudo[104909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:18 devstack sudo[104891]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:18 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-da014f82-639a-4195-803d-e1c28cf792e2 tempest-VolumesExtendTest-1772209352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3a392502-bf92-4019-8ad1-5b48db42b20f_dydqjlkgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7c20ba84-2fb8-46bd-b149-48b5fcde2faa" returned: 0 in 1.904s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:18 devstack cinder-volume[92083]: DEBUG cinder.image.image_utils [None req-da014f82-639a-4195-803d-e1c28cf792e2 tempest-VolumesExtendTest-1772209352 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3a392502-bf92-4019-8ad1-5b48db42b20f_dydqjlkgdevstack@QuobyteHD, size 112.00 MB, duration 1.91 sec, destination /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7c20ba84-2fb8-46bd-b149-48b5fcde2faa {{(pid=92083) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 17 05:51:18 devstack cinder-volume[92083]: INFO cinder.image.image_utils [None req-da014f82-639a-4195-803d-e1c28cf792e2 tempest-VolumesExtendTest-1772209352 None] Converted 112.00 MB image at 58.78 MB/s Jun 17 05:51:18 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-da014f82-639a-4195-803d-e1c28cf792e2 tempest-VolumesExtendTest-1772209352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7c20ba84-2fb8-46bd-b149-48b5fcde2faa 1G {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:18 devstack sudo[104911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7c20ba84-2fb8-46bd-b149-48b5fcde2faa 1G Jun 17 05:51:18 devstack sudo[104911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:18 devstack sudo[104909]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:18 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0266c1c5-e8fa-4c53-bca4-11c19a9e9d33 tempest-GroupsV314Test-549425539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.696s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:18 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-0266c1c5-e8fa-4c53-bca4-11c19a9e9d33 tempest-GroupsV314Test-549425539 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:51:18 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-0266c1c5-e8fa-4c53-bca4-11c19a9e9d33 tempest-GroupsV314Test-549425539 None] Delete group completed successfully. Jun 17 05:51:18 devstack sudo[104911]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:18 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-da014f82-639a-4195-803d-e1c28cf792e2 tempest-VolumesExtendTest-1772209352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7c20ba84-2fb8-46bd-b149-48b5fcde2faa 1G" returned: 0 in 0.730s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:18 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f20397b-e00b-408f-9a0c-f5f0db5b18cc]: (4, 'raw') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:51:18 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-da014f82-639a-4195-803d-e1c28cf792e2 tempest-VolumesExtendTest-1772209352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7c20ba84-2fb8-46bd-b149-48b5fcde2faa {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:19 devstack sudo[104917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7c20ba84-2fb8-46bd-b149-48b5fcde2faa Jun 17 05:51:19 devstack sudo[104917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:19 devstack sudo[104917]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:19 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-da014f82-639a-4195-803d-e1c28cf792e2 tempest-VolumesExtendTest-1772209352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7c20ba84-2fb8-46bd-b149-48b5fcde2faa" returned: 0 in 0.754s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:19 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-da014f82-639a-4195-803d-e1c28cf792e2 tempest-VolumesExtendTest-1772209352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7c20ba84-2fb8-46bd-b149-48b5fcde2faa {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:19 devstack sudo[104922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7c20ba84-2fb8-46bd-b149-48b5fcde2faa Jun 17 05:51:19 devstack sudo[104922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:20 devstack sudo[104922]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:20 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-da014f82-639a-4195-803d-e1c28cf792e2 tempest-VolumesExtendTest-1772209352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7c20ba84-2fb8-46bd-b149-48b5fcde2faa" returned: 1 in 0.734s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:20 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-da014f82-639a-4195-803d-e1c28cf792e2 tempest-VolumesExtendTest-1772209352 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7c20ba84-2fb8-46bd-b149-48b5fcde2faa' failed. Not Retrying. {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 05:51:20 devstack cinder-volume[92083]: DEBUG cinder.volume.volume_utils [None req-da014f82-639a-4195-803d-e1c28cf792e2 tempest-VolumesExtendTest-1772209352 None] Downloaded image 3a392502-bf92-4019-8ad1-5b48db42b20f ((None, [{'url': 'file:///opt/stack/data/glance/images/3a392502-bf92-4019-8ad1-5b48db42b20f', 'metadata': {}}])) to volume 7c20ba84-2fb8-46bd-b149-48b5fcde2faa successfully. {{(pid=92083) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 17 05:51:20 devstack cinder-volume[92083]: DEBUG cinder.image.image_utils [None req-da014f82-639a-4195-803d-e1c28cf792e2 tempest-VolumesExtendTest-1772209352 None] Temporary image 3a392502-bf92-4019-8ad1-5b48db42b20f for user 7f9b6f6bfab64f0fa5c665e4c590dae6 is deleted. {{(pid=92083) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 17 05:51:20 devstack cinder-volume[92083]: DEBUG cinder.volume.volume_utils [None req-da014f82-639a-4195-803d-e1c28cf792e2 tempest-VolumesExtendTest-1772209352 None] Marking volume 7c20ba84-2fb8-46bd-b149-48b5fcde2faa as bootable. {{(pid=92083) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 17 05:51:20 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-da014f82-639a-4195-803d-e1c28cf792e2 tempest-VolumesExtendTest-1772209352 None] Copying metadata from image 3a392502-bf92-4019-8ad1-5b48db42b20f to 7c20ba84-2fb8-46bd-b149-48b5fcde2faa. {{(pid=92083) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 17 05:51:20 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-da014f82-639a-4195-803d-e1c28cf792e2 tempest-VolumesExtendTest-1772209352 None] Creating volume glance metadata for volume 7c20ba84-2fb8-46bd-b149-48b5fcde2faa backed by image 3a392502-bf92-4019-8ad1-5b48db42b20f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3a392502-bf92-4019-8ad1-5b48db42b20f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=92083) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 17 05:51:20 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-da014f82-639a-4195-803d-e1c28cf792e2 tempest-VolumesExtendTest-1772209352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (629ab2a2-8057-4661-a2b7-a98c4f18ace2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c20ba84-2fb8-46bd-b149-48b5fcde2faa', 'volume_size': 1, 'image_id': '3a392502-bf92-4019-8ad1-5b48db42b20f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3a392502-bf92-4019-8ad1-5b48db42b20f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd68ea14f86c14b8aac202e298736b075', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3a392502-bf92-4019-8ad1-5b48db42b20f', 'created_at': datetime.datetime(2026, 6, 17, 3, 31, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 3, 31, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3a392502-bf92-4019-8ad1-5b48db42b20f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:51:20 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-da014f82-639a-4195-803d-e1c28cf792e2 tempest-VolumesExtendTest-1772209352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c78a62d-02cd-4c76-8d3a-a6fd0de18e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:51:20 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-da014f82-639a-4195-803d-e1c28cf792e2 tempest-VolumesExtendTest-1772209352 None] Volume volume-7c20ba84-2fb8-46bd-b149-48b5fcde2faa (7c20ba84-2fb8-46bd-b149-48b5fcde2faa): created successfully Jun 17 05:51:20 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-da014f82-639a-4195-803d-e1c28cf792e2 tempest-VolumesExtendTest-1772209352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c78a62d-02cd-4c76-8d3a-a6fd0de18e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:51:20 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-da014f82-639a-4195-803d-e1c28cf792e2 tempest-VolumesExtendTest-1772209352 None] Flow 'volume_create_manager' (4cbda567-8789-41f3-91d8-0a122844ddae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:51:20 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-da014f82-639a-4195-803d-e1c28cf792e2 tempest-VolumesExtendTest-1772209352 None] Created volume successfully. Jun 17 05:51:20 devstack cinder-volume[92083]: INFO cinder.volume.manager [req-21b876f0-fdee-4f40-93aa-01382842ae11 req-027f9419-7408-4c8d-8370-21838a5938b4 tempest-TestServerVolumeAttachmentScenario-875878610 None] Terminate volume connection completed successfully. Jun 17 05:51:20 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [req-21b876f0-fdee-4f40-93aa-01382842ae11 req-027f9419-7408-4c8d-8370-21838a5938b4 tempest-TestServerVolumeAttachmentScenario-875878610 None] Deleting attachment ad91a5ae-01a8-42ff-9489-eec484888c6c. {{(pid=92083) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 17 05:51:21 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-83323721-f1d6-4805-bd2d-5f75776b6c1e tempest-VolumesExtendTest-1772209352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:51:21 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-83323721-f1d6-4805-bd2d-5f75776b6c1e tempest-VolumesExtendTest-1772209352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:51:21 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93b13fe-7026-462b-a9ca-9dc21d93166e]: (4, 'raw') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:51:21 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-83323721-f1d6-4805-bd2d-5f75776b6c1e tempest-VolumesExtendTest-1772209352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7c20ba84-2fb8-46bd-b149-48b5fcde2faa {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:21 devstack sudo[104929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7c20ba84-2fb8-46bd-b149-48b5fcde2faa Jun 17 05:51:21 devstack sudo[104929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:22 devstack sudo[104929]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:22 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-83323721-f1d6-4805-bd2d-5f75776b6c1e tempest-VolumesExtendTest-1772209352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7c20ba84-2fb8-46bd-b149-48b5fcde2faa" returned: 0 in 0.720s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:22 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-83323721-f1d6-4805-bd2d-5f75776b6c1e tempest-VolumesExtendTest-1772209352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7c20ba84-2fb8-46bd-b149-48b5fcde2faa {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:22 devstack sudo[104933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7c20ba84-2fb8-46bd-b149-48b5fcde2faa Jun 17 05:51:22 devstack sudo[104933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:23 devstack sudo[104933]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:23 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-83323721-f1d6-4805-bd2d-5f75776b6c1e tempest-VolumesExtendTest-1772209352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7c20ba84-2fb8-46bd-b149-48b5fcde2faa" returned: 1 in 0.821s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:23 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-83323721-f1d6-4805-bd2d-5f75776b6c1e tempest-VolumesExtendTest-1772209352 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7c20ba84-2fb8-46bd-b149-48b5fcde2faa' failed. Not Retrying. {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 05:51:23 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-83323721-f1d6-4805-bd2d-5f75776b6c1e tempest-VolumesExtendTest-1772209352 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7c20ba84-2fb8-46bd-b149-48b5fcde2faa 2G {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:23 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-83323721-f1d6-4805-bd2d-5f75776b6c1e tempest-VolumesExtendTest-1772209352 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7c20ba84-2fb8-46bd-b149-48b5fcde2faa 2G" returned: 0 in 0.071s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:23 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-83323721-f1d6-4805-bd2d-5f75776b6c1e tempest-VolumesExtendTest-1772209352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.669s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:51:23 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-83323721-f1d6-4805-bd2d-5f75776b6c1e tempest-VolumesExtendTest-1772209352 None] Extend volume completed successfully. Jun 17 05:51:24 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-ce36bd70-60d8-4f6f-ab98-2c905f7b25b5 tempest-VolumesExtendTest-1772209352 None] Acquiring lock "cinder-7c20ba84-2fb8-46bd-b149-48b5fcde2faa-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:51:24 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-ce36bd70-60d8-4f6f-ab98-2c905f7b25b5 tempest-VolumesExtendTest-1772209352 None] Lock "cinder-7c20ba84-2fb8-46bd-b149-48b5fcde2faa-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:51:24 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-ce36bd70-60d8-4f6f-ab98-2c905f7b25b5 tempest-VolumesExtendTest-1772209352 None] Acquiring lock "cinder-quobyte-7c20ba84-2fb8-46bd-b149-48b5fcde2faa" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:51:24 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-ce36bd70-60d8-4f6f-ab98-2c905f7b25b5 tempest-VolumesExtendTest-1772209352 None] Lock "cinder-quobyte-7c20ba84-2fb8-46bd-b149-48b5fcde2faa" acquired by "delete_volume" :: waited 0.024s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:51:24 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[9655d8c1-dc46-4b86-8fe1-be37bbfe24bd]: (4, 'raw') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:51:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ce36bd70-60d8-4f6f-ab98-2c905f7b25b5 tempest-VolumesExtendTest-1772209352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7c20ba84-2fb8-46bd-b149-48b5fcde2faa {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:24 devstack sudo[104941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7c20ba84-2fb8-46bd-b149-48b5fcde2faa Jun 17 05:51:24 devstack sudo[104941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:24 devstack cinder-volume[92083]: INFO cinder.volume.manager [req-6bdc2797-d6ab-4cfa-9f20-bbe9bc50e897 req-d8642653-662e-4ca8-ad89-831a32226ca8 tempest-TestServerVolumeAttachmentScenario-875878610 None] Terminate volume connection completed successfully. Jun 17 05:51:24 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [req-6bdc2797-d6ab-4cfa-9f20-bbe9bc50e897 req-d8642653-662e-4ca8-ad89-831a32226ca8 tempest-TestServerVolumeAttachmentScenario-875878610 None] Deleting attachment 518e2455-a8fa-4d04-8e15-68eba94d0341. {{(pid=92083) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 17 05:51:24 devstack sudo[104941]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ce36bd70-60d8-4f6f-ab98-2c905f7b25b5 tempest-VolumesExtendTest-1772209352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7c20ba84-2fb8-46bd-b149-48b5fcde2faa" returned: 0 in 0.750s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ce36bd70-60d8-4f6f-ab98-2c905f7b25b5 tempest-VolumesExtendTest-1772209352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7c20ba84-2fb8-46bd-b149-48b5fcde2faa {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:25 devstack sudo[104948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7c20ba84-2fb8-46bd-b149-48b5fcde2faa Jun 17 05:51:25 devstack sudo[104948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:25 devstack sudo[104948]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ce36bd70-60d8-4f6f-ab98-2c905f7b25b5 tempest-VolumesExtendTest-1772209352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7c20ba84-2fb8-46bd-b149-48b5fcde2faa" returned: 1 in 0.759s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ce36bd70-60d8-4f6f-ab98-2c905f7b25b5 tempest-VolumesExtendTest-1772209352 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7c20ba84-2fb8-46bd-b149-48b5fcde2faa' failed. Not Retrying. {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 05:51:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ce36bd70-60d8-4f6f-ab98-2c905f7b25b5 tempest-VolumesExtendTest-1772209352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7c20ba84-2fb8-46bd-b149-48b5fcde2faa {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:25 devstack sudo[104953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7c20ba84-2fb8-46bd-b149-48b5fcde2faa Jun 17 05:51:25 devstack sudo[104953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:26 devstack sudo[104953]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:26 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ce36bd70-60d8-4f6f-ab98-2c905f7b25b5 tempest-VolumesExtendTest-1772209352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7c20ba84-2fb8-46bd-b149-48b5fcde2faa" returned: 0 in 0.672s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:26 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-ce36bd70-60d8-4f6f-ab98-2c905f7b25b5 tempest-VolumesExtendTest-1772209352 None] Lock "cinder-quobyte-7c20ba84-2fb8-46bd-b149-48b5fcde2faa" released by "delete_volume" :: held 2.282s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:51:26 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-ce36bd70-60d8-4f6f-ab98-2c905f7b25b5 tempest-VolumesExtendTest-1772209352 None] Created reservations ['4c3aca42-8520-4fbd-982b-a31ddee272c8', '3c7f2b42-df43-47ed-a4e5-78e155e73509', '545977a7-1aeb-4878-ab34-340b41ee8ffe', 'b1779a3a-6bc8-4e8f-a90f-d96d3a0b2275'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:51:26 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ce36bd70-60d8-4f6f-ab98-2c905f7b25b5 tempest-VolumesExtendTest-1772209352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:51:26 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ce36bd70-60d8-4f6f-ab98-2c905f7b25b5 tempest-VolumesExtendTest-1772209352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:51:26 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ce36bd70-60d8-4f6f-ab98-2c905f7b25b5 tempest-VolumesExtendTest-1772209352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:51:26 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ce36bd70-60d8-4f6f-ab98-2c905f7b25b5 tempest-VolumesExtendTest-1772209352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:51:26 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ce36bd70-60d8-4f6f-ab98-2c905f7b25b5 tempest-VolumesExtendTest-1772209352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:51:26 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ce36bd70-60d8-4f6f-ab98-2c905f7b25b5 tempest-VolumesExtendTest-1772209352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:26 devstack sudo[104956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:51:26 devstack sudo[104956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:27 devstack sudo[104956]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ce36bd70-60d8-4f6f-ab98-2c905f7b25b5 tempest-VolumesExtendTest-1772209352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.735s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:27 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-ce36bd70-60d8-4f6f-ab98-2c905f7b25b5 tempest-VolumesExtendTest-1772209352 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:51:27 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-ce36bd70-60d8-4f6f-ab98-2c905f7b25b5 tempest-VolumesExtendTest-1772209352 None] Deleted volume successfully. Jun 17 05:51:27 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-ce36bd70-60d8-4f6f-ab98-2c905f7b25b5 tempest-VolumesExtendTest-1772209352 None] Lock "cinder-7c20ba84-2fb8-46bd-b149-48b5fcde2faa-delete_volume" released by "delete_volume" :: held 3.305s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:51:27 devstack cinder-volume[92083]: DEBUG oslo_service.periodic_task [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92083) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 05:51:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:51:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:51:27 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:51:27 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:51:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:51:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:27 devstack sudo[104959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:51:27 devstack sudo[104959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:28 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3f523b1-00be-429b-8b14-2cd4054c5461 tempest-VolumesExtendTest-1772209352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:51:28 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e3f523b1-00be-429b-8b14-2cd4054c5461 tempest-VolumesExtendTest-1772209352 None] Flow 'volume_create_manager' (7eca2ae8-169f-485d-94f0-fc22b22a4bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:51:28 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e3f523b1-00be-429b-8b14-2cd4054c5461 tempest-VolumesExtendTest-1772209352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f059806-9ce1-412f-b5e8-d9bf25f1699a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:51:28 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e3f523b1-00be-429b-8b14-2cd4054c5461 tempest-VolumesExtendTest-1772209352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f059806-9ce1-412f-b5e8-d9bf25f1699a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:51:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-462008566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e0fe845-8b16-4ce5-ad42-a5fae08a59fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8f9befcec2644509202bd6b3045c710',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:51:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:51:28Z,use_quota=True,user_id='7f9b6f6bfab64f0fa5c665e4c590dae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:51:28 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e3f523b1-00be-429b-8b14-2cd4054c5461 tempest-VolumesExtendTest-1772209352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37c15f6a-8d10-4aaf-97aa-a01e1b16dd06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:51:28 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e3f523b1-00be-429b-8b14-2cd4054c5461 tempest-VolumesExtendTest-1772209352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37c15f6a-8d10-4aaf-97aa-a01e1b16dd06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:51:28 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e3f523b1-00be-429b-8b14-2cd4054c5461 tempest-VolumesExtendTest-1772209352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf341faf-772d-4da7-b944-71d9bb70c79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:51:28 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e3f523b1-00be-429b-8b14-2cd4054c5461 tempest-VolumesExtendTest-1772209352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf341faf-772d-4da7-b944-71d9bb70c79a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e0fe845-8b16-4ce5-ad42-a5fae08a59fe', 'volume_name': 'volume-1e0fe845-8b16-4ce5-ad42-a5fae08a59fe', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:51:28 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e3f523b1-00be-429b-8b14-2cd4054c5461 tempest-VolumesExtendTest-1772209352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9340c6e-bcbe-40db-a869-0adcb03a466c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:51:28 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e3f523b1-00be-429b-8b14-2cd4054c5461 tempest-VolumesExtendTest-1772209352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9340c6e-bcbe-40db-a869-0adcb03a466c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:51:28 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e3f523b1-00be-429b-8b14-2cd4054c5461 tempest-VolumesExtendTest-1772209352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb47ca33-771b-4cc4-81f6-07ee4affbd7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:51:28 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-e3f523b1-00be-429b-8b14-2cd4054c5461 tempest-VolumesExtendTest-1772209352 None] Volume 1e0fe845-8b16-4ce5-ad42-a5fae08a59fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e0fe845-8b16-4ce5-ad42-a5fae08a59fe', 'volume_size': 1} Jun 17 05:51:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e3f523b1-00be-429b-8b14-2cd4054c5461 tempest-VolumesExtendTest-1772209352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:51:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e3f523b1-00be-429b-8b14-2cd4054c5461 tempest-VolumesExtendTest-1772209352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:51:28 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-e3f523b1-00be-429b-8b14-2cd4054c5461 tempest-VolumesExtendTest-1772209352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:51:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-462008566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e0fe845-8b16-4ce5-ad42-a5fae08a59fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8f9befcec2644509202bd6b3045c710',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:51:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:51:28Z,use_quota=True,user_id='7f9b6f6bfab64f0fa5c665e4c590dae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:51:28 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-e3f523b1-00be-429b-8b14-2cd4054c5461 tempest-VolumesExtendTest-1772209352 None] Creating volume 1e0fe845-8b16-4ce5-ad42-a5fae08a59fe {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:51:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e3f523b1-00be-429b-8b14-2cd4054c5461 tempest-VolumesExtendTest-1772209352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:51:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e3f523b1-00be-429b-8b14-2cd4054c5461 tempest-VolumesExtendTest-1772209352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:51:28 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-e3f523b1-00be-429b-8b14-2cd4054c5461 tempest-VolumesExtendTest-1772209352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:51:28 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-e3f523b1-00be-429b-8b14-2cd4054c5461 tempest-VolumesExtendTest-1772209352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:51:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e3f523b1-00be-429b-8b14-2cd4054c5461 tempest-VolumesExtendTest-1772209352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:51:28 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-e3f523b1-00be-429b-8b14-2cd4054c5461 tempest-VolumesExtendTest-1772209352 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:51:28 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-e3f523b1-00be-429b-8b14-2cd4054c5461 tempest-VolumesExtendTest-1772209352 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:51:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e3f523b1-00be-429b-8b14-2cd4054c5461 tempest-VolumesExtendTest-1772209352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1e0fe845-8b16-4ce5-ad42-a5fae08a59fe 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:28 devstack sudo[104998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1e0fe845-8b16-4ce5-ad42-a5fae08a59fe 1073741824 Jun 17 05:51:28 devstack sudo[104998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:28 devstack sudo[104959]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.980s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:28 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:51:28 devstack cinder-volume[92083]: DEBUG oslo_service.periodic_task [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running periodic task VolumeManager._thread_info {{(pid=92083) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 05:51:28 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] thread count: 28 {{(pid=92083) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 17 05:51:28 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] thread info: [<_MainThread(MainThread, started 133483869905024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92083) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 17 05:51:29 devstack sudo[104998]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:29 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e3f523b1-00be-429b-8b14-2cd4054c5461 tempest-VolumesExtendTest-1772209352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1e0fe845-8b16-4ce5-ad42-a5fae08a59fe 1073741824" returned: 0 in 0.988s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:29 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e3f523b1-00be-429b-8b14-2cd4054c5461 tempest-VolumesExtendTest-1772209352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1e0fe845-8b16-4ce5-ad42-a5fae08a59fe {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:29 devstack sudo[105009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1e0fe845-8b16-4ce5-ad42-a5fae08a59fe Jun 17 05:51:29 devstack sudo[105009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:30 devstack sudo[105009]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:30 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e3f523b1-00be-429b-8b14-2cd4054c5461 tempest-VolumesExtendTest-1772209352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1e0fe845-8b16-4ce5-ad42-a5fae08a59fe" returned: 0 in 0.859s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:30 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-e3f523b1-00be-429b-8b14-2cd4054c5461 tempest-VolumesExtendTest-1772209352 None] <== create_volume: return (1898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:51:30 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e3f523b1-00be-429b-8b14-2cd4054c5461 tempest-VolumesExtendTest-1772209352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.901s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:51:30 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e3f523b1-00be-429b-8b14-2cd4054c5461 tempest-VolumesExtendTest-1772209352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb47ca33-771b-4cc4-81f6-07ee4affbd7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e0fe845-8b16-4ce5-ad42-a5fae08a59fe', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:51:30 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e3f523b1-00be-429b-8b14-2cd4054c5461 tempest-VolumesExtendTest-1772209352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d73a6c49-a89e-4289-b05d-be200cba9496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:51:30 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-e3f523b1-00be-429b-8b14-2cd4054c5461 tempest-VolumesExtendTest-1772209352 None] Volume volume-1e0fe845-8b16-4ce5-ad42-a5fae08a59fe (1e0fe845-8b16-4ce5-ad42-a5fae08a59fe): created successfully Jun 17 05:51:30 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e3f523b1-00be-429b-8b14-2cd4054c5461 tempest-VolumesExtendTest-1772209352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d73a6c49-a89e-4289-b05d-be200cba9496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:51:30 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e3f523b1-00be-429b-8b14-2cd4054c5461 tempest-VolumesExtendTest-1772209352 None] Flow 'volume_create_manager' (7eca2ae8-169f-485d-94f0-fc22b22a4bb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:51:30 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-e3f523b1-00be-429b-8b14-2cd4054c5461 tempest-VolumesExtendTest-1772209352 None] Created volume successfully. Jun 17 05:51:31 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-89562f5a-99fc-4c2c-b7f3-de6614dee2e6 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:51:31 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-89562f5a-99fc-4c2c-b7f3-de6614dee2e6 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Flow 'volume_create_manager' (56667c01-7051-45d2-8f28-2ac4e1b4a5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:51:31 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-89562f5a-99fc-4c2c-b7f3-de6614dee2e6 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84001423-c3a0-4de1-85f7-0c2ae983025f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:51:31 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-89562f5a-99fc-4c2c-b7f3-de6614dee2e6 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84001423-c3a0-4de1-85f7-0c2ae983025f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:51:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1838751802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6164c396-c37a-4b6a-9200-dde764023bad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62cbf985f1ab4a2298782f8e8821693f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:51:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:51:31Z,use_quota=True,user_id='3078795afebe4ce2bfc92daa9ef0ab86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:51:31 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-89562f5a-99fc-4c2c-b7f3-de6614dee2e6 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4920b771-9e23-4488-b81b-bad3140cbcb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:51:31 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-89562f5a-99fc-4c2c-b7f3-de6614dee2e6 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4920b771-9e23-4488-b81b-bad3140cbcb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:51:31 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-89562f5a-99fc-4c2c-b7f3-de6614dee2e6 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed3a0921-05d8-4800-a970-0f94812c22ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:51:31 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-89562f5a-99fc-4c2c-b7f3-de6614dee2e6 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed3a0921-05d8-4800-a970-0f94812c22ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6164c396-c37a-4b6a-9200-dde764023bad', 'volume_name': 'volume-6164c396-c37a-4b6a-9200-dde764023bad', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:51:31 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-89562f5a-99fc-4c2c-b7f3-de6614dee2e6 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55ba8698-23f3-44c7-af38-c352c23af491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:51:31 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-89562f5a-99fc-4c2c-b7f3-de6614dee2e6 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55ba8698-23f3-44c7-af38-c352c23af491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:51:31 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-89562f5a-99fc-4c2c-b7f3-de6614dee2e6 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17bc0809-7b01-42c8-b674-a040564f327b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:51:31 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-89562f5a-99fc-4c2c-b7f3-de6614dee2e6 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Volume 6164c396-c37a-4b6a-9200-dde764023bad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6164c396-c37a-4b6a-9200-dde764023bad', 'volume_size': 1} Jun 17 05:51:31 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-89562f5a-99fc-4c2c-b7f3-de6614dee2e6 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:51:31 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-89562f5a-99fc-4c2c-b7f3-de6614dee2e6 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:51:31 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-89562f5a-99fc-4c2c-b7f3-de6614dee2e6 tempest-VolumeQuotasAdminTestJSON-1565282960 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:51:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1838751802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6164c396-c37a-4b6a-9200-dde764023bad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62cbf985f1ab4a2298782f8e8821693f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:51:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:51:31Z,use_quota=True,user_id='3078795afebe4ce2bfc92daa9ef0ab86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:51:31 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-89562f5a-99fc-4c2c-b7f3-de6614dee2e6 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Creating volume 6164c396-c37a-4b6a-9200-dde764023bad {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:51:31 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-89562f5a-99fc-4c2c-b7f3-de6614dee2e6 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:51:31 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-89562f5a-99fc-4c2c-b7f3-de6614dee2e6 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:51:31 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-89562f5a-99fc-4c2c-b7f3-de6614dee2e6 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:51:31 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-89562f5a-99fc-4c2c-b7f3-de6614dee2e6 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:51:31 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-89562f5a-99fc-4c2c-b7f3-de6614dee2e6 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:51:31 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-89562f5a-99fc-4c2c-b7f3-de6614dee2e6 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:51:31 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-89562f5a-99fc-4c2c-b7f3-de6614dee2e6 tempest-VolumeQuotasAdminTestJSON-1565282960 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:51:31 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-89562f5a-99fc-4c2c-b7f3-de6614dee2e6 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6164c396-c37a-4b6a-9200-dde764023bad 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:31 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-5f224ffd-d427-4fb7-9ce1-6c493c7d15ab tempest-VolumesExtendTest-1772209352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:51:31 devstack sudo[105052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6164c396-c37a-4b6a-9200-dde764023bad 1073741824 Jun 17 05:51:31 devstack sudo[105052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:32 devstack sudo[105052]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:32 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-89562f5a-99fc-4c2c-b7f3-de6614dee2e6 tempest-VolumeQuotasAdminTestJSON-1565282960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6164c396-c37a-4b6a-9200-dde764023bad 1073741824" returned: 0 in 0.788s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:32 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-89562f5a-99fc-4c2c-b7f3-de6614dee2e6 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6164c396-c37a-4b6a-9200-dde764023bad {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:32 devstack sudo[105058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6164c396-c37a-4b6a-9200-dde764023bad Jun 17 05:51:32 devstack sudo[105058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:32 devstack sudo[105058]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:32 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-89562f5a-99fc-4c2c-b7f3-de6614dee2e6 tempest-VolumeQuotasAdminTestJSON-1565282960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6164c396-c37a-4b6a-9200-dde764023bad" returned: 0 in 0.586s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:32 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-89562f5a-99fc-4c2c-b7f3-de6614dee2e6 tempest-VolumeQuotasAdminTestJSON-1565282960 None] <== create_volume: return (1410ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:51:32 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-89562f5a-99fc-4c2c-b7f3-de6614dee2e6 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.413s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:51:32 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-5f224ffd-d427-4fb7-9ce1-6c493c7d15ab tempest-VolumesExtendTest-1772209352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.380s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:51:32 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-89562f5a-99fc-4c2c-b7f3-de6614dee2e6 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17bc0809-7b01-42c8-b674-a040564f327b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6164c396-c37a-4b6a-9200-dde764023bad', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:51:32 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-89562f5a-99fc-4c2c-b7f3-de6614dee2e6 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ff911e4-fdc7-414b-b965-76ceef12c16c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:51:32 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-5f224ffd-d427-4fb7-9ce1-6c493c7d15ab tempest-VolumesExtendTest-1772209352 None] Creating offline snapshot a636bfd3-4d94-4bbf-bf85-e99a64741e2c of volume 1e0fe845-8b16-4ce5-ad42-a5fae08a59fe {{(pid=92083) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 17 05:51:32 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-89562f5a-99fc-4c2c-b7f3-de6614dee2e6 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Volume volume-6164c396-c37a-4b6a-9200-dde764023bad (6164c396-c37a-4b6a-9200-dde764023bad): created successfully Jun 17 05:51:32 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-89562f5a-99fc-4c2c-b7f3-de6614dee2e6 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ff911e4-fdc7-414b-b965-76ceef12c16c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:51:32 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-89562f5a-99fc-4c2c-b7f3-de6614dee2e6 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Flow 'volume_create_manager' (56667c01-7051-45d2-8f28-2ac4e1b4a5e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:51:32 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce90d58-0862-4ea5-a5a9-b8d0964be422]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:51:32 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-5f224ffd-d427-4fb7-9ce1-6c493c7d15ab tempest-VolumesExtendTest-1772209352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1e0fe845-8b16-4ce5-ad42-a5fae08a59fe {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:32 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-89562f5a-99fc-4c2c-b7f3-de6614dee2e6 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Created volume successfully. Jun 17 05:51:32 devstack sudo[105061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1e0fe845-8b16-4ce5-ad42-a5fae08a59fe Jun 17 05:51:32 devstack sudo[105061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:33 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-a063372b-af1e-4c9e-af6f-da87ad063341 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Acquiring lock "cinder-6164c396-c37a-4b6a-9200-dde764023bad-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:51:33 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-a063372b-af1e-4c9e-af6f-da87ad063341 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Lock "cinder-6164c396-c37a-4b6a-9200-dde764023bad-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:51:33 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-a063372b-af1e-4c9e-af6f-da87ad063341 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Acquiring lock "cinder-quobyte-6164c396-c37a-4b6a-9200-dde764023bad" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:51:33 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-a063372b-af1e-4c9e-af6f-da87ad063341 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Lock "cinder-quobyte-6164c396-c37a-4b6a-9200-dde764023bad" acquired by "delete_volume" :: waited 0.018s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:51:33 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0c79ef-5b06-485b-9ee5-c93ad7b43e0b]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:51:33 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a063372b-af1e-4c9e-af6f-da87ad063341 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6164c396-c37a-4b6a-9200-dde764023bad {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:33 devstack sudo[105061]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:33 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-5f224ffd-d427-4fb7-9ce1-6c493c7d15ab tempest-VolumesExtendTest-1772209352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1e0fe845-8b16-4ce5-ad42-a5fae08a59fe" returned: 0 in 0.748s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:33 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-5f224ffd-d427-4fb7-9ce1-6c493c7d15ab tempest-VolumesExtendTest-1772209352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1e0fe845-8b16-4ce5-ad42-a5fae08a59fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1e0fe845-8b16-4ce5-ad42-a5fae08a59fe.a636bfd3-4d94-4bbf-bf85-e99a64741e2c 1G {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:33 devstack sudo[105067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1e0fe845-8b16-4ce5-ad42-a5fae08a59fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1e0fe845-8b16-4ce5-ad42-a5fae08a59fe.a636bfd3-4d94-4bbf-bf85-e99a64741e2c 1G Jun 17 05:51:33 devstack sudo[105067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:33 devstack sudo[105066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6164c396-c37a-4b6a-9200-dde764023bad Jun 17 05:51:33 devstack sudo[105066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:34 devstack sudo[105066]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:34 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a063372b-af1e-4c9e-af6f-da87ad063341 tempest-VolumeQuotasAdminTestJSON-1565282960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6164c396-c37a-4b6a-9200-dde764023bad" returned: 0 in 0.724s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:34 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a063372b-af1e-4c9e-af6f-da87ad063341 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6164c396-c37a-4b6a-9200-dde764023bad {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:34 devstack sudo[105076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6164c396-c37a-4b6a-9200-dde764023bad Jun 17 05:51:34 devstack sudo[105076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:34 devstack sudo[105067]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:34 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-5f224ffd-d427-4fb7-9ce1-6c493c7d15ab tempest-VolumesExtendTest-1772209352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1e0fe845-8b16-4ce5-ad42-a5fae08a59fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1e0fe845-8b16-4ce5-ad42-a5fae08a59fe.a636bfd3-4d94-4bbf-bf85-e99a64741e2c 1G" returned: 0 in 0.756s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:34 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-5f224ffd-d427-4fb7-9ce1-6c493c7d15ab tempest-VolumesExtendTest-1772209352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e0fe845-8b16-4ce5-ad42-a5fae08a59fe -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1e0fe845-8b16-4ce5-ad42-a5fae08a59fe.a636bfd3-4d94-4bbf-bf85-e99a64741e2c {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:34 devstack sudo[105078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e0fe845-8b16-4ce5-ad42-a5fae08a59fe -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1e0fe845-8b16-4ce5-ad42-a5fae08a59fe.a636bfd3-4d94-4bbf-bf85-e99a64741e2c Jun 17 05:51:34 devstack sudo[105078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:35 devstack sudo[105076]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:35 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a063372b-af1e-4c9e-af6f-da87ad063341 tempest-VolumeQuotasAdminTestJSON-1565282960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6164c396-c37a-4b6a-9200-dde764023bad" returned: 0 in 0.706s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:35 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-a063372b-af1e-4c9e-af6f-da87ad063341 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Lock "cinder-quobyte-6164c396-c37a-4b6a-9200-dde764023bad" released by "delete_volume" :: held 1.473s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:51:35 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-a063372b-af1e-4c9e-af6f-da87ad063341 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Created reservations ['357fbdfe-e23d-43f4-b525-0cd7aaff6ea4', '0d2df599-b444-4bb4-a251-f169236f6afa', '7b582971-07c0-47a0-9af7-60785fa60b28', '78259207-4af3-4065-bd43-23836ee63c30'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:51:35 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-a063372b-af1e-4c9e-af6f-da87ad063341 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:51:35 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-a063372b-af1e-4c9e-af6f-da87ad063341 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:51:35 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-a063372b-af1e-4c9e-af6f-da87ad063341 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:51:35 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-a063372b-af1e-4c9e-af6f-da87ad063341 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:51:35 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-a063372b-af1e-4c9e-af6f-da87ad063341 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:51:35 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a063372b-af1e-4c9e-af6f-da87ad063341 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:35 devstack sudo[105078]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:35 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-5f224ffd-d427-4fb7-9ce1-6c493c7d15ab tempest-VolumesExtendTest-1772209352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e0fe845-8b16-4ce5-ad42-a5fae08a59fe -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1e0fe845-8b16-4ce5-ad42-a5fae08a59fe.a636bfd3-4d94-4bbf-bf85-e99a64741e2c" returned: 0 in 0.775s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:35 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [None req-5f224ffd-d427-4fb7-9ce1-6c493c7d15ab tempest-VolumesExtendTest-1772209352 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1e0fe845-8b16-4ce5-ad42-a5fae08a59fe.a636bfd3-4d94-4bbf-bf85-e99a64741e2c is being set with open permissions: ugo+rw Jun 17 05:51:35 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-5f224ffd-d427-4fb7-9ce1-6c493c7d15ab tempest-VolumesExtendTest-1772209352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1e0fe845-8b16-4ce5-ad42-a5fae08a59fe.a636bfd3-4d94-4bbf-bf85-e99a64741e2c {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:35 devstack sudo[105085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:51:35 devstack sudo[105085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:35 devstack sudo[105086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1e0fe845-8b16-4ce5-ad42-a5fae08a59fe.a636bfd3-4d94-4bbf-bf85-e99a64741e2c Jun 17 05:51:35 devstack sudo[105086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:35 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-0ecfb745-c43e-4186-8dee-439f5c43cd4d tempest-TestServerVolumeAttachmentScenario-875878610 None] Acquiring lock "cinder-519f9e31-8efb-498c-a677-2da62211f5c8-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:51:35 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-0ecfb745-c43e-4186-8dee-439f5c43cd4d tempest-TestServerVolumeAttachmentScenario-875878610 None] Lock "cinder-519f9e31-8efb-498c-a677-2da62211f5c8-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:51:35 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-0ecfb745-c43e-4186-8dee-439f5c43cd4d tempest-TestServerVolumeAttachmentScenario-875878610 None] Acquiring lock "cinder-quobyte-519f9e31-8efb-498c-a677-2da62211f5c8" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:51:35 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-0ecfb745-c43e-4186-8dee-439f5c43cd4d tempest-TestServerVolumeAttachmentScenario-875878610 None] Lock "cinder-quobyte-519f9e31-8efb-498c-a677-2da62211f5c8" acquired by "delete_volume" :: waited 0.019s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:51:35 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[35031fd0-9db4-47a1-95d2-df7e5e2d83ff]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:51:35 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0ecfb745-c43e-4186-8dee-439f5c43cd4d tempest-TestServerVolumeAttachmentScenario-875878610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-519f9e31-8efb-498c-a677-2da62211f5c8 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:35 devstack sudo[105089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-519f9e31-8efb-498c-a677-2da62211f5c8 Jun 17 05:51:35 devstack sudo[105089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:35 devstack sudo[105086]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:35 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-5f224ffd-d427-4fb7-9ce1-6c493c7d15ab tempest-VolumesExtendTest-1772209352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1e0fe845-8b16-4ce5-ad42-a5fae08a59fe.a636bfd3-4d94-4bbf-bf85-e99a64741e2c" returned: 0 in 0.629s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:35 devstack sudo[105085]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:35 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a063372b-af1e-4c9e-af6f-da87ad063341 tempest-VolumeQuotasAdminTestJSON-1565282960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.656s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:35 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-a063372b-af1e-4c9e-af6f-da87ad063341 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:51:35 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-a063372b-af1e-4c9e-af6f-da87ad063341 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Deleted volume successfully. Jun 17 05:51:35 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-5f224ffd-d427-4fb7-9ce1-6c493c7d15ab tempest-VolumesExtendTest-1772209352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1e0fe845-8b16-4ce5-ad42-a5fae08a59fe.info {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:35 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-a063372b-af1e-4c9e-af6f-da87ad063341 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Lock "cinder-6164c396-c37a-4b6a-9200-dde764023bad-delete_volume" released by "delete_volume" :: held 2.369s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:51:35 devstack sudo[105093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1e0fe845-8b16-4ce5-ad42-a5fae08a59fe.info Jun 17 05:51:35 devstack sudo[105093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:36 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca2c4b87-a350-4953-9e14-ec21b5e52da9 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:51:36 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ca2c4b87-a350-4953-9e14-ec21b5e52da9 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Flow 'volume_create_manager' (c5c9c817-1607-4d23-b888-54a31203afbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:51:36 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ca2c4b87-a350-4953-9e14-ec21b5e52da9 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (217138c6-dce5-4fe9-b0e0-275045b21002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:51:36 devstack sudo[105089]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:36 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0ecfb745-c43e-4186-8dee-439f5c43cd4d tempest-TestServerVolumeAttachmentScenario-875878610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-519f9e31-8efb-498c-a677-2da62211f5c8" returned: 0 in 0.758s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:36 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0ecfb745-c43e-4186-8dee-439f5c43cd4d tempest-TestServerVolumeAttachmentScenario-875878610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-519f9e31-8efb-498c-a677-2da62211f5c8 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:36 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ca2c4b87-a350-4953-9e14-ec21b5e52da9 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (217138c6-dce5-4fe9-b0e0-275045b21002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:51:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-597957688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb110bda-2cbb-439a-9083-dc736613da74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62cbf985f1ab4a2298782f8e8821693f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:51:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:51:36Z,use_quota=True,user_id='3078795afebe4ce2bfc92daa9ef0ab86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:51:36 devstack sudo[105099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-519f9e31-8efb-498c-a677-2da62211f5c8 Jun 17 05:51:36 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ca2c4b87-a350-4953-9e14-ec21b5e52da9 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bc5adc2-e0ed-4c90-8e1b-d64e0a6a946b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:51:36 devstack sudo[105099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:36 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ca2c4b87-a350-4953-9e14-ec21b5e52da9 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bc5adc2-e0ed-4c90-8e1b-d64e0a6a946b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:51:36 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ca2c4b87-a350-4953-9e14-ec21b5e52da9 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (936adf4f-e750-4991-a902-03df1602f049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:51:36 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ca2c4b87-a350-4953-9e14-ec21b5e52da9 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (936adf4f-e750-4991-a902-03df1602f049) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb110bda-2cbb-439a-9083-dc736613da74', 'volume_name': 'volume-fb110bda-2cbb-439a-9083-dc736613da74', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:51:36 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ca2c4b87-a350-4953-9e14-ec21b5e52da9 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4f83d76-1002-4cbb-bb30-191ecf8763ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:51:36 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ca2c4b87-a350-4953-9e14-ec21b5e52da9 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4f83d76-1002-4cbb-bb30-191ecf8763ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:51:36 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ca2c4b87-a350-4953-9e14-ec21b5e52da9 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11045da8-36f8-4ca0-8ca5-0ed8bd1bfccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:51:36 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-ca2c4b87-a350-4953-9e14-ec21b5e52da9 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Volume fb110bda-2cbb-439a-9083-dc736613da74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb110bda-2cbb-439a-9083-dc736613da74', 'volume_size': 1} Jun 17 05:51:36 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ca2c4b87-a350-4953-9e14-ec21b5e52da9 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:51:36 devstack sudo[105093]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:36 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-5f224ffd-d427-4fb7-9ce1-6c493c7d15ab tempest-VolumesExtendTest-1772209352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1e0fe845-8b16-4ce5-ad42-a5fae08a59fe.info" returned: 0 in 0.633s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:36 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [None req-5f224ffd-d427-4fb7-9ce1-6c493c7d15ab tempest-VolumesExtendTest-1772209352 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1e0fe845-8b16-4ce5-ad42-a5fae08a59fe.info is being set with open permissions: ugo+rw Jun 17 05:51:36 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-5f224ffd-d427-4fb7-9ce1-6c493c7d15ab tempest-VolumesExtendTest-1772209352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1e0fe845-8b16-4ce5-ad42-a5fae08a59fe.info {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:36 devstack sudo[105102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1e0fe845-8b16-4ce5-ad42-a5fae08a59fe.info Jun 17 05:51:36 devstack sudo[105102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:36 devstack sudo[105099]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:36 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0ecfb745-c43e-4186-8dee-439f5c43cd4d tempest-TestServerVolumeAttachmentScenario-875878610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-519f9e31-8efb-498c-a677-2da62211f5c8" returned: 0 in 0.590s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:36 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-0ecfb745-c43e-4186-8dee-439f5c43cd4d tempest-TestServerVolumeAttachmentScenario-875878610 None] Lock "cinder-quobyte-519f9e31-8efb-498c-a677-2da62211f5c8" released by "delete_volume" :: held 1.388s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:51:36 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-0ecfb745-c43e-4186-8dee-439f5c43cd4d tempest-TestServerVolumeAttachmentScenario-875878610 None] Created reservations ['34da631a-ee93-49a5-8a17-a6e574fb7e87', 'f418501b-be82-40ab-9d4f-d57277e76204', '5fb9b55b-ced2-45dd-98f1-be8dc13fe27a', 'c8bdce37-446a-4bd3-96a0-41b4da4bef31'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:51:36 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-0ecfb745-c43e-4186-8dee-439f5c43cd4d tempest-TestServerVolumeAttachmentScenario-875878610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:51:36 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-0ecfb745-c43e-4186-8dee-439f5c43cd4d tempest-TestServerVolumeAttachmentScenario-875878610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:51:36 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-0ecfb745-c43e-4186-8dee-439f5c43cd4d tempest-TestServerVolumeAttachmentScenario-875878610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:51:36 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-0ecfb745-c43e-4186-8dee-439f5c43cd4d tempest-TestServerVolumeAttachmentScenario-875878610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:51:36 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-0ecfb745-c43e-4186-8dee-439f5c43cd4d tempest-TestServerVolumeAttachmentScenario-875878610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:51:36 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0ecfb745-c43e-4186-8dee-439f5c43cd4d tempest-TestServerVolumeAttachmentScenario-875878610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:37 devstack sudo[105106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:51:37 devstack sudo[105106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:37 devstack sudo[105102]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:37 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-5f224ffd-d427-4fb7-9ce1-6c493c7d15ab tempest-VolumesExtendTest-1772209352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1e0fe845-8b16-4ce5-ad42-a5fae08a59fe.info" returned: 0 in 0.601s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:37 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-5f224ffd-d427-4fb7-9ce1-6c493c7d15ab tempest-VolumesExtendTest-1772209352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.280s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:51:37 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ca2c4b87-a350-4953-9e14-ec21b5e52da9 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.776s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:51:37 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ca2c4b87-a350-4953-9e14-ec21b5e52da9 tempest-VolumeQuotasAdminTestJSON-1565282960 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:51:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-597957688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb110bda-2cbb-439a-9083-dc736613da74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62cbf985f1ab4a2298782f8e8821693f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:51:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:51:36Z,use_quota=True,user_id='3078795afebe4ce2bfc92daa9ef0ab86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:51:37 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-ca2c4b87-a350-4953-9e14-ec21b5e52da9 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Creating volume fb110bda-2cbb-439a-9083-dc736613da74 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:51:37 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ca2c4b87-a350-4953-9e14-ec21b5e52da9 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:51:37 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ca2c4b87-a350-4953-9e14-ec21b5e52da9 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:51:37 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ca2c4b87-a350-4953-9e14-ec21b5e52da9 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:51:37 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ca2c4b87-a350-4953-9e14-ec21b5e52da9 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:51:37 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ca2c4b87-a350-4953-9e14-ec21b5e52da9 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:51:37 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ca2c4b87-a350-4953-9e14-ec21b5e52da9 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:51:37 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-ca2c4b87-a350-4953-9e14-ec21b5e52da9 tempest-VolumeQuotasAdminTestJSON-1565282960 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:51:37 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ca2c4b87-a350-4953-9e14-ec21b5e52da9 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-fb110bda-2cbb-439a-9083-dc736613da74 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:37 devstack sudo[105108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-fb110bda-2cbb-439a-9083-dc736613da74 1073741824 Jun 17 05:51:37 devstack sudo[105108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:37 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-5f224ffd-d427-4fb7-9ce1-6c493c7d15ab tempest-VolumesExtendTest-1772209352 None] Create snapshot completed successfully Jun 17 05:51:37 devstack sudo[105106]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:37 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0ecfb745-c43e-4186-8dee-439f5c43cd4d tempest-TestServerVolumeAttachmentScenario-875878610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.598s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:37 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-0ecfb745-c43e-4186-8dee-439f5c43cd4d tempest-TestServerVolumeAttachmentScenario-875878610 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:51:37 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-0ecfb745-c43e-4186-8dee-439f5c43cd4d tempest-TestServerVolumeAttachmentScenario-875878610 None] Deleted volume successfully. Jun 17 05:51:37 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-0ecfb745-c43e-4186-8dee-439f5c43cd4d tempest-TestServerVolumeAttachmentScenario-875878610 None] Lock "cinder-519f9e31-8efb-498c-a677-2da62211f5c8-delete_volume" released by "delete_volume" :: held 2.210s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:51:37 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-7e68fc83-1977-43d2-918f-841e1f641885 tempest-TestServerVolumeAttachmentScenario-875878610 None] Acquiring lock "cinder-fa25d0a5-e5bb-4bce-a035-5989951230bd-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:51:37 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-7e68fc83-1977-43d2-918f-841e1f641885 tempest-TestServerVolumeAttachmentScenario-875878610 None] Lock "cinder-fa25d0a5-e5bb-4bce-a035-5989951230bd-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:51:37 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-7e68fc83-1977-43d2-918f-841e1f641885 tempest-TestServerVolumeAttachmentScenario-875878610 None] Acquiring lock "cinder-quobyte-fa25d0a5-e5bb-4bce-a035-5989951230bd" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:51:37 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-7e68fc83-1977-43d2-918f-841e1f641885 tempest-TestServerVolumeAttachmentScenario-875878610 None] Lock "cinder-quobyte-fa25d0a5-e5bb-4bce-a035-5989951230bd" acquired by "delete_volume" :: waited 0.017s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:51:37 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cbad843-7428-4efe-9d64-70bb80379563]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:51:37 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-7e68fc83-1977-43d2-918f-841e1f641885 tempest-TestServerVolumeAttachmentScenario-875878610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-fa25d0a5-e5bb-4bce-a035-5989951230bd {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:37 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-a010b204-cf0f-4e9b-9cf4-3eebc7657fd3 tempest-VolumesExtendTest-1772209352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:51:37 devstack sudo[105114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-fa25d0a5-e5bb-4bce-a035-5989951230bd Jun 17 05:51:37 devstack sudo[105114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:37 devstack sudo[105108]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:37 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ca2c4b87-a350-4953-9e14-ec21b5e52da9 tempest-VolumeQuotasAdminTestJSON-1565282960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-fb110bda-2cbb-439a-9083-dc736613da74 1073741824" returned: 0 in 0.839s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:37 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ca2c4b87-a350-4953-9e14-ec21b5e52da9 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-fb110bda-2cbb-439a-9083-dc736613da74 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:38 devstack sudo[105117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-fb110bda-2cbb-439a-9083-dc736613da74 Jun 17 05:51:38 devstack sudo[105117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:38 devstack sudo[105114]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:38 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-7e68fc83-1977-43d2-918f-841e1f641885 tempest-TestServerVolumeAttachmentScenario-875878610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-fa25d0a5-e5bb-4bce-a035-5989951230bd" returned: 0 in 0.732s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:38 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-7e68fc83-1977-43d2-918f-841e1f641885 tempest-TestServerVolumeAttachmentScenario-875878610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-fa25d0a5-e5bb-4bce-a035-5989951230bd {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:38 devstack sudo[105122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-fa25d0a5-e5bb-4bce-a035-5989951230bd Jun 17 05:51:38 devstack sudo[105122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:38 devstack sudo[105117]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:38 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ca2c4b87-a350-4953-9e14-ec21b5e52da9 tempest-VolumeQuotasAdminTestJSON-1565282960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-fb110bda-2cbb-439a-9083-dc736613da74" returned: 0 in 0.611s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:38 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ca2c4b87-a350-4953-9e14-ec21b5e52da9 tempest-VolumeQuotasAdminTestJSON-1565282960 None] <== create_volume: return (1491ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:51:38 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ca2c4b87-a350-4953-9e14-ec21b5e52da9 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.495s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:51:38 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-a010b204-cf0f-4e9b-9cf4-3eebc7657fd3 tempest-VolumesExtendTest-1772209352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.827s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:51:38 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ca2c4b87-a350-4953-9e14-ec21b5e52da9 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11045da8-36f8-4ca0-8ca5-0ed8bd1bfccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb110bda-2cbb-439a-9083-dc736613da74', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:51:38 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ca2c4b87-a350-4953-9e14-ec21b5e52da9 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (179b3b31-4b1b-4e75-8591-3929dbf13867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:51:38 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[031fabb3-4a9e-4dc0-a1b6-5154fb818a71]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:51:38 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a010b204-cf0f-4e9b-9cf4-3eebc7657fd3 tempest-VolumesExtendTest-1772209352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1e0fe845-8b16-4ce5-ad42-a5fae08a59fe {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:38 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-ca2c4b87-a350-4953-9e14-ec21b5e52da9 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Volume volume-fb110bda-2cbb-439a-9083-dc736613da74 (fb110bda-2cbb-439a-9083-dc736613da74): created successfully Jun 17 05:51:38 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ca2c4b87-a350-4953-9e14-ec21b5e52da9 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (179b3b31-4b1b-4e75-8591-3929dbf13867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:51:38 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ca2c4b87-a350-4953-9e14-ec21b5e52da9 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Flow 'volume_create_manager' (c5c9c817-1607-4d23-b888-54a31203afbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:51:38 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-ca2c4b87-a350-4953-9e14-ec21b5e52da9 tempest-VolumeQuotasAdminTestJSON-1565282960 None] Created volume successfully. Jun 17 05:51:38 devstack sudo[105125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1e0fe845-8b16-4ce5-ad42-a5fae08a59fe Jun 17 05:51:38 devstack sudo[105125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:39 devstack sudo[105122]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-7e68fc83-1977-43d2-918f-841e1f641885 tempest-TestServerVolumeAttachmentScenario-875878610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-fa25d0a5-e5bb-4bce-a035-5989951230bd" returned: 0 in 0.612s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:39 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-7e68fc83-1977-43d2-918f-841e1f641885 tempest-TestServerVolumeAttachmentScenario-875878610 None] Lock "cinder-quobyte-fa25d0a5-e5bb-4bce-a035-5989951230bd" released by "delete_volume" :: held 1.389s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:51:39 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-7e68fc83-1977-43d2-918f-841e1f641885 tempest-TestServerVolumeAttachmentScenario-875878610 None] Created reservations ['c54230ed-854b-4dea-9aec-115e8fedef97', '28aa71b3-b98d-4661-a5fd-b2763778a253', '12b0f134-4593-4aea-b140-07524e775dfc', 'fb60a48e-8e82-453e-8a64-71bc0fa9c511'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:51:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-7e68fc83-1977-43d2-918f-841e1f641885 tempest-TestServerVolumeAttachmentScenario-875878610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:51:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-7e68fc83-1977-43d2-918f-841e1f641885 tempest-TestServerVolumeAttachmentScenario-875878610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:51:39 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-7e68fc83-1977-43d2-918f-841e1f641885 tempest-TestServerVolumeAttachmentScenario-875878610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:51:39 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-7e68fc83-1977-43d2-918f-841e1f641885 tempest-TestServerVolumeAttachmentScenario-875878610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:51:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-7e68fc83-1977-43d2-918f-841e1f641885 tempest-TestServerVolumeAttachmentScenario-875878610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:51:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-7e68fc83-1977-43d2-918f-841e1f641885 tempest-TestServerVolumeAttachmentScenario-875878610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:39 devstack sudo[105129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:51:39 devstack sudo[105129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:39 devstack sudo[105125]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a010b204-cf0f-4e9b-9cf4-3eebc7657fd3 tempest-VolumesExtendTest-1772209352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1e0fe845-8b16-4ce5-ad42-a5fae08a59fe" returned: 0 in 0.725s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a010b204-cf0f-4e9b-9cf4-3eebc7657fd3 tempest-VolumesExtendTest-1772209352 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1e0fe845-8b16-4ce5-ad42-a5fae08a59fe.a636bfd3-4d94-4bbf-bf85-e99a64741e2c 2G {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a010b204-cf0f-4e9b-9cf4-3eebc7657fd3 tempest-VolumesExtendTest-1772209352 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1e0fe845-8b16-4ce5-ad42-a5fae08a59fe.a636bfd3-4d94-4bbf-bf85-e99a64741e2c 2G" returned: 0 in 0.172s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-a010b204-cf0f-4e9b-9cf4-3eebc7657fd3 tempest-VolumesExtendTest-1772209352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.953s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:51:39 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-a010b204-cf0f-4e9b-9cf4-3eebc7657fd3 tempest-VolumesExtendTest-1772209352 None] Extend volume completed successfully. Jun 17 05:51:39 devstack sudo[105129]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-7e68fc83-1977-43d2-918f-841e1f641885 tempest-TestServerVolumeAttachmentScenario-875878610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.672s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:39 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-7e68fc83-1977-43d2-918f-841e1f641885 tempest-TestServerVolumeAttachmentScenario-875878610 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:51:39 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-7e68fc83-1977-43d2-918f-841e1f641885 tempest-TestServerVolumeAttachmentScenario-875878610 None] Deleted volume successfully. Jun 17 05:51:39 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-7e68fc83-1977-43d2-918f-841e1f641885 tempest-TestServerVolumeAttachmentScenario-875878610 None] Lock "cinder-fa25d0a5-e5bb-4bce-a035-5989951230bd-delete_volume" released by "delete_volume" :: held 2.262s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:51:40 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-48599498-fc2e-4677-ade4-f1d60f54d0b7 tempest-VolumesExtendTest-1772209352 None] Acquiring lock "cinder-a636bfd3-4d94-4bbf-bf85-e99a64741e2c-delete_snapshot" by "delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:51:40 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-48599498-fc2e-4677-ade4-f1d60f54d0b7 tempest-VolumesExtendTest-1772209352 None] Lock "cinder-a636bfd3-4d94-4bbf-bf85-e99a64741e2c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:51:40 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-48599498-fc2e-4677-ade4-f1d60f54d0b7 tempest-VolumesExtendTest-1772209352 None] Acquiring lock "cinder-quobyte-1e0fe845-8b16-4ce5-ad42-a5fae08a59fe" by "delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:51:40 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-48599498-fc2e-4677-ade4-f1d60f54d0b7 tempest-VolumesExtendTest-1772209352 None] Lock "cinder-quobyte-1e0fe845-8b16-4ce5-ad42-a5fae08a59fe" acquired by "delete_snapshot" :: waited 0.026s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:51:40 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-48599498-fc2e-4677-ade4-f1d60f54d0b7 tempest-VolumesExtendTest-1772209352 None] Acquiring lock "cinder-quobyte-a636bfd3-4d94-4bbf-bf85-e99a64741e2c" by "_delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:51:40 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-2f4742a9-d4d8-4992-8466-0b64320547a5 tempest-VolumeQuotasAdminTestJSON-1506515110 None] Transfer volume completed successfully. Jun 17 05:51:40 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-48599498-fc2e-4677-ade4-f1d60f54d0b7 tempest-VolumesExtendTest-1772209352 None] Lock "cinder-quobyte-a636bfd3-4d94-4bbf-bf85-e99a64741e2c" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:51:40 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-48599498-fc2e-4677-ade4-f1d60f54d0b7 tempest-VolumesExtendTest-1772209352 None] Deleting offline snapshot a636bfd3-4d94-4bbf-bf85-e99a64741e2c of volume 1e0fe845-8b16-4ce5-ad42-a5fae08a59fe {{(pid=92083) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 17 05:51:40 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-48599498-fc2e-4677-ade4-f1d60f54d0b7 tempest-VolumesExtendTest-1772209352 None] snapshot_file for this snap is: volume-1e0fe845-8b16-4ce5-ad42-a5fae08a59fe.a636bfd3-4d94-4bbf-bf85-e99a64741e2c {{(pid=92083) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 17 05:51:40 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab61effe-355d-426f-84a7-61f8f4ed491a]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:51:40 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-48599498-fc2e-4677-ade4-f1d60f54d0b7 tempest-VolumesExtendTest-1772209352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1e0fe845-8b16-4ce5-ad42-a5fae08a59fe.a636bfd3-4d94-4bbf-bf85-e99a64741e2c {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:40 devstack sudo[105139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1e0fe845-8b16-4ce5-ad42-a5fae08a59fe.a636bfd3-4d94-4bbf-bf85-e99a64741e2c Jun 17 05:51:40 devstack sudo[105139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:40 devstack sudo[105139]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:40 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-48599498-fc2e-4677-ade4-f1d60f54d0b7 tempest-VolumesExtendTest-1772209352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1e0fe845-8b16-4ce5-ad42-a5fae08a59fe.a636bfd3-4d94-4bbf-bf85-e99a64741e2c" returned: 0 in 0.761s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:40 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-48599498-fc2e-4677-ade4-f1d60f54d0b7 tempest-VolumesExtendTest-1772209352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e0fe845-8b16-4ce5-ad42-a5fae08a59fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92083) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 05:51:40 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8436f5-c75d-4ec0-abd8-cf5608c86a5f]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:51:40 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-48599498-fc2e-4677-ade4-f1d60f54d0b7 tempest-VolumesExtendTest-1772209352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1e0fe845-8b16-4ce5-ad42-a5fae08a59fe {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:41 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-238584e1-111b-4954-aef6-7cfdb6cc2f8b tempest-VolumeQuotasAdminTestJSON-1069097914 None] Acquiring lock "cinder-fb110bda-2cbb-439a-9083-dc736613da74-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:51:41 devstack sudo[105144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1e0fe845-8b16-4ce5-ad42-a5fae08a59fe Jun 17 05:51:41 devstack sudo[105144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:41 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-238584e1-111b-4954-aef6-7cfdb6cc2f8b tempest-VolumeQuotasAdminTestJSON-1069097914 None] Lock "cinder-fb110bda-2cbb-439a-9083-dc736613da74-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:51:41 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-238584e1-111b-4954-aef6-7cfdb6cc2f8b tempest-VolumeQuotasAdminTestJSON-1069097914 None] Acquiring lock "cinder-quobyte-fb110bda-2cbb-439a-9083-dc736613da74" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:51:41 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-238584e1-111b-4954-aef6-7cfdb6cc2f8b tempest-VolumeQuotasAdminTestJSON-1069097914 None] Lock "cinder-quobyte-fb110bda-2cbb-439a-9083-dc736613da74" acquired by "delete_volume" :: waited 0.015s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:51:41 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[25014fc2-646f-46a6-9068-587a99fd8ae2]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:51:41 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-238584e1-111b-4954-aef6-7cfdb6cc2f8b tempest-VolumeQuotasAdminTestJSON-1069097914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-fb110bda-2cbb-439a-9083-dc736613da74 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:41 devstack sudo[105146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-fb110bda-2cbb-439a-9083-dc736613da74 Jun 17 05:51:41 devstack sudo[105146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:41 devstack sudo[105144]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:41 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-48599498-fc2e-4677-ade4-f1d60f54d0b7 tempest-VolumesExtendTest-1772209352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1e0fe845-8b16-4ce5-ad42-a5fae08a59fe" returned: 0 in 0.746s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:41 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-48599498-fc2e-4677-ade4-f1d60f54d0b7 tempest-VolumesExtendTest-1772209352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1e0fe845-8b16-4ce5-ad42-a5fae08a59fe.a636bfd3-4d94-4bbf-bf85-e99a64741e2c {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:41 devstack sudo[105152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1e0fe845-8b16-4ce5-ad42-a5fae08a59fe.a636bfd3-4d94-4bbf-bf85-e99a64741e2c Jun 17 05:51:41 devstack sudo[105152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:41 devstack sudo[105146]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:41 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-238584e1-111b-4954-aef6-7cfdb6cc2f8b tempest-VolumeQuotasAdminTestJSON-1069097914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-fb110bda-2cbb-439a-9083-dc736613da74" returned: 0 in 0.758s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:41 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-238584e1-111b-4954-aef6-7cfdb6cc2f8b tempest-VolumeQuotasAdminTestJSON-1069097914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-fb110bda-2cbb-439a-9083-dc736613da74 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:41 devstack sudo[105157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-fb110bda-2cbb-439a-9083-dc736613da74 Jun 17 05:51:41 devstack sudo[105157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:42 devstack sudo[105152]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-48599498-fc2e-4677-ade4-f1d60f54d0b7 tempest-VolumesExtendTest-1772209352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1e0fe845-8b16-4ce5-ad42-a5fae08a59fe.a636bfd3-4d94-4bbf-bf85-e99a64741e2c" returned: 0 in 0.808s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-48599498-fc2e-4677-ade4-f1d60f54d0b7 tempest-VolumesExtendTest-1772209352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1e0fe845-8b16-4ce5-ad42-a5fae08a59fe.a636bfd3-4d94-4bbf-bf85-e99a64741e2c {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:42 devstack sudo[105164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1e0fe845-8b16-4ce5-ad42-a5fae08a59fe.a636bfd3-4d94-4bbf-bf85-e99a64741e2c Jun 17 05:51:42 devstack sudo[105164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:42 devstack sudo[105157]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-238584e1-111b-4954-aef6-7cfdb6cc2f8b tempest-VolumeQuotasAdminTestJSON-1069097914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-fb110bda-2cbb-439a-9083-dc736613da74" returned: 0 in 0.663s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:42 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-238584e1-111b-4954-aef6-7cfdb6cc2f8b tempest-VolumeQuotasAdminTestJSON-1069097914 None] Lock "cinder-quobyte-fb110bda-2cbb-439a-9083-dc736613da74" released by "delete_volume" :: held 1.478s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:51:42 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-238584e1-111b-4954-aef6-7cfdb6cc2f8b tempest-VolumeQuotasAdminTestJSON-1069097914 None] Created reservations ['f8da5288-2ac2-4f01-bd4d-c008838e23d2', 'f6310875-7778-4b4d-8825-ffcaee595457', 'eb990430-e8b6-4b55-8ac0-3143d556d93e', '0a5abe48-82fd-4ef8-a669-f6a597259e6d'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:51:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-238584e1-111b-4954-aef6-7cfdb6cc2f8b tempest-VolumeQuotasAdminTestJSON-1069097914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:51:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-238584e1-111b-4954-aef6-7cfdb6cc2f8b tempest-VolumeQuotasAdminTestJSON-1069097914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:51:42 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-238584e1-111b-4954-aef6-7cfdb6cc2f8b tempest-VolumeQuotasAdminTestJSON-1069097914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:51:42 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-238584e1-111b-4954-aef6-7cfdb6cc2f8b tempest-VolumeQuotasAdminTestJSON-1069097914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:51:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-238584e1-111b-4954-aef6-7cfdb6cc2f8b tempest-VolumeQuotasAdminTestJSON-1069097914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:51:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-238584e1-111b-4954-aef6-7cfdb6cc2f8b tempest-VolumeQuotasAdminTestJSON-1069097914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:42 devstack sudo[105166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:51:42 devstack sudo[105166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:43 devstack sudo[105164]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:43 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-48599498-fc2e-4677-ade4-f1d60f54d0b7 tempest-VolumesExtendTest-1772209352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1e0fe845-8b16-4ce5-ad42-a5fae08a59fe.a636bfd3-4d94-4bbf-bf85-e99a64741e2c" returned: 0 in 0.767s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:43 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-48599498-fc2e-4677-ade4-f1d60f54d0b7 tempest-VolumesExtendTest-1772209352 None] Lock "cinder-quobyte-a636bfd3-4d94-4bbf-bf85-e99a64741e2c" released by "_delete_snapshot" :: held 3.196s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:51:43 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-48599498-fc2e-4677-ade4-f1d60f54d0b7 tempest-VolumesExtendTest-1772209352 None] Lock "cinder-quobyte-1e0fe845-8b16-4ce5-ad42-a5fae08a59fe" released by "delete_snapshot" :: held 3.224s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:51:43 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-48599498-fc2e-4677-ade4-f1d60f54d0b7 tempest-VolumesExtendTest-1772209352 None] Created reservations ['058022b2-2752-4e8d-91e2-d26b12a0c3ed', '470490c2-fcc9-4adb-b929-6b49d465179e', '80eaed51-c09d-4322-ba10-a1ef865ee443', '0e93dd93-58d2-49cb-b844-5a5ac53ed96e'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:51:43 devstack sudo[105166]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:43 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-48599498-fc2e-4677-ade4-f1d60f54d0b7 tempest-VolumesExtendTest-1772209352 None] Delete snapshot completed successfully. Jun 17 05:51:43 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-238584e1-111b-4954-aef6-7cfdb6cc2f8b tempest-VolumeQuotasAdminTestJSON-1069097914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.702s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:43 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-238584e1-111b-4954-aef6-7cfdb6cc2f8b tempest-VolumeQuotasAdminTestJSON-1069097914 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:51:43 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-48599498-fc2e-4677-ade4-f1d60f54d0b7 tempest-VolumesExtendTest-1772209352 None] Lock "cinder-a636bfd3-4d94-4bbf-bf85-e99a64741e2c-delete_snapshot" released by "delete_snapshot" :: held 3.409s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:51:43 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-238584e1-111b-4954-aef6-7cfdb6cc2f8b tempest-VolumeQuotasAdminTestJSON-1069097914 None] Deleted volume successfully. Jun 17 05:51:43 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-238584e1-111b-4954-aef6-7cfdb6cc2f8b tempest-VolumeQuotasAdminTestJSON-1069097914 None] Lock "cinder-fb110bda-2cbb-439a-9083-dc736613da74-delete_volume" released by "delete_volume" :: held 2.447s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:51:44 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-295a7b9b-0947-46ea-a1bf-b7a6b5d46228 tempest-VolumesExtendTest-1772209352 None] Acquiring lock "cinder-1e0fe845-8b16-4ce5-ad42-a5fae08a59fe-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:51:44 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-295a7b9b-0947-46ea-a1bf-b7a6b5d46228 tempest-VolumesExtendTest-1772209352 None] Lock "cinder-1e0fe845-8b16-4ce5-ad42-a5fae08a59fe-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:51:44 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-295a7b9b-0947-46ea-a1bf-b7a6b5d46228 tempest-VolumesExtendTest-1772209352 None] Acquiring lock "cinder-quobyte-1e0fe845-8b16-4ce5-ad42-a5fae08a59fe" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:51:44 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-295a7b9b-0947-46ea-a1bf-b7a6b5d46228 tempest-VolumesExtendTest-1772209352 None] Lock "cinder-quobyte-1e0fe845-8b16-4ce5-ad42-a5fae08a59fe" acquired by "delete_volume" :: waited 0.015s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:51:44 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c6419c-069a-4a2d-a205-a307a7a90448]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:51:44 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-295a7b9b-0947-46ea-a1bf-b7a6b5d46228 tempest-VolumesExtendTest-1772209352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1e0fe845-8b16-4ce5-ad42-a5fae08a59fe {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:44 devstack sudo[105171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1e0fe845-8b16-4ce5-ad42-a5fae08a59fe Jun 17 05:51:44 devstack sudo[105171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:45 devstack sudo[105171]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:45 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-295a7b9b-0947-46ea-a1bf-b7a6b5d46228 tempest-VolumesExtendTest-1772209352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1e0fe845-8b16-4ce5-ad42-a5fae08a59fe" returned: 0 in 0.782s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:45 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-295a7b9b-0947-46ea-a1bf-b7a6b5d46228 tempest-VolumesExtendTest-1772209352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1e0fe845-8b16-4ce5-ad42-a5fae08a59fe {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:45 devstack sudo[105177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1e0fe845-8b16-4ce5-ad42-a5fae08a59fe Jun 17 05:51:45 devstack sudo[105177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:45 devstack sudo[105177]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:45 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-295a7b9b-0947-46ea-a1bf-b7a6b5d46228 tempest-VolumesExtendTest-1772209352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-1e0fe845-8b16-4ce5-ad42-a5fae08a59fe" returned: 0 in 0.657s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:46 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-295a7b9b-0947-46ea-a1bf-b7a6b5d46228 tempest-VolumesExtendTest-1772209352 None] Lock "cinder-quobyte-1e0fe845-8b16-4ce5-ad42-a5fae08a59fe" released by "delete_volume" :: held 1.510s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:51:46 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-295a7b9b-0947-46ea-a1bf-b7a6b5d46228 tempest-VolumesExtendTest-1772209352 None] Created reservations ['92788443-92fe-49b6-b1ac-e285a426fe93', 'de5282dc-d066-4f61-9b34-9bde9ed87082', '98d37249-a66d-4af7-8e1c-5fb198e049bc', '2865a6fe-7b31-40d4-ad02-38dbf246f930'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:51:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-295a7b9b-0947-46ea-a1bf-b7a6b5d46228 tempest-VolumesExtendTest-1772209352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:51:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-295a7b9b-0947-46ea-a1bf-b7a6b5d46228 tempest-VolumesExtendTest-1772209352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:51:46 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-295a7b9b-0947-46ea-a1bf-b7a6b5d46228 tempest-VolumesExtendTest-1772209352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:51:46 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-295a7b9b-0947-46ea-a1bf-b7a6b5d46228 tempest-VolumesExtendTest-1772209352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:51:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-295a7b9b-0947-46ea-a1bf-b7a6b5d46228 tempest-VolumesExtendTest-1772209352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:51:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-295a7b9b-0947-46ea-a1bf-b7a6b5d46228 tempest-VolumesExtendTest-1772209352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:46 devstack sudo[105180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:51:46 devstack sudo[105180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:46 devstack sudo[105180]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-295a7b9b-0947-46ea-a1bf-b7a6b5d46228 tempest-VolumesExtendTest-1772209352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.832s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:46 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-295a7b9b-0947-46ea-a1bf-b7a6b5d46228 tempest-VolumesExtendTest-1772209352 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:51:46 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-295a7b9b-0947-46ea-a1bf-b7a6b5d46228 tempest-VolumesExtendTest-1772209352 None] Deleted volume successfully. Jun 17 05:51:47 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-295a7b9b-0947-46ea-a1bf-b7a6b5d46228 tempest-VolumesExtendTest-1772209352 None] Lock "cinder-1e0fe845-8b16-4ce5-ad42-a5fae08a59fe-delete_volume" released by "delete_volume" :: held 2.576s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:51:50 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5386444-c9a8-495c-a03d-e19aa7b757ed tempest-VolumesNegativeTest-758418413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:51:50 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b5386444-c9a8-495c-a03d-e19aa7b757ed tempest-VolumesNegativeTest-758418413 None] Flow 'volume_create_manager' (3f993f92-6cdf-4132-9de3-47bdb1299100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:51:50 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b5386444-c9a8-495c-a03d-e19aa7b757ed tempest-VolumesNegativeTest-758418413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (384cf777-72b7-41da-83d6-b44b7baf0ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:51:50 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b5386444-c9a8-495c-a03d-e19aa7b757ed tempest-VolumesNegativeTest-758418413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (384cf777-72b7-41da-83d6-b44b7baf0ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:51:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-124795590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=294c802b-0e74-43d6-8c92-889fc47b553a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b79c758782d4478951679d1ac08946f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:51:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:51:51Z,use_quota=True,user_id='de3f77c2e5df4b10834993d3f4ca0b2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:51:50 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b5386444-c9a8-495c-a03d-e19aa7b757ed tempest-VolumesNegativeTest-758418413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9beaea72-d3d9-4a0a-b4fa-d454df9b0b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:51:50 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b5386444-c9a8-495c-a03d-e19aa7b757ed tempest-VolumesNegativeTest-758418413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9beaea72-d3d9-4a0a-b4fa-d454df9b0b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:51:50 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b5386444-c9a8-495c-a03d-e19aa7b757ed tempest-VolumesNegativeTest-758418413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09216b38-929f-4e0f-88b8-2bd3a9865472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:51:50 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b5386444-c9a8-495c-a03d-e19aa7b757ed tempest-VolumesNegativeTest-758418413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09216b38-929f-4e0f-88b8-2bd3a9865472) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '294c802b-0e74-43d6-8c92-889fc47b553a', 'volume_name': 'volume-294c802b-0e74-43d6-8c92-889fc47b553a', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:51:50 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b5386444-c9a8-495c-a03d-e19aa7b757ed tempest-VolumesNegativeTest-758418413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45ea9b5e-105b-41f6-bfd3-e9389ed57d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:51:50 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b5386444-c9a8-495c-a03d-e19aa7b757ed tempest-VolumesNegativeTest-758418413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45ea9b5e-105b-41f6-bfd3-e9389ed57d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:51:50 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b5386444-c9a8-495c-a03d-e19aa7b757ed tempest-VolumesNegativeTest-758418413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f78864e7-9dad-4ae7-a0fc-b82eb795497c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:51:50 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-b5386444-c9a8-495c-a03d-e19aa7b757ed tempest-VolumesNegativeTest-758418413 None] Volume 294c802b-0e74-43d6-8c92-889fc47b553a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-294c802b-0e74-43d6-8c92-889fc47b553a', 'volume_size': 1} Jun 17 05:51:50 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-b5386444-c9a8-495c-a03d-e19aa7b757ed tempest-VolumesNegativeTest-758418413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:51:50 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-b5386444-c9a8-495c-a03d-e19aa7b757ed tempest-VolumesNegativeTest-758418413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:51:50 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-b5386444-c9a8-495c-a03d-e19aa7b757ed tempest-VolumesNegativeTest-758418413 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:51:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-124795590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=294c802b-0e74-43d6-8c92-889fc47b553a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b79c758782d4478951679d1ac08946f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:51:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:51:51Z,use_quota=True,user_id='de3f77c2e5df4b10834993d3f4ca0b2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:51:50 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-b5386444-c9a8-495c-a03d-e19aa7b757ed tempest-VolumesNegativeTest-758418413 None] Creating volume 294c802b-0e74-43d6-8c92-889fc47b553a {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:51:50 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-b5386444-c9a8-495c-a03d-e19aa7b757ed tempest-VolumesNegativeTest-758418413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:51:50 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-b5386444-c9a8-495c-a03d-e19aa7b757ed tempest-VolumesNegativeTest-758418413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:51:50 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-b5386444-c9a8-495c-a03d-e19aa7b757ed tempest-VolumesNegativeTest-758418413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:51:50 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-b5386444-c9a8-495c-a03d-e19aa7b757ed tempest-VolumesNegativeTest-758418413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:51:50 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-b5386444-c9a8-495c-a03d-e19aa7b757ed tempest-VolumesNegativeTest-758418413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:51:50 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-b5386444-c9a8-495c-a03d-e19aa7b757ed tempest-VolumesNegativeTest-758418413 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:51:50 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-b5386444-c9a8-495c-a03d-e19aa7b757ed tempest-VolumesNegativeTest-758418413 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:51:50 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b5386444-c9a8-495c-a03d-e19aa7b757ed tempest-VolumesNegativeTest-758418413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-294c802b-0e74-43d6-8c92-889fc47b553a 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:51 devstack sudo[105185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-294c802b-0e74-43d6-8c92-889fc47b553a 1073741824 Jun 17 05:51:51 devstack sudo[105185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:51 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2950b3b-0cef-4950-82f6-90ea7653e051 tempest-CreateVolumesFromSnapshotTest-268034479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:51:51 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b2950b3b-0cef-4950-82f6-90ea7653e051 tempest-CreateVolumesFromSnapshotTest-268034479 None] Flow 'volume_create_manager' (92e1324d-b84c-4394-9aee-7ac256c97ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:51:51 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b2950b3b-0cef-4950-82f6-90ea7653e051 tempest-CreateVolumesFromSnapshotTest-268034479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f625b478-48b8-4a2e-a8ca-d4c08139c6ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:51:51 devstack sudo[105185]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:51 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b2950b3b-0cef-4950-82f6-90ea7653e051 tempest-CreateVolumesFromSnapshotTest-268034479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f625b478-48b8-4a2e-a8ca-d4c08139c6ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:51:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-807209496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4c459f4-7021-4f41-9556-e556e063d9a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8716964877da422595daa29dd3cae9f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:51:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:51:52Z,use_quota=True,user_id='374fe51754214ee58f422397d5891eaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:51:51 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b2950b3b-0cef-4950-82f6-90ea7653e051 tempest-CreateVolumesFromSnapshotTest-268034479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d1591de-84d5-4d48-becc-d1edcbc16c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:51:51 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b2950b3b-0cef-4950-82f6-90ea7653e051 tempest-CreateVolumesFromSnapshotTest-268034479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d1591de-84d5-4d48-becc-d1edcbc16c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:51:51 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b2950b3b-0cef-4950-82f6-90ea7653e051 tempest-CreateVolumesFromSnapshotTest-268034479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b799e553-2c4d-493c-b8f6-e88b49e21678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:51:51 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b2950b3b-0cef-4950-82f6-90ea7653e051 tempest-CreateVolumesFromSnapshotTest-268034479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b799e553-2c4d-493c-b8f6-e88b49e21678) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4c459f4-7021-4f41-9556-e556e063d9a6', 'volume_name': 'volume-f4c459f4-7021-4f41-9556-e556e063d9a6', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:51:51 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b2950b3b-0cef-4950-82f6-90ea7653e051 tempest-CreateVolumesFromSnapshotTest-268034479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6c55df5-75ab-42d8-b8e3-917cd42c76d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:51:51 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b2950b3b-0cef-4950-82f6-90ea7653e051 tempest-CreateVolumesFromSnapshotTest-268034479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6c55df5-75ab-42d8-b8e3-917cd42c76d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:51:51 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b2950b3b-0cef-4950-82f6-90ea7653e051 tempest-CreateVolumesFromSnapshotTest-268034479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7958206d-b638-4e81-96d1-be3925d218c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:51:51 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-b2950b3b-0cef-4950-82f6-90ea7653e051 tempest-CreateVolumesFromSnapshotTest-268034479 None] Volume f4c459f4-7021-4f41-9556-e556e063d9a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4c459f4-7021-4f41-9556-e556e063d9a6', 'volume_size': 1} Jun 17 05:51:51 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-b2950b3b-0cef-4950-82f6-90ea7653e051 tempest-CreateVolumesFromSnapshotTest-268034479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:51:51 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b5386444-c9a8-495c-a03d-e19aa7b757ed tempest-VolumesNegativeTest-758418413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-294c802b-0e74-43d6-8c92-889fc47b553a 1073741824" returned: 0 in 0.905s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:51 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b5386444-c9a8-495c-a03d-e19aa7b757ed tempest-VolumesNegativeTest-758418413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-294c802b-0e74-43d6-8c92-889fc47b553a {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:51 devstack sudo[105191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-294c802b-0e74-43d6-8c92-889fc47b553a Jun 17 05:51:51 devstack sudo[105191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:52 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-42d37e1a-15d9-4485-886d-dcd87a287928 tempest-VolumesServicesTestJSON-931481982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:51:52 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-42d37e1a-15d9-4485-886d-dcd87a287928 tempest-VolumesServicesTestJSON-931481982 None] Flow 'volume_create_manager' (1b000069-1234-4662-a548-c1b76d7cff13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:51:52 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-42d37e1a-15d9-4485-886d-dcd87a287928 tempest-VolumesServicesTestJSON-931481982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45eeef85-7e3c-4883-a02c-9569f0f38f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:51:52 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-42d37e1a-15d9-4485-886d-dcd87a287928 tempest-VolumesServicesTestJSON-931481982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45eeef85-7e3c-4883-a02c-9569f0f38f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:51:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-204680754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e53e1380-82ea-4bab-97e9-e9e5fd4d70a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d6a33ad8f714ef7b44f2e716a16dbec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:51:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:51:52Z,use_quota=True,user_id='5b2ccd58f1fe43d0887015727a75ded0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:51:52 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-42d37e1a-15d9-4485-886d-dcd87a287928 tempest-VolumesServicesTestJSON-931481982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fae209c-a159-432c-b4e8-56cb91833fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:51:52 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-42d37e1a-15d9-4485-886d-dcd87a287928 tempest-VolumesServicesTestJSON-931481982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fae209c-a159-432c-b4e8-56cb91833fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:51:52 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-42d37e1a-15d9-4485-886d-dcd87a287928 tempest-VolumesServicesTestJSON-931481982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (503ed54d-ecc2-4cf2-983f-84f49bc2ffa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:51:52 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-42d37e1a-15d9-4485-886d-dcd87a287928 tempest-VolumesServicesTestJSON-931481982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (503ed54d-ecc2-4cf2-983f-84f49bc2ffa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e53e1380-82ea-4bab-97e9-e9e5fd4d70a5', 'volume_name': 'volume-e53e1380-82ea-4bab-97e9-e9e5fd4d70a5', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:51:52 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-42d37e1a-15d9-4485-886d-dcd87a287928 tempest-VolumesServicesTestJSON-931481982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0890ee39-f485-47b4-a5f1-3d84cb07289f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:51:52 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-42d37e1a-15d9-4485-886d-dcd87a287928 tempest-VolumesServicesTestJSON-931481982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0890ee39-f485-47b4-a5f1-3d84cb07289f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:51:52 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-42d37e1a-15d9-4485-886d-dcd87a287928 tempest-VolumesServicesTestJSON-931481982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc3c2aa9-7a5a-4b2c-b7f4-d977ff65b277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:51:52 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-42d37e1a-15d9-4485-886d-dcd87a287928 tempest-VolumesServicesTestJSON-931481982 None] Volume e53e1380-82ea-4bab-97e9-e9e5fd4d70a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e53e1380-82ea-4bab-97e9-e9e5fd4d70a5', 'volume_size': 1} Jun 17 05:51:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-42d37e1a-15d9-4485-886d-dcd87a287928 tempest-VolumesServicesTestJSON-931481982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:51:52 devstack sudo[105191]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b5386444-c9a8-495c-a03d-e19aa7b757ed tempest-VolumesNegativeTest-758418413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-294c802b-0e74-43d6-8c92-889fc47b553a" returned: 0 in 0.602s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:52 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-b5386444-c9a8-495c-a03d-e19aa7b757ed tempest-VolumesNegativeTest-758418413 None] <== create_volume: return (1544ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:51:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-b5386444-c9a8-495c-a03d-e19aa7b757ed tempest-VolumesNegativeTest-758418413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.547s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:51:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-b2950b3b-0cef-4950-82f6-90ea7653e051 tempest-CreateVolumesFromSnapshotTest-268034479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.642s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:51:52 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-b2950b3b-0cef-4950-82f6-90ea7653e051 tempest-CreateVolumesFromSnapshotTest-268034479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:51:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-807209496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4c459f4-7021-4f41-9556-e556e063d9a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8716964877da422595daa29dd3cae9f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:51:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:51:52Z,use_quota=True,user_id='374fe51754214ee58f422397d5891eaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:51:52 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-b2950b3b-0cef-4950-82f6-90ea7653e051 tempest-CreateVolumesFromSnapshotTest-268034479 None] Creating volume f4c459f4-7021-4f41-9556-e556e063d9a6 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:51:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-b2950b3b-0cef-4950-82f6-90ea7653e051 tempest-CreateVolumesFromSnapshotTest-268034479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:51:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-b2950b3b-0cef-4950-82f6-90ea7653e051 tempest-CreateVolumesFromSnapshotTest-268034479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:51:52 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-b2950b3b-0cef-4950-82f6-90ea7653e051 tempest-CreateVolumesFromSnapshotTest-268034479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:51:52 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-b2950b3b-0cef-4950-82f6-90ea7653e051 tempest-CreateVolumesFromSnapshotTest-268034479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:51:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-b2950b3b-0cef-4950-82f6-90ea7653e051 tempest-CreateVolumesFromSnapshotTest-268034479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:51:52 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-b2950b3b-0cef-4950-82f6-90ea7653e051 tempest-CreateVolumesFromSnapshotTest-268034479 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:51:52 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-b2950b3b-0cef-4950-82f6-90ea7653e051 tempest-CreateVolumesFromSnapshotTest-268034479 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:51:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b2950b3b-0cef-4950-82f6-90ea7653e051 tempest-CreateVolumesFromSnapshotTest-268034479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f4c459f4-7021-4f41-9556-e556e063d9a6 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:52 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b5386444-c9a8-495c-a03d-e19aa7b757ed tempest-VolumesNegativeTest-758418413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f78864e7-9dad-4ae7-a0fc-b82eb795497c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-294c802b-0e74-43d6-8c92-889fc47b553a', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:51:52 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b5386444-c9a8-495c-a03d-e19aa7b757ed tempest-VolumesNegativeTest-758418413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (981671e1-8dcc-42fd-8b93-7ed05d8916b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:51:52 devstack sudo[105194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f4c459f4-7021-4f41-9556-e556e063d9a6 1073741824 Jun 17 05:51:52 devstack sudo[105194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:52 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-b5386444-c9a8-495c-a03d-e19aa7b757ed tempest-VolumesNegativeTest-758418413 None] Volume volume-294c802b-0e74-43d6-8c92-889fc47b553a (294c802b-0e74-43d6-8c92-889fc47b553a): created successfully Jun 17 05:51:52 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b5386444-c9a8-495c-a03d-e19aa7b757ed tempest-VolumesNegativeTest-758418413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (981671e1-8dcc-42fd-8b93-7ed05d8916b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:51:52 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b5386444-c9a8-495c-a03d-e19aa7b757ed tempest-VolumesNegativeTest-758418413 None] Flow 'volume_create_manager' (3f993f92-6cdf-4132-9de3-47bdb1299100) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:51:52 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-b5386444-c9a8-495c-a03d-e19aa7b757ed tempest-VolumesNegativeTest-758418413 None] Created volume successfully. Jun 17 05:51:53 devstack sudo[105194]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:53 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b2950b3b-0cef-4950-82f6-90ea7653e051 tempest-CreateVolumesFromSnapshotTest-268034479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f4c459f4-7021-4f41-9556-e556e063d9a6 1073741824" returned: 0 in 0.840s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:53 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b2950b3b-0cef-4950-82f6-90ea7653e051 tempest-CreateVolumesFromSnapshotTest-268034479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f4c459f4-7021-4f41-9556-e556e063d9a6 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:53 devstack sudo[105201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f4c459f4-7021-4f41-9556-e556e063d9a6 Jun 17 05:51:53 devstack sudo[105201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:54 devstack sudo[105201]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b2950b3b-0cef-4950-82f6-90ea7653e051 tempest-CreateVolumesFromSnapshotTest-268034479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f4c459f4-7021-4f41-9556-e556e063d9a6" returned: 0 in 0.613s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:54 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-b2950b3b-0cef-4950-82f6-90ea7653e051 tempest-CreateVolumesFromSnapshotTest-268034479 None] <== create_volume: return (1495ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:51:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-b2950b3b-0cef-4950-82f6-90ea7653e051 tempest-CreateVolumesFromSnapshotTest-268034479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.498s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:51:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-42d37e1a-15d9-4485-886d-dcd87a287928 tempest-VolumesServicesTestJSON-931481982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.880s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:51:54 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-42d37e1a-15d9-4485-886d-dcd87a287928 tempest-VolumesServicesTestJSON-931481982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:51:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-204680754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e53e1380-82ea-4bab-97e9-e9e5fd4d70a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d6a33ad8f714ef7b44f2e716a16dbec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:51:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:51:52Z,use_quota=True,user_id='5b2ccd58f1fe43d0887015727a75ded0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:51:54 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-42d37e1a-15d9-4485-886d-dcd87a287928 tempest-VolumesServicesTestJSON-931481982 None] Creating volume e53e1380-82ea-4bab-97e9-e9e5fd4d70a5 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:51:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-42d37e1a-15d9-4485-886d-dcd87a287928 tempest-VolumesServicesTestJSON-931481982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:51:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-42d37e1a-15d9-4485-886d-dcd87a287928 tempest-VolumesServicesTestJSON-931481982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:51:54 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-42d37e1a-15d9-4485-886d-dcd87a287928 tempest-VolumesServicesTestJSON-931481982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:51:54 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-42d37e1a-15d9-4485-886d-dcd87a287928 tempest-VolumesServicesTestJSON-931481982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:51:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-42d37e1a-15d9-4485-886d-dcd87a287928 tempest-VolumesServicesTestJSON-931481982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:51:54 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-42d37e1a-15d9-4485-886d-dcd87a287928 tempest-VolumesServicesTestJSON-931481982 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:51:54 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-42d37e1a-15d9-4485-886d-dcd87a287928 tempest-VolumesServicesTestJSON-931481982 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:51:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-42d37e1a-15d9-4485-886d-dcd87a287928 tempest-VolumesServicesTestJSON-931481982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-e53e1380-82ea-4bab-97e9-e9e5fd4d70a5 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:54 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b2950b3b-0cef-4950-82f6-90ea7653e051 tempest-CreateVolumesFromSnapshotTest-268034479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7958206d-b638-4e81-96d1-be3925d218c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4c459f4-7021-4f41-9556-e556e063d9a6', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:51:54 devstack sudo[105207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-e53e1380-82ea-4bab-97e9-e9e5fd4d70a5 1073741824 Jun 17 05:51:54 devstack sudo[105207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:54 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b2950b3b-0cef-4950-82f6-90ea7653e051 tempest-CreateVolumesFromSnapshotTest-268034479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13f0bfb9-4c38-4b91-8635-fe61611177b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:51:54 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-b2950b3b-0cef-4950-82f6-90ea7653e051 tempest-CreateVolumesFromSnapshotTest-268034479 None] Volume volume-f4c459f4-7021-4f41-9556-e556e063d9a6 (f4c459f4-7021-4f41-9556-e556e063d9a6): created successfully Jun 17 05:51:54 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b2950b3b-0cef-4950-82f6-90ea7653e051 tempest-CreateVolumesFromSnapshotTest-268034479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13f0bfb9-4c38-4b91-8635-fe61611177b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:51:54 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b2950b3b-0cef-4950-82f6-90ea7653e051 tempest-CreateVolumesFromSnapshotTest-268034479 None] Flow 'volume_create_manager' (92e1324d-b84c-4394-9aee-7ac256c97ff9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:51:54 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-b2950b3b-0cef-4950-82f6-90ea7653e051 tempest-CreateVolumesFromSnapshotTest-268034479 None] Created volume successfully. Jun 17 05:51:54 devstack sudo[105207]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-42d37e1a-15d9-4485-886d-dcd87a287928 tempest-VolumesServicesTestJSON-931481982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-e53e1380-82ea-4bab-97e9-e9e5fd4d70a5 1073741824" returned: 0 in 0.808s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-42d37e1a-15d9-4485-886d-dcd87a287928 tempest-VolumesServicesTestJSON-931481982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-e53e1380-82ea-4bab-97e9-e9e5fd4d70a5 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:54 devstack sudo[105212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-e53e1380-82ea-4bab-97e9-e9e5fd4d70a5 Jun 17 05:51:54 devstack sudo[105212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-a56e7f05-8042-46b1-9a4a-ac2fb42df9d2 tempest-CreateVolumesFromSnapshotTest-268034479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:51:55 devstack sudo[105212]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-42d37e1a-15d9-4485-886d-dcd87a287928 tempest-VolumesServicesTestJSON-931481982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-e53e1380-82ea-4bab-97e9-e9e5fd4d70a5" returned: 0 in 0.619s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:55 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-42d37e1a-15d9-4485-886d-dcd87a287928 tempest-VolumesServicesTestJSON-931481982 None] <== create_volume: return (1473ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:51:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-42d37e1a-15d9-4485-886d-dcd87a287928 tempest-VolumesServicesTestJSON-931481982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.475s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:51:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-a56e7f05-8042-46b1-9a4a-ac2fb42df9d2 tempest-CreateVolumesFromSnapshotTest-268034479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.308s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:51:55 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-42d37e1a-15d9-4485-886d-dcd87a287928 tempest-VolumesServicesTestJSON-931481982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc3c2aa9-7a5a-4b2c-b7f4-d977ff65b277) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e53e1380-82ea-4bab-97e9-e9e5fd4d70a5', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:51:55 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-42d37e1a-15d9-4485-886d-dcd87a287928 tempest-VolumesServicesTestJSON-931481982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6b2083a-54ad-4669-ad9d-3abf3487191b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:51:55 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-a56e7f05-8042-46b1-9a4a-ac2fb42df9d2 tempest-CreateVolumesFromSnapshotTest-268034479 None] Creating offline snapshot d47b17c7-d523-444f-a6fc-8ac239cdc5ac of volume f4c459f4-7021-4f41-9556-e556e063d9a6 {{(pid=92083) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 17 05:51:55 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-42d37e1a-15d9-4485-886d-dcd87a287928 tempest-VolumesServicesTestJSON-931481982 None] Volume volume-e53e1380-82ea-4bab-97e9-e9e5fd4d70a5 (e53e1380-82ea-4bab-97e9-e9e5fd4d70a5): created successfully Jun 17 05:51:55 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-42d37e1a-15d9-4485-886d-dcd87a287928 tempest-VolumesServicesTestJSON-931481982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6b2083a-54ad-4669-ad9d-3abf3487191b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:51:55 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-42d37e1a-15d9-4485-886d-dcd87a287928 tempest-VolumesServicesTestJSON-931481982 None] Flow 'volume_create_manager' (1b000069-1234-4662-a548-c1b76d7cff13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:51:55 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4b2253-dcfd-4b15-a7d1-5903ab648f77]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:51:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a56e7f05-8042-46b1-9a4a-ac2fb42df9d2 tempest-CreateVolumesFromSnapshotTest-268034479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f4c459f4-7021-4f41-9556-e556e063d9a6 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:55 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-42d37e1a-15d9-4485-886d-dcd87a287928 tempest-VolumesServicesTestJSON-931481982 None] Created volume successfully. Jun 17 05:51:55 devstack sudo[105215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f4c459f4-7021-4f41-9556-e556e063d9a6 Jun 17 05:51:55 devstack sudo[105215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:56 devstack sudo[105215]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:56 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a56e7f05-8042-46b1-9a4a-ac2fb42df9d2 tempest-CreateVolumesFromSnapshotTest-268034479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f4c459f4-7021-4f41-9556-e556e063d9a6" returned: 0 in 0.712s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:56 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a56e7f05-8042-46b1-9a4a-ac2fb42df9d2 tempest-CreateVolumesFromSnapshotTest-268034479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f4c459f4-7021-4f41-9556-e556e063d9a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f4c459f4-7021-4f41-9556-e556e063d9a6.d47b17c7-d523-444f-a6fc-8ac239cdc5ac 1G {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:56 devstack sudo[105220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f4c459f4-7021-4f41-9556-e556e063d9a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f4c459f4-7021-4f41-9556-e556e063d9a6.d47b17c7-d523-444f-a6fc-8ac239cdc5ac 1G Jun 17 05:51:56 devstack sudo[105220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:56 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-799359ac-abff-4e0d-ae73-0c3310afad9c tempest-VolumesServicesTestJSON-931481982 None] Acquiring lock "cinder-e53e1380-82ea-4bab-97e9-e9e5fd4d70a5-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:51:56 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-799359ac-abff-4e0d-ae73-0c3310afad9c tempest-VolumesServicesTestJSON-931481982 None] Lock "cinder-e53e1380-82ea-4bab-97e9-e9e5fd4d70a5-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:51:56 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-799359ac-abff-4e0d-ae73-0c3310afad9c tempest-VolumesServicesTestJSON-931481982 None] Acquiring lock "cinder-quobyte-e53e1380-82ea-4bab-97e9-e9e5fd4d70a5" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:51:56 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-799359ac-abff-4e0d-ae73-0c3310afad9c tempest-VolumesServicesTestJSON-931481982 None] Lock "cinder-quobyte-e53e1380-82ea-4bab-97e9-e9e5fd4d70a5" acquired by "delete_volume" :: waited 0.015s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:51:56 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[de89cf04-6fd4-4aef-adc2-ceb67e230860]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:51:56 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-799359ac-abff-4e0d-ae73-0c3310afad9c tempest-VolumesServicesTestJSON-931481982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-e53e1380-82ea-4bab-97e9-e9e5fd4d70a5 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:56 devstack sudo[105222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-e53e1380-82ea-4bab-97e9-e9e5fd4d70a5 Jun 17 05:51:56 devstack sudo[105222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:57 devstack sudo[105220]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a56e7f05-8042-46b1-9a4a-ac2fb42df9d2 tempest-CreateVolumesFromSnapshotTest-268034479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f4c459f4-7021-4f41-9556-e556e063d9a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f4c459f4-7021-4f41-9556-e556e063d9a6.d47b17c7-d523-444f-a6fc-8ac239cdc5ac 1G" returned: 0 in 0.759s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a56e7f05-8042-46b1-9a4a-ac2fb42df9d2 tempest-CreateVolumesFromSnapshotTest-268034479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4c459f4-7021-4f41-9556-e556e063d9a6 -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f4c459f4-7021-4f41-9556-e556e063d9a6.d47b17c7-d523-444f-a6fc-8ac239cdc5ac {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:57 devstack sudo[105227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4c459f4-7021-4f41-9556-e556e063d9a6 -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f4c459f4-7021-4f41-9556-e556e063d9a6.d47b17c7-d523-444f-a6fc-8ac239cdc5ac Jun 17 05:51:57 devstack sudo[105227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:57 devstack sudo[105222]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-799359ac-abff-4e0d-ae73-0c3310afad9c tempest-VolumesServicesTestJSON-931481982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-e53e1380-82ea-4bab-97e9-e9e5fd4d70a5" returned: 0 in 0.769s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-799359ac-abff-4e0d-ae73-0c3310afad9c tempest-VolumesServicesTestJSON-931481982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-e53e1380-82ea-4bab-97e9-e9e5fd4d70a5 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:57 devstack sudo[105232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-e53e1380-82ea-4bab-97e9-e9e5fd4d70a5 Jun 17 05:51:57 devstack sudo[105232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:57 devstack sudo[105227]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a56e7f05-8042-46b1-9a4a-ac2fb42df9d2 tempest-CreateVolumesFromSnapshotTest-268034479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4c459f4-7021-4f41-9556-e556e063d9a6 -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f4c459f4-7021-4f41-9556-e556e063d9a6.d47b17c7-d523-444f-a6fc-8ac239cdc5ac" returned: 0 in 0.684s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:57 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [None req-a56e7f05-8042-46b1-9a4a-ac2fb42df9d2 tempest-CreateVolumesFromSnapshotTest-268034479 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f4c459f4-7021-4f41-9556-e556e063d9a6.d47b17c7-d523-444f-a6fc-8ac239cdc5ac is being set with open permissions: ugo+rw Jun 17 05:51:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a56e7f05-8042-46b1-9a4a-ac2fb42df9d2 tempest-CreateVolumesFromSnapshotTest-268034479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f4c459f4-7021-4f41-9556-e556e063d9a6.d47b17c7-d523-444f-a6fc-8ac239cdc5ac {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:57 devstack sudo[105237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f4c459f4-7021-4f41-9556-e556e063d9a6.d47b17c7-d523-444f-a6fc-8ac239cdc5ac Jun 17 05:51:57 devstack sudo[105237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:57 devstack sudo[105232]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-799359ac-abff-4e0d-ae73-0c3310afad9c tempest-VolumesServicesTestJSON-931481982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-e53e1380-82ea-4bab-97e9-e9e5fd4d70a5" returned: 0 in 0.624s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:57 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-799359ac-abff-4e0d-ae73-0c3310afad9c tempest-VolumesServicesTestJSON-931481982 None] Lock "cinder-quobyte-e53e1380-82ea-4bab-97e9-e9e5fd4d70a5" released by "delete_volume" :: held 1.434s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:51:57 devstack cinder-volume[92083]: DEBUG dbcounter [-] [92083] Writing DB stats cinder:SELECT=104,cinder:INSERT=31,cinder:UPDATE=120,cinder:DELETE=7 {{(pid=92083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:51:57 devstack cinder-volume[92083]: DEBUG dbcounter [-] [92083] Writing DB stats cinder:INSERT=34,cinder:SELECT=98,cinder:UPDATE=115,cinder:DELETE=8 {{(pid=92083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:51:58 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-799359ac-abff-4e0d-ae73-0c3310afad9c tempest-VolumesServicesTestJSON-931481982 None] Created reservations ['8b785889-379f-43c5-a6eb-12f9fdd61572', '83b1363c-a80b-46a9-a866-4adc9c4d3b89', '2d8bd3ba-1c51-4a11-919d-d5944604738d', 'c3166ff4-0a3e-4596-bba5-9ffb1a278bec'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:51:58 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-799359ac-abff-4e0d-ae73-0c3310afad9c tempest-VolumesServicesTestJSON-931481982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:51:58 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-799359ac-abff-4e0d-ae73-0c3310afad9c tempest-VolumesServicesTestJSON-931481982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:51:58 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-799359ac-abff-4e0d-ae73-0c3310afad9c tempest-VolumesServicesTestJSON-931481982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:51:58 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-799359ac-abff-4e0d-ae73-0c3310afad9c tempest-VolumesServicesTestJSON-931481982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:51:58 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-799359ac-abff-4e0d-ae73-0c3310afad9c tempest-VolumesServicesTestJSON-931481982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:51:58 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-799359ac-abff-4e0d-ae73-0c3310afad9c tempest-VolumesServicesTestJSON-931481982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:58 devstack sudo[105240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:51:58 devstack sudo[105240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:58 devstack sudo[105237]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:58 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a56e7f05-8042-46b1-9a4a-ac2fb42df9d2 tempest-CreateVolumesFromSnapshotTest-268034479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f4c459f4-7021-4f41-9556-e556e063d9a6.d47b17c7-d523-444f-a6fc-8ac239cdc5ac" returned: 0 in 0.643s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:58 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a56e7f05-8042-46b1-9a4a-ac2fb42df9d2 tempest-CreateVolumesFromSnapshotTest-268034479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f4c459f4-7021-4f41-9556-e556e063d9a6.info {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:58 devstack sudo[105243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f4c459f4-7021-4f41-9556-e556e063d9a6.info Jun 17 05:51:58 devstack sudo[105243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:58 devstack sudo[105240]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:58 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-799359ac-abff-4e0d-ae73-0c3310afad9c tempest-VolumesServicesTestJSON-931481982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.672s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:58 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-799359ac-abff-4e0d-ae73-0c3310afad9c tempest-VolumesServicesTestJSON-931481982 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:51:58 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-799359ac-abff-4e0d-ae73-0c3310afad9c tempest-VolumesServicesTestJSON-931481982 None] Deleted volume successfully. Jun 17 05:51:58 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-799359ac-abff-4e0d-ae73-0c3310afad9c tempest-VolumesServicesTestJSON-931481982 None] Lock "cinder-e53e1380-82ea-4bab-97e9-e9e5fd4d70a5-delete_volume" released by "delete_volume" :: held 2.319s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:51:59 devstack sudo[105243]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:59 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a56e7f05-8042-46b1-9a4a-ac2fb42df9d2 tempest-CreateVolumesFromSnapshotTest-268034479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f4c459f4-7021-4f41-9556-e556e063d9a6.info" returned: 0 in 0.661s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:59 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [None req-a56e7f05-8042-46b1-9a4a-ac2fb42df9d2 tempest-CreateVolumesFromSnapshotTest-268034479 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f4c459f4-7021-4f41-9556-e556e063d9a6.info is being set with open permissions: ugo+rw Jun 17 05:51:59 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a56e7f05-8042-46b1-9a4a-ac2fb42df9d2 tempest-CreateVolumesFromSnapshotTest-268034479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f4c459f4-7021-4f41-9556-e556e063d9a6.info {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:51:59 devstack sudo[105248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f4c459f4-7021-4f41-9556-e556e063d9a6.info Jun 17 05:51:59 devstack sudo[105248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:51:59 devstack sudo[105248]: pam_unix(sudo:session): session closed for user root Jun 17 05:51:59 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a56e7f05-8042-46b1-9a4a-ac2fb42df9d2 tempest-CreateVolumesFromSnapshotTest-268034479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f4c459f4-7021-4f41-9556-e556e063d9a6.info" returned: 0 in 0.637s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:51:59 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-a56e7f05-8042-46b1-9a4a-ac2fb42df9d2 tempest-CreateVolumesFromSnapshotTest-268034479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.213s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:51:59 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-a56e7f05-8042-46b1-9a4a-ac2fb42df9d2 tempest-CreateVolumesFromSnapshotTest-268034479 None] Create snapshot completed successfully Jun 17 05:52:01 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf151e35-2b71-405b-bc29-94ba82798eae tempest-CreateVolumesFromSnapshotTest-268034479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:52:01 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-bf151e35-2b71-405b-bc29-94ba82798eae tempest-CreateVolumesFromSnapshotTest-268034479 None] Flow 'volume_create_manager' (a5c0e336-a6c5-4c84-b7bc-85056f44f25d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:52:01 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-bf151e35-2b71-405b-bc29-94ba82798eae tempest-CreateVolumesFromSnapshotTest-268034479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13ce3da4-3f6c-4ff4-9636-b9229aaf235f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:01 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-bf151e35-2b71-405b-bc29-94ba82798eae tempest-CreateVolumesFromSnapshotTest-268034479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13ce3da4-3f6c-4ff4-9636-b9229aaf235f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:52:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-922005242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acb2a230-4501-4c20-9213-a854061f4cbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8716964877da422595daa29dd3cae9f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:52:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:52:01Z,use_quota=True,user_id='374fe51754214ee58f422397d5891eaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:01 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-bf151e35-2b71-405b-bc29-94ba82798eae tempest-CreateVolumesFromSnapshotTest-268034479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62d98e1f-d796-4709-8b3e-d91c881f85c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:01 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-bf151e35-2b71-405b-bc29-94ba82798eae tempest-CreateVolumesFromSnapshotTest-268034479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62d98e1f-d796-4709-8b3e-d91c881f85c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:01 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-bf151e35-2b71-405b-bc29-94ba82798eae tempest-CreateVolumesFromSnapshotTest-268034479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1261338c-2f2b-48c2-84c9-a39a0b9f3357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:01 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-bf151e35-2b71-405b-bc29-94ba82798eae tempest-CreateVolumesFromSnapshotTest-268034479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1261338c-2f2b-48c2-84c9-a39a0b9f3357) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acb2a230-4501-4c20-9213-a854061f4cbb', 'volume_name': 'volume-acb2a230-4501-4c20-9213-a854061f4cbb', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:01 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-bf151e35-2b71-405b-bc29-94ba82798eae tempest-CreateVolumesFromSnapshotTest-268034479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d00e59dc-822e-4bff-8965-9a1918ae3371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:01 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-bf151e35-2b71-405b-bc29-94ba82798eae tempest-CreateVolumesFromSnapshotTest-268034479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d00e59dc-822e-4bff-8965-9a1918ae3371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:01 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-bf151e35-2b71-405b-bc29-94ba82798eae tempest-CreateVolumesFromSnapshotTest-268034479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb8a605b-5405-49b2-8b98-98f64f340284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:01 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-bf151e35-2b71-405b-bc29-94ba82798eae tempest-CreateVolumesFromSnapshotTest-268034479 None] Volume acb2a230-4501-4c20-9213-a854061f4cbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acb2a230-4501-4c20-9213-a854061f4cbb', 'volume_size': 1} Jun 17 05:52:01 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-bf151e35-2b71-405b-bc29-94ba82798eae tempest-CreateVolumesFromSnapshotTest-268034479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:52:01 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-bf151e35-2b71-405b-bc29-94ba82798eae tempest-CreateVolumesFromSnapshotTest-268034479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:52:01 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-bf151e35-2b71-405b-bc29-94ba82798eae tempest-CreateVolumesFromSnapshotTest-268034479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:52:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-922005242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acb2a230-4501-4c20-9213-a854061f4cbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8716964877da422595daa29dd3cae9f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:52:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:52:01Z,use_quota=True,user_id='374fe51754214ee58f422397d5891eaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:52:01 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-bf151e35-2b71-405b-bc29-94ba82798eae tempest-CreateVolumesFromSnapshotTest-268034479 None] Creating volume acb2a230-4501-4c20-9213-a854061f4cbb {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:52:01 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-bf151e35-2b71-405b-bc29-94ba82798eae tempest-CreateVolumesFromSnapshotTest-268034479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:52:01 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-bf151e35-2b71-405b-bc29-94ba82798eae tempest-CreateVolumesFromSnapshotTest-268034479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:52:01 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-bf151e35-2b71-405b-bc29-94ba82798eae tempest-CreateVolumesFromSnapshotTest-268034479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:52:01 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-bf151e35-2b71-405b-bc29-94ba82798eae tempest-CreateVolumesFromSnapshotTest-268034479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:52:01 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-bf151e35-2b71-405b-bc29-94ba82798eae tempest-CreateVolumesFromSnapshotTest-268034479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:52:01 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-bf151e35-2b71-405b-bc29-94ba82798eae tempest-CreateVolumesFromSnapshotTest-268034479 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:52:01 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-bf151e35-2b71-405b-bc29-94ba82798eae tempest-CreateVolumesFromSnapshotTest-268034479 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:52:01 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-bf151e35-2b71-405b-bc29-94ba82798eae tempest-CreateVolumesFromSnapshotTest-268034479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-acb2a230-4501-4c20-9213-a854061f4cbb 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:01 devstack sudo[105251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-acb2a230-4501-4c20-9213-a854061f4cbb 1073741824 Jun 17 05:52:01 devstack sudo[105251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:01 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd937829-987b-42ae-9b68-2105b4a41391 tempest-CreateVolumesFromSnapshotTest-268034479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:52:01 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-fd937829-987b-42ae-9b68-2105b4a41391 tempest-CreateVolumesFromSnapshotTest-268034479 None] Flow 'volume_create_manager' (2d256619-d715-4ed1-ae21-a6d8b1c5189b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:52:01 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-fd937829-987b-42ae-9b68-2105b4a41391 tempest-CreateVolumesFromSnapshotTest-268034479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d261440a-456c-4fd3-b234-14ce86865f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:01 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-fd937829-987b-42ae-9b68-2105b4a41391 tempest-CreateVolumesFromSnapshotTest-268034479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d261440a-456c-4fd3-b234-14ce86865f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:52:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1140639339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=774c2145-61a4-4fe1-97cd-ad97466c29c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8716964877da422595daa29dd3cae9f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:52:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:52:02Z,use_quota=True,user_id='374fe51754214ee58f422397d5891eaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:01 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-fd937829-987b-42ae-9b68-2105b4a41391 tempest-CreateVolumesFromSnapshotTest-268034479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d006a8b0-d1e8-4824-ade4-5fbf1792b41d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:01 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-fd937829-987b-42ae-9b68-2105b4a41391 tempest-CreateVolumesFromSnapshotTest-268034479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d006a8b0-d1e8-4824-ade4-5fbf1792b41d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:01 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-fd937829-987b-42ae-9b68-2105b4a41391 tempest-CreateVolumesFromSnapshotTest-268034479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac75640d-7444-4562-b70a-9c9494c44223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:01 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-fd937829-987b-42ae-9b68-2105b4a41391 tempest-CreateVolumesFromSnapshotTest-268034479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac75640d-7444-4562-b70a-9c9494c44223) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '774c2145-61a4-4fe1-97cd-ad97466c29c3', 'volume_name': 'volume-774c2145-61a4-4fe1-97cd-ad97466c29c3', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:01 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-fd937829-987b-42ae-9b68-2105b4a41391 tempest-CreateVolumesFromSnapshotTest-268034479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dc7b0d5-31ee-454a-8320-e9506a8fe9b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:01 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-fd937829-987b-42ae-9b68-2105b4a41391 tempest-CreateVolumesFromSnapshotTest-268034479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dc7b0d5-31ee-454a-8320-e9506a8fe9b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:01 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-fd937829-987b-42ae-9b68-2105b4a41391 tempest-CreateVolumesFromSnapshotTest-268034479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a30c7d35-1044-4089-8e86-37139a6449e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:01 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-fd937829-987b-42ae-9b68-2105b4a41391 tempest-CreateVolumesFromSnapshotTest-268034479 None] Volume 774c2145-61a4-4fe1-97cd-ad97466c29c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-774c2145-61a4-4fe1-97cd-ad97466c29c3', 'volume_size': 1} Jun 17 05:52:01 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-fd937829-987b-42ae-9b68-2105b4a41391 tempest-CreateVolumesFromSnapshotTest-268034479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:52:02 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-67a7494a-55bf-4668-b2c3-a8f1657a18ff tempest-CreateVolumesFromSnapshotTest-268034479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:52:02 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-67a7494a-55bf-4668-b2c3-a8f1657a18ff tempest-CreateVolumesFromSnapshotTest-268034479 None] Flow 'volume_create_manager' (291516cc-7393-4614-8e17-40117ff53d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:52:02 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-67a7494a-55bf-4668-b2c3-a8f1657a18ff tempest-CreateVolumesFromSnapshotTest-268034479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f03e1be-54d7-4973-bced-bcc64ca89c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:02 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-67a7494a-55bf-4668-b2c3-a8f1657a18ff tempest-CreateVolumesFromSnapshotTest-268034479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f03e1be-54d7-4973-bced-bcc64ca89c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:52:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1754015885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eff69357-fbe5-4f30-a5e7-b4980abbb27f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8716964877da422595daa29dd3cae9f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:52:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:52:02Z,use_quota=True,user_id='374fe51754214ee58f422397d5891eaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:02 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-67a7494a-55bf-4668-b2c3-a8f1657a18ff tempest-CreateVolumesFromSnapshotTest-268034479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bba3aea8-969f-4739-9b63-75817e847503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:02 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-67a7494a-55bf-4668-b2c3-a8f1657a18ff tempest-CreateVolumesFromSnapshotTest-268034479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bba3aea8-969f-4739-9b63-75817e847503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:02 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-67a7494a-55bf-4668-b2c3-a8f1657a18ff tempest-CreateVolumesFromSnapshotTest-268034479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76f6472f-723c-4172-91d6-0bf2ffcb2ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:02 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-67a7494a-55bf-4668-b2c3-a8f1657a18ff tempest-CreateVolumesFromSnapshotTest-268034479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76f6472f-723c-4172-91d6-0bf2ffcb2ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eff69357-fbe5-4f30-a5e7-b4980abbb27f', 'volume_name': 'volume-eff69357-fbe5-4f30-a5e7-b4980abbb27f', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:02 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-67a7494a-55bf-4668-b2c3-a8f1657a18ff tempest-CreateVolumesFromSnapshotTest-268034479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74c87d50-6c85-41b8-ba17-fc7c3eaf14ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:02 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-67a7494a-55bf-4668-b2c3-a8f1657a18ff tempest-CreateVolumesFromSnapshotTest-268034479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74c87d50-6c85-41b8-ba17-fc7c3eaf14ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:02 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-67a7494a-55bf-4668-b2c3-a8f1657a18ff tempest-CreateVolumesFromSnapshotTest-268034479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cde61ba-f170-47c0-8519-4e70bdf72a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:02 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-67a7494a-55bf-4668-b2c3-a8f1657a18ff tempest-CreateVolumesFromSnapshotTest-268034479 None] Volume eff69357-fbe5-4f30-a5e7-b4980abbb27f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eff69357-fbe5-4f30-a5e7-b4980abbb27f', 'volume_size': 1} Jun 17 05:52:02 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-67a7494a-55bf-4668-b2c3-a8f1657a18ff tempest-CreateVolumesFromSnapshotTest-268034479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:52:02 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0422f23-9f74-4031-83ec-3af3a3a3837b tempest-CreateVolumesFromSnapshotTest-268034479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:52:02 devstack sudo[105251]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:02 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b0422f23-9f74-4031-83ec-3af3a3a3837b tempest-CreateVolumesFromSnapshotTest-268034479 None] Flow 'volume_create_manager' (f4c7757b-d1fa-4fde-baaf-cfe75a6f5b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:52:02 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b0422f23-9f74-4031-83ec-3af3a3a3837b tempest-CreateVolumesFromSnapshotTest-268034479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (053d026e-9caa-4a99-b66e-8dd45a5e02d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:02 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-bf151e35-2b71-405b-bc29-94ba82798eae tempest-CreateVolumesFromSnapshotTest-268034479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-acb2a230-4501-4c20-9213-a854061f4cbb 1073741824" returned: 0 in 1.492s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:02 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b0422f23-9f74-4031-83ec-3af3a3a3837b tempest-CreateVolumesFromSnapshotTest-268034479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (053d026e-9caa-4a99-b66e-8dd45a5e02d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:52:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-140553048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=151db657-9708-4e19-86c8-27b884cfcdeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8716964877da422595daa29dd3cae9f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:52:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:52:03Z,use_quota=True,user_id='374fe51754214ee58f422397d5891eaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:02 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b0422f23-9f74-4031-83ec-3af3a3a3837b tempest-CreateVolumesFromSnapshotTest-268034479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fdfe082-235a-470a-af61-6a1e6e4978de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:02 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b0422f23-9f74-4031-83ec-3af3a3a3837b tempest-CreateVolumesFromSnapshotTest-268034479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fdfe082-235a-470a-af61-6a1e6e4978de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:02 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b0422f23-9f74-4031-83ec-3af3a3a3837b tempest-CreateVolumesFromSnapshotTest-268034479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f04151ec-bb6c-463f-b60c-8e2b37cf001e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:02 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b0422f23-9f74-4031-83ec-3af3a3a3837b tempest-CreateVolumesFromSnapshotTest-268034479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f04151ec-bb6c-463f-b60c-8e2b37cf001e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '151db657-9708-4e19-86c8-27b884cfcdeb', 'volume_name': 'volume-151db657-9708-4e19-86c8-27b884cfcdeb', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:02 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b0422f23-9f74-4031-83ec-3af3a3a3837b tempest-CreateVolumesFromSnapshotTest-268034479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a95d248-c436-47e7-acb2-8a5f854e44bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:02 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b0422f23-9f74-4031-83ec-3af3a3a3837b tempest-CreateVolumesFromSnapshotTest-268034479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a95d248-c436-47e7-acb2-8a5f854e44bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:02 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b0422f23-9f74-4031-83ec-3af3a3a3837b tempest-CreateVolumesFromSnapshotTest-268034479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af355a2d-5ba1-4cfc-8b95-1922b10b81e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:02 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-b0422f23-9f74-4031-83ec-3af3a3a3837b tempest-CreateVolumesFromSnapshotTest-268034479 None] Volume 151db657-9708-4e19-86c8-27b884cfcdeb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-151db657-9708-4e19-86c8-27b884cfcdeb', 'volume_size': 1} Jun 17 05:52:02 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-b0422f23-9f74-4031-83ec-3af3a3a3837b tempest-CreateVolumesFromSnapshotTest-268034479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:52:02 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-bf151e35-2b71-405b-bc29-94ba82798eae tempest-CreateVolumesFromSnapshotTest-268034479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-acb2a230-4501-4c20-9213-a854061f4cbb {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:02 devstack sudo[105273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-acb2a230-4501-4c20-9213-a854061f4cbb Jun 17 05:52:02 devstack sudo[105273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:03 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-39c59aa8-5c59-4868-9a93-32f0f753f37e tempest-CreateVolumesFromSnapshotTest-268034479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:52:03 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-39c59aa8-5c59-4868-9a93-32f0f753f37e tempest-CreateVolumesFromSnapshotTest-268034479 None] Flow 'volume_create_manager' (3c5b2ada-3e8a-48be-8c8b-9f0a9ada5e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:52:03 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-39c59aa8-5c59-4868-9a93-32f0f753f37e tempest-CreateVolumesFromSnapshotTest-268034479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ba0cac0-540a-43fe-aaf0-fdb2b39b9290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:03 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-39c59aa8-5c59-4868-9a93-32f0f753f37e tempest-CreateVolumesFromSnapshotTest-268034479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ba0cac0-540a-43fe-aaf0-fdb2b39b9290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:52:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1230060885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=095460b4-b525-437a-b8f3-b5f72a2713b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8716964877da422595daa29dd3cae9f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:52:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:52:03Z,use_quota=True,user_id='374fe51754214ee58f422397d5891eaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:03 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-39c59aa8-5c59-4868-9a93-32f0f753f37e tempest-CreateVolumesFromSnapshotTest-268034479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bc9fcaf-698e-40c0-a155-b4ee78d08a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:03 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-39c59aa8-5c59-4868-9a93-32f0f753f37e tempest-CreateVolumesFromSnapshotTest-268034479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bc9fcaf-698e-40c0-a155-b4ee78d08a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:03 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-39c59aa8-5c59-4868-9a93-32f0f753f37e tempest-CreateVolumesFromSnapshotTest-268034479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f785a2fb-72c5-42fe-8063-ab90de7397fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:03 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-39c59aa8-5c59-4868-9a93-32f0f753f37e tempest-CreateVolumesFromSnapshotTest-268034479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f785a2fb-72c5-42fe-8063-ab90de7397fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '095460b4-b525-437a-b8f3-b5f72a2713b3', 'volume_name': 'volume-095460b4-b525-437a-b8f3-b5f72a2713b3', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:03 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-39c59aa8-5c59-4868-9a93-32f0f753f37e tempest-CreateVolumesFromSnapshotTest-268034479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b46fa178-3912-437b-9fcf-fb2aaf303a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:03 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-39c59aa8-5c59-4868-9a93-32f0f753f37e tempest-CreateVolumesFromSnapshotTest-268034479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b46fa178-3912-437b-9fcf-fb2aaf303a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:03 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-39c59aa8-5c59-4868-9a93-32f0f753f37e tempest-CreateVolumesFromSnapshotTest-268034479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84cd3627-4e2c-4a88-af51-8ee1ac839ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:03 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-39c59aa8-5c59-4868-9a93-32f0f753f37e tempest-CreateVolumesFromSnapshotTest-268034479 None] Volume 095460b4-b525-437a-b8f3-b5f72a2713b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-095460b4-b525-437a-b8f3-b5f72a2713b3', 'volume_size': 1} Jun 17 05:52:03 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-39c59aa8-5c59-4868-9a93-32f0f753f37e tempest-CreateVolumesFromSnapshotTest-268034479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:52:03 devstack sudo[105273]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:03 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-bf151e35-2b71-405b-bc29-94ba82798eae tempest-CreateVolumesFromSnapshotTest-268034479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-acb2a230-4501-4c20-9213-a854061f4cbb" returned: 0 in 0.703s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:03 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-bf151e35-2b71-405b-bc29-94ba82798eae tempest-CreateVolumesFromSnapshotTest-268034479 None] <== create_volume: return (2300ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:52:03 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-bf151e35-2b71-405b-bc29-94ba82798eae tempest-CreateVolumesFromSnapshotTest-268034479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.303s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:52:03 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-fd937829-987b-42ae-9b68-2105b4a41391 tempest-CreateVolumesFromSnapshotTest-268034479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.687s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:52:03 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-fd937829-987b-42ae-9b68-2105b4a41391 tempest-CreateVolumesFromSnapshotTest-268034479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:52:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1140639339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=774c2145-61a4-4fe1-97cd-ad97466c29c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8716964877da422595daa29dd3cae9f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:52:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:52:02Z,use_quota=True,user_id='374fe51754214ee58f422397d5891eaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:52:03 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-fd937829-987b-42ae-9b68-2105b4a41391 tempest-CreateVolumesFromSnapshotTest-268034479 None] Creating volume 774c2145-61a4-4fe1-97cd-ad97466c29c3 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:52:03 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-fd937829-987b-42ae-9b68-2105b4a41391 tempest-CreateVolumesFromSnapshotTest-268034479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:52:03 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-fd937829-987b-42ae-9b68-2105b4a41391 tempest-CreateVolumesFromSnapshotTest-268034479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:52:03 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-fd937829-987b-42ae-9b68-2105b4a41391 tempest-CreateVolumesFromSnapshotTest-268034479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:52:03 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-fd937829-987b-42ae-9b68-2105b4a41391 tempest-CreateVolumesFromSnapshotTest-268034479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:52:03 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-fd937829-987b-42ae-9b68-2105b4a41391 tempest-CreateVolumesFromSnapshotTest-268034479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:52:03 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-fd937829-987b-42ae-9b68-2105b4a41391 tempest-CreateVolumesFromSnapshotTest-268034479 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:52:03 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-fd937829-987b-42ae-9b68-2105b4a41391 tempest-CreateVolumesFromSnapshotTest-268034479 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:52:03 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-fd937829-987b-42ae-9b68-2105b4a41391 tempest-CreateVolumesFromSnapshotTest-268034479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-774c2145-61a4-4fe1-97cd-ad97466c29c3 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:03 devstack sudo[105277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-774c2145-61a4-4fe1-97cd-ad97466c29c3 1073741824 Jun 17 05:52:03 devstack sudo[105277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:03 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-bf151e35-2b71-405b-bc29-94ba82798eae tempest-CreateVolumesFromSnapshotTest-268034479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb8a605b-5405-49b2-8b98-98f64f340284) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acb2a230-4501-4c20-9213-a854061f4cbb', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:03 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-bf151e35-2b71-405b-bc29-94ba82798eae tempest-CreateVolumesFromSnapshotTest-268034479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5768fe2-453b-4281-8abf-d173ae840967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:03 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-bf151e35-2b71-405b-bc29-94ba82798eae tempest-CreateVolumesFromSnapshotTest-268034479 None] Volume volume-acb2a230-4501-4c20-9213-a854061f4cbb (acb2a230-4501-4c20-9213-a854061f4cbb): created successfully Jun 17 05:52:03 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-bf151e35-2b71-405b-bc29-94ba82798eae tempest-CreateVolumesFromSnapshotTest-268034479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5768fe2-453b-4281-8abf-d173ae840967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:03 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-bf151e35-2b71-405b-bc29-94ba82798eae tempest-CreateVolumesFromSnapshotTest-268034479 None] Flow 'volume_create_manager' (a5c0e336-a6c5-4c84-b7bc-85056f44f25d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:52:03 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-bf151e35-2b71-405b-bc29-94ba82798eae tempest-CreateVolumesFromSnapshotTest-268034479 None] Created volume successfully. Jun 17 05:52:04 devstack sudo[105277]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:04 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-fd937829-987b-42ae-9b68-2105b4a41391 tempest-CreateVolumesFromSnapshotTest-268034479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-774c2145-61a4-4fe1-97cd-ad97466c29c3 1073741824" returned: 0 in 0.887s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:04 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-fd937829-987b-42ae-9b68-2105b4a41391 tempest-CreateVolumesFromSnapshotTest-268034479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-774c2145-61a4-4fe1-97cd-ad97466c29c3 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:04 devstack sudo[105282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-774c2145-61a4-4fe1-97cd-ad97466c29c3 Jun 17 05:52:04 devstack sudo[105282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:05 devstack sudo[105282]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-fd937829-987b-42ae-9b68-2105b4a41391 tempest-CreateVolumesFromSnapshotTest-268034479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-774c2145-61a4-4fe1-97cd-ad97466c29c3" returned: 0 in 0.673s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:05 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-fd937829-987b-42ae-9b68-2105b4a41391 tempest-CreateVolumesFromSnapshotTest-268034479 None] <== create_volume: return (1611ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:52:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-fd937829-987b-42ae-9b68-2105b4a41391 tempest-CreateVolumesFromSnapshotTest-268034479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.616s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:52:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-67a7494a-55bf-4668-b2c3-a8f1657a18ff tempest-CreateVolumesFromSnapshotTest-268034479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.963s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:52:05 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-67a7494a-55bf-4668-b2c3-a8f1657a18ff tempest-CreateVolumesFromSnapshotTest-268034479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:52:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1754015885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eff69357-fbe5-4f30-a5e7-b4980abbb27f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8716964877da422595daa29dd3cae9f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:52:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:52:02Z,use_quota=True,user_id='374fe51754214ee58f422397d5891eaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:52:05 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-67a7494a-55bf-4668-b2c3-a8f1657a18ff tempest-CreateVolumesFromSnapshotTest-268034479 None] Creating volume eff69357-fbe5-4f30-a5e7-b4980abbb27f {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:52:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-67a7494a-55bf-4668-b2c3-a8f1657a18ff tempest-CreateVolumesFromSnapshotTest-268034479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:52:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-67a7494a-55bf-4668-b2c3-a8f1657a18ff tempest-CreateVolumesFromSnapshotTest-268034479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:52:05 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-67a7494a-55bf-4668-b2c3-a8f1657a18ff tempest-CreateVolumesFromSnapshotTest-268034479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:52:05 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-67a7494a-55bf-4668-b2c3-a8f1657a18ff tempest-CreateVolumesFromSnapshotTest-268034479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:52:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-67a7494a-55bf-4668-b2c3-a8f1657a18ff tempest-CreateVolumesFromSnapshotTest-268034479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:52:05 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-67a7494a-55bf-4668-b2c3-a8f1657a18ff tempest-CreateVolumesFromSnapshotTest-268034479 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:52:05 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-67a7494a-55bf-4668-b2c3-a8f1657a18ff tempest-CreateVolumesFromSnapshotTest-268034479 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:52:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-67a7494a-55bf-4668-b2c3-a8f1657a18ff tempest-CreateVolumesFromSnapshotTest-268034479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-eff69357-fbe5-4f30-a5e7-b4980abbb27f 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:05 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-fd937829-987b-42ae-9b68-2105b4a41391 tempest-CreateVolumesFromSnapshotTest-268034479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a30c7d35-1044-4089-8e86-37139a6449e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-774c2145-61a4-4fe1-97cd-ad97466c29c3', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:05 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-fd937829-987b-42ae-9b68-2105b4a41391 tempest-CreateVolumesFromSnapshotTest-268034479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ff9d9c1-94e3-47e0-a6de-aad4973ca9f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:05 devstack sudo[105285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-eff69357-fbe5-4f30-a5e7-b4980abbb27f 1073741824 Jun 17 05:52:05 devstack sudo[105285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:05 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-fd937829-987b-42ae-9b68-2105b4a41391 tempest-CreateVolumesFromSnapshotTest-268034479 None] Volume volume-774c2145-61a4-4fe1-97cd-ad97466c29c3 (774c2145-61a4-4fe1-97cd-ad97466c29c3): created successfully Jun 17 05:52:05 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-fd937829-987b-42ae-9b68-2105b4a41391 tempest-CreateVolumesFromSnapshotTest-268034479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ff9d9c1-94e3-47e0-a6de-aad4973ca9f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:05 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-fd937829-987b-42ae-9b68-2105b4a41391 tempest-CreateVolumesFromSnapshotTest-268034479 None] Flow 'volume_create_manager' (2d256619-d715-4ed1-ae21-a6d8b1c5189b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:52:05 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-fd937829-987b-42ae-9b68-2105b4a41391 tempest-CreateVolumesFromSnapshotTest-268034479 None] Created volume successfully. Jun 17 05:52:05 devstack sudo[105285]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-67a7494a-55bf-4668-b2c3-a8f1657a18ff tempest-CreateVolumesFromSnapshotTest-268034479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-eff69357-fbe5-4f30-a5e7-b4980abbb27f 1073741824" returned: 0 in 0.850s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-67a7494a-55bf-4668-b2c3-a8f1657a18ff tempest-CreateVolumesFromSnapshotTest-268034479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-eff69357-fbe5-4f30-a5e7-b4980abbb27f {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:06 devstack sudo[105291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-eff69357-fbe5-4f30-a5e7-b4980abbb27f Jun 17 05:52:06 devstack sudo[105291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:06 devstack sudo[105291]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-67a7494a-55bf-4668-b2c3-a8f1657a18ff tempest-CreateVolumesFromSnapshotTest-268034479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-eff69357-fbe5-4f30-a5e7-b4980abbb27f" returned: 0 in 0.691s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:06 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-67a7494a-55bf-4668-b2c3-a8f1657a18ff tempest-CreateVolumesFromSnapshotTest-268034479 None] <== create_volume: return (1603ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:52:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-67a7494a-55bf-4668-b2c3-a8f1657a18ff tempest-CreateVolumesFromSnapshotTest-268034479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.606s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:52:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-b0422f23-9f74-4031-83ec-3af3a3a3837b tempest-CreateVolumesFromSnapshotTest-268034479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.980s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:52:06 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-b0422f23-9f74-4031-83ec-3af3a3a3837b tempest-CreateVolumesFromSnapshotTest-268034479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:52:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-140553048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=151db657-9708-4e19-86c8-27b884cfcdeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8716964877da422595daa29dd3cae9f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:52:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:52:03Z,use_quota=True,user_id='374fe51754214ee58f422397d5891eaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:52:06 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-b0422f23-9f74-4031-83ec-3af3a3a3837b tempest-CreateVolumesFromSnapshotTest-268034479 None] Creating volume 151db657-9708-4e19-86c8-27b884cfcdeb {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:52:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-b0422f23-9f74-4031-83ec-3af3a3a3837b tempest-CreateVolumesFromSnapshotTest-268034479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:52:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-b0422f23-9f74-4031-83ec-3af3a3a3837b tempest-CreateVolumesFromSnapshotTest-268034479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:52:06 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-b0422f23-9f74-4031-83ec-3af3a3a3837b tempest-CreateVolumesFromSnapshotTest-268034479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:52:06 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-b0422f23-9f74-4031-83ec-3af3a3a3837b tempest-CreateVolumesFromSnapshotTest-268034479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:52:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-b0422f23-9f74-4031-83ec-3af3a3a3837b tempest-CreateVolumesFromSnapshotTest-268034479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:52:06 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-b0422f23-9f74-4031-83ec-3af3a3a3837b tempest-CreateVolumesFromSnapshotTest-268034479 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:52:06 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-b0422f23-9f74-4031-83ec-3af3a3a3837b tempest-CreateVolumesFromSnapshotTest-268034479 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:52:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b0422f23-9f74-4031-83ec-3af3a3a3837b tempest-CreateVolumesFromSnapshotTest-268034479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-151db657-9708-4e19-86c8-27b884cfcdeb 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:06 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-67a7494a-55bf-4668-b2c3-a8f1657a18ff tempest-CreateVolumesFromSnapshotTest-268034479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cde61ba-f170-47c0-8519-4e70bdf72a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eff69357-fbe5-4f30-a5e7-b4980abbb27f', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:06 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-67a7494a-55bf-4668-b2c3-a8f1657a18ff tempest-CreateVolumesFromSnapshotTest-268034479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6869e117-790b-4fb0-b0a0-6c3d189b81e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:06 devstack sudo[105297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-151db657-9708-4e19-86c8-27b884cfcdeb 1073741824 Jun 17 05:52:06 devstack sudo[105297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:06 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-67a7494a-55bf-4668-b2c3-a8f1657a18ff tempest-CreateVolumesFromSnapshotTest-268034479 None] Volume volume-eff69357-fbe5-4f30-a5e7-b4980abbb27f (eff69357-fbe5-4f30-a5e7-b4980abbb27f): created successfully Jun 17 05:52:06 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-67a7494a-55bf-4668-b2c3-a8f1657a18ff tempest-CreateVolumesFromSnapshotTest-268034479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6869e117-790b-4fb0-b0a0-6c3d189b81e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:06 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-67a7494a-55bf-4668-b2c3-a8f1657a18ff tempest-CreateVolumesFromSnapshotTest-268034479 None] Flow 'volume_create_manager' (291516cc-7393-4614-8e17-40117ff53d83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:52:06 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-67a7494a-55bf-4668-b2c3-a8f1657a18ff tempest-CreateVolumesFromSnapshotTest-268034479 None] Created volume successfully. Jun 17 05:52:07 devstack sudo[105297]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b0422f23-9f74-4031-83ec-3af3a3a3837b tempest-CreateVolumesFromSnapshotTest-268034479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-151db657-9708-4e19-86c8-27b884cfcdeb 1073741824" returned: 0 in 0.973s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b0422f23-9f74-4031-83ec-3af3a3a3837b tempest-CreateVolumesFromSnapshotTest-268034479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-151db657-9708-4e19-86c8-27b884cfcdeb {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:07 devstack sudo[105302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-151db657-9708-4e19-86c8-27b884cfcdeb Jun 17 05:52:07 devstack sudo[105302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:08 devstack sudo[105302]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b0422f23-9f74-4031-83ec-3af3a3a3837b tempest-CreateVolumesFromSnapshotTest-268034479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-151db657-9708-4e19-86c8-27b884cfcdeb" returned: 0 in 1.159s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:08 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-b0422f23-9f74-4031-83ec-3af3a3a3837b tempest-CreateVolumesFromSnapshotTest-268034479 None] <== create_volume: return (2178ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:52:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-b0422f23-9f74-4031-83ec-3af3a3a3837b tempest-CreateVolumesFromSnapshotTest-268034479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.181s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:52:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-39c59aa8-5c59-4868-9a93-32f0f753f37e tempest-CreateVolumesFromSnapshotTest-268034479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.684s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:52:08 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-39c59aa8-5c59-4868-9a93-32f0f753f37e tempest-CreateVolumesFromSnapshotTest-268034479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:52:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1230060885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=095460b4-b525-437a-b8f3-b5f72a2713b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8716964877da422595daa29dd3cae9f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:52:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:52:03Z,use_quota=True,user_id='374fe51754214ee58f422397d5891eaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:52:08 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-39c59aa8-5c59-4868-9a93-32f0f753f37e tempest-CreateVolumesFromSnapshotTest-268034479 None] Creating volume 095460b4-b525-437a-b8f3-b5f72a2713b3 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:52:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-39c59aa8-5c59-4868-9a93-32f0f753f37e tempest-CreateVolumesFromSnapshotTest-268034479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:52:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-39c59aa8-5c59-4868-9a93-32f0f753f37e tempest-CreateVolumesFromSnapshotTest-268034479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:52:08 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-39c59aa8-5c59-4868-9a93-32f0f753f37e tempest-CreateVolumesFromSnapshotTest-268034479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:52:08 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-39c59aa8-5c59-4868-9a93-32f0f753f37e tempest-CreateVolumesFromSnapshotTest-268034479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:52:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-39c59aa8-5c59-4868-9a93-32f0f753f37e tempest-CreateVolumesFromSnapshotTest-268034479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:52:08 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-39c59aa8-5c59-4868-9a93-32f0f753f37e tempest-CreateVolumesFromSnapshotTest-268034479 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:52:08 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-39c59aa8-5c59-4868-9a93-32f0f753f37e tempest-CreateVolumesFromSnapshotTest-268034479 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:52:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-39c59aa8-5c59-4868-9a93-32f0f753f37e tempest-CreateVolumesFromSnapshotTest-268034479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-095460b4-b525-437a-b8f3-b5f72a2713b3 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:09 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b0422f23-9f74-4031-83ec-3af3a3a3837b tempest-CreateVolumesFromSnapshotTest-268034479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af355a2d-5ba1-4cfc-8b95-1922b10b81e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-151db657-9708-4e19-86c8-27b884cfcdeb', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:09 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b0422f23-9f74-4031-83ec-3af3a3a3837b tempest-CreateVolumesFromSnapshotTest-268034479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81ff7021-b0be-4fdc-a53a-9a19d5c834d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:09 devstack sudo[105365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-095460b4-b525-437a-b8f3-b5f72a2713b3 1073741824 Jun 17 05:52:09 devstack sudo[105365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:09 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-b0422f23-9f74-4031-83ec-3af3a3a3837b tempest-CreateVolumesFromSnapshotTest-268034479 None] Volume volume-151db657-9708-4e19-86c8-27b884cfcdeb (151db657-9708-4e19-86c8-27b884cfcdeb): created successfully Jun 17 05:52:09 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b0422f23-9f74-4031-83ec-3af3a3a3837b tempest-CreateVolumesFromSnapshotTest-268034479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81ff7021-b0be-4fdc-a53a-9a19d5c834d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:09 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b0422f23-9f74-4031-83ec-3af3a3a3837b tempest-CreateVolumesFromSnapshotTest-268034479 None] Flow 'volume_create_manager' (f4c7757b-d1fa-4fde-baaf-cfe75a6f5b70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:52:09 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-b0422f23-9f74-4031-83ec-3af3a3a3837b tempest-CreateVolumesFromSnapshotTest-268034479 None] Created volume successfully. Jun 17 05:52:10 devstack sudo[105365]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-39c59aa8-5c59-4868-9a93-32f0f753f37e tempest-CreateVolumesFromSnapshotTest-268034479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-095460b4-b525-437a-b8f3-b5f72a2713b3 1073741824" returned: 0 in 1.084s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-39c59aa8-5c59-4868-9a93-32f0f753f37e tempest-CreateVolumesFromSnapshotTest-268034479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-095460b4-b525-437a-b8f3-b5f72a2713b3 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:10 devstack sudo[105374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-095460b4-b525-437a-b8f3-b5f72a2713b3 Jun 17 05:52:10 devstack sudo[105374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:10 devstack sudo[105374]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-39c59aa8-5c59-4868-9a93-32f0f753f37e tempest-CreateVolumesFromSnapshotTest-268034479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-095460b4-b525-437a-b8f3-b5f72a2713b3" returned: 0 in 0.851s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:10 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-39c59aa8-5c59-4868-9a93-32f0f753f37e tempest-CreateVolumesFromSnapshotTest-268034479 None] <== create_volume: return (1996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:52:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-39c59aa8-5c59-4868-9a93-32f0f753f37e tempest-CreateVolumesFromSnapshotTest-268034479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:52:10 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-39c59aa8-5c59-4868-9a93-32f0f753f37e tempest-CreateVolumesFromSnapshotTest-268034479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84cd3627-4e2c-4a88-af51-8ee1ac839ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-095460b4-b525-437a-b8f3-b5f72a2713b3', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:10 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-39c59aa8-5c59-4868-9a93-32f0f753f37e tempest-CreateVolumesFromSnapshotTest-268034479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07fe38c7-ba69-418f-981e-24406c086808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:10 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-39c59aa8-5c59-4868-9a93-32f0f753f37e tempest-CreateVolumesFromSnapshotTest-268034479 None] Volume volume-095460b4-b525-437a-b8f3-b5f72a2713b3 (095460b4-b525-437a-b8f3-b5f72a2713b3): created successfully Jun 17 05:52:11 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-39c59aa8-5c59-4868-9a93-32f0f753f37e tempest-CreateVolumesFromSnapshotTest-268034479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07fe38c7-ba69-418f-981e-24406c086808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:11 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-39c59aa8-5c59-4868-9a93-32f0f753f37e tempest-CreateVolumesFromSnapshotTest-268034479 None] Flow 'volume_create_manager' (3c5b2ada-3e8a-48be-8c8b-9f0a9ada5e8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:52:11 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-39c59aa8-5c59-4868-9a93-32f0f753f37e tempest-CreateVolumesFromSnapshotTest-268034479 None] Created volume successfully. Jun 17 05:52:11 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-720798eb-564b-4812-a832-de0efca2caec tempest-CreateVolumesFromSnapshotTest-268034479 None] Acquiring lock "cinder-095460b4-b525-437a-b8f3-b5f72a2713b3-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:52:11 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-720798eb-564b-4812-a832-de0efca2caec tempest-CreateVolumesFromSnapshotTest-268034479 None] Lock "cinder-095460b4-b525-437a-b8f3-b5f72a2713b3-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:52:11 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-720798eb-564b-4812-a832-de0efca2caec tempest-CreateVolumesFromSnapshotTest-268034479 None] Acquiring lock "cinder-quobyte-095460b4-b525-437a-b8f3-b5f72a2713b3" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:52:11 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-720798eb-564b-4812-a832-de0efca2caec tempest-CreateVolumesFromSnapshotTest-268034479 None] Lock "cinder-quobyte-095460b4-b525-437a-b8f3-b5f72a2713b3" acquired by "delete_volume" :: waited 0.027s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:52:11 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f5e0e0-7388-4f18-af03-2f256a6b29b2]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:52:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-720798eb-564b-4812-a832-de0efca2caec tempest-CreateVolumesFromSnapshotTest-268034479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-095460b4-b525-437a-b8f3-b5f72a2713b3 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:11 devstack sudo[105377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-095460b4-b525-437a-b8f3-b5f72a2713b3 Jun 17 05:52:11 devstack sudo[105377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:12 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-31001738-65b3-4af0-aadd-ad64a6850464 tempest-VolumeTypesAccessTest-1929207709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:52:12 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-31001738-65b3-4af0-aadd-ad64a6850464 tempest-VolumeTypesAccessTest-1929207709 None] Flow 'volume_create_manager' (e7790b98-17cf-4a0e-86bc-45f0cccb9e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:52:12 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-31001738-65b3-4af0-aadd-ad64a6850464 tempest-VolumeTypesAccessTest-1929207709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e673b806-81c6-45ba-b71f-3e3e24be859b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:12 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-31001738-65b3-4af0-aadd-ad64a6850464 tempest-VolumeTypesAccessTest-1929207709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e673b806-81c6-45ba-b71f-3e3e24be859b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:52:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-929708718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ee182a5-8085-4734-ba8a-ca2f101d01dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67c7a80f0cef421a80eb6dab4b66e03a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:52:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:52:12Z,use_quota=True,user_id='ba4da61c4b9e4ad993271ed074e94e70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c98fe038-f6e6-4d67-823e-8a71b48b5f55),volume_type_id=c98fe038-f6e6-4d67-823e-8a71b48b5f55)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:12 devstack sudo[105377]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:12 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-31001738-65b3-4af0-aadd-ad64a6850464 tempest-VolumeTypesAccessTest-1929207709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca2e843e-e5c9-43f8-988f-70364463f73f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:12 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-31001738-65b3-4af0-aadd-ad64a6850464 tempest-VolumeTypesAccessTest-1929207709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca2e843e-e5c9-43f8-988f-70364463f73f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:12 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-31001738-65b3-4af0-aadd-ad64a6850464 tempest-VolumeTypesAccessTest-1929207709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20b94a91-922d-4447-a214-cad06e656291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:12 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-31001738-65b3-4af0-aadd-ad64a6850464 tempest-VolumeTypesAccessTest-1929207709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20b94a91-922d-4447-a214-cad06e656291) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ee182a5-8085-4734-ba8a-ca2f101d01dc', 'volume_name': 'volume-0ee182a5-8085-4734-ba8a-ca2f101d01dc', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:12 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-31001738-65b3-4af0-aadd-ad64a6850464 tempest-VolumeTypesAccessTest-1929207709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2602bcf-75be-4483-99fe-a704c6ce15ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:12 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-31001738-65b3-4af0-aadd-ad64a6850464 tempest-VolumeTypesAccessTest-1929207709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2602bcf-75be-4483-99fe-a704c6ce15ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:12 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-31001738-65b3-4af0-aadd-ad64a6850464 tempest-VolumeTypesAccessTest-1929207709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae646c9b-ad2e-430d-8080-33762ee5c5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:12 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-31001738-65b3-4af0-aadd-ad64a6850464 tempest-VolumeTypesAccessTest-1929207709 None] Volume 0ee182a5-8085-4734-ba8a-ca2f101d01dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ee182a5-8085-4734-ba8a-ca2f101d01dc', 'volume_size': 1} Jun 17 05:52:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-31001738-65b3-4af0-aadd-ad64a6850464 tempest-VolumeTypesAccessTest-1929207709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:52:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-31001738-65b3-4af0-aadd-ad64a6850464 tempest-VolumeTypesAccessTest-1929207709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:52:12 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-31001738-65b3-4af0-aadd-ad64a6850464 tempest-VolumeTypesAccessTest-1929207709 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:52:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-929708718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ee182a5-8085-4734-ba8a-ca2f101d01dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67c7a80f0cef421a80eb6dab4b66e03a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:52:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:52:12Z,use_quota=True,user_id='ba4da61c4b9e4ad993271ed074e94e70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c98fe038-f6e6-4d67-823e-8a71b48b5f55),volume_type_id=c98fe038-f6e6-4d67-823e-8a71b48b5f55)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:52:12 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-31001738-65b3-4af0-aadd-ad64a6850464 tempest-VolumeTypesAccessTest-1929207709 None] Creating volume 0ee182a5-8085-4734-ba8a-ca2f101d01dc {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:52:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-31001738-65b3-4af0-aadd-ad64a6850464 tempest-VolumeTypesAccessTest-1929207709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:52:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-31001738-65b3-4af0-aadd-ad64a6850464 tempest-VolumeTypesAccessTest-1929207709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:52:12 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-31001738-65b3-4af0-aadd-ad64a6850464 tempest-VolumeTypesAccessTest-1929207709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:52:12 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-31001738-65b3-4af0-aadd-ad64a6850464 tempest-VolumeTypesAccessTest-1929207709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:52:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-31001738-65b3-4af0-aadd-ad64a6850464 tempest-VolumeTypesAccessTest-1929207709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:52:12 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-31001738-65b3-4af0-aadd-ad64a6850464 tempest-VolumeTypesAccessTest-1929207709 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:52:12 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-31001738-65b3-4af0-aadd-ad64a6850464 tempest-VolumeTypesAccessTest-1929207709 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:52:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-31001738-65b3-4af0-aadd-ad64a6850464 tempest-VolumeTypesAccessTest-1929207709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0ee182a5-8085-4734-ba8a-ca2f101d01dc 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-720798eb-564b-4812-a832-de0efca2caec tempest-CreateVolumesFromSnapshotTest-268034479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-095460b4-b525-437a-b8f3-b5f72a2713b3" returned: 0 in 1.092s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-720798eb-564b-4812-a832-de0efca2caec tempest-CreateVolumesFromSnapshotTest-268034479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-095460b4-b525-437a-b8f3-b5f72a2713b3 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:12 devstack sudo[105417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0ee182a5-8085-4734-ba8a-ca2f101d01dc 1073741824 Jun 17 05:52:12 devstack sudo[105417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:12 devstack sudo[105418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-095460b4-b525-437a-b8f3-b5f72a2713b3 Jun 17 05:52:12 devstack sudo[105418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:13 devstack sudo[105418]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:13 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-720798eb-564b-4812-a832-de0efca2caec tempest-CreateVolumesFromSnapshotTest-268034479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-095460b4-b525-437a-b8f3-b5f72a2713b3" returned: 0 in 0.717s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:13 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-720798eb-564b-4812-a832-de0efca2caec tempest-CreateVolumesFromSnapshotTest-268034479 None] Lock "cinder-quobyte-095460b4-b525-437a-b8f3-b5f72a2713b3" released by "delete_volume" :: held 1.880s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:52:13 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-720798eb-564b-4812-a832-de0efca2caec tempest-CreateVolumesFromSnapshotTest-268034479 None] Created reservations ['31366977-18dd-40b1-b421-f7f6c47fbd1f', '68865335-bd79-4811-9b0b-9277ceedae86', 'a66dd4dd-d2ec-4172-8fb1-1bac461dc96b', 'b61b994d-88de-492a-9b7e-23de8528b24e'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:52:13 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-720798eb-564b-4812-a832-de0efca2caec tempest-CreateVolumesFromSnapshotTest-268034479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:52:13 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-720798eb-564b-4812-a832-de0efca2caec tempest-CreateVolumesFromSnapshotTest-268034479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:52:13 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-720798eb-564b-4812-a832-de0efca2caec tempest-CreateVolumesFromSnapshotTest-268034479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:52:13 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-720798eb-564b-4812-a832-de0efca2caec tempest-CreateVolumesFromSnapshotTest-268034479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:52:13 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-720798eb-564b-4812-a832-de0efca2caec tempest-CreateVolumesFromSnapshotTest-268034479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:52:13 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-720798eb-564b-4812-a832-de0efca2caec tempest-CreateVolumesFromSnapshotTest-268034479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:13 devstack sudo[105428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:52:13 devstack sudo[105428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:13 devstack sudo[105417]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:13 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-31001738-65b3-4af0-aadd-ad64a6850464 tempest-VolumeTypesAccessTest-1929207709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0ee182a5-8085-4734-ba8a-ca2f101d01dc 1073741824" returned: 0 in 0.909s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:13 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-31001738-65b3-4af0-aadd-ad64a6850464 tempest-VolumeTypesAccessTest-1929207709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0ee182a5-8085-4734-ba8a-ca2f101d01dc {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:13 devstack sudo[105430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0ee182a5-8085-4734-ba8a-ca2f101d01dc Jun 17 05:52:13 devstack sudo[105430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:13 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-6aebfe19-a25f-47d4-8988-ee182f312d0b tempest-CreateVolumesFromSnapshotTest-268034479 None] Acquiring lock "cinder-151db657-9708-4e19-86c8-27b884cfcdeb-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:52:13 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-6aebfe19-a25f-47d4-8988-ee182f312d0b tempest-CreateVolumesFromSnapshotTest-268034479 None] Lock "cinder-151db657-9708-4e19-86c8-27b884cfcdeb-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:52:13 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-6aebfe19-a25f-47d4-8988-ee182f312d0b tempest-CreateVolumesFromSnapshotTest-268034479 None] Acquiring lock "cinder-quobyte-151db657-9708-4e19-86c8-27b884cfcdeb" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:52:13 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-6aebfe19-a25f-47d4-8988-ee182f312d0b tempest-CreateVolumesFromSnapshotTest-268034479 None] Lock "cinder-quobyte-151db657-9708-4e19-86c8-27b884cfcdeb" acquired by "delete_volume" :: waited 0.025s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:52:13 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[98776562-648c-4af3-8d4b-fd9965108c1d]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:52:13 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6aebfe19-a25f-47d4-8988-ee182f312d0b tempest-CreateVolumesFromSnapshotTest-268034479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-151db657-9708-4e19-86c8-27b884cfcdeb {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:13 devstack sudo[105432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-151db657-9708-4e19-86c8-27b884cfcdeb Jun 17 05:52:13 devstack sudo[105432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:14 devstack sudo[105428]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-720798eb-564b-4812-a832-de0efca2caec tempest-CreateVolumesFromSnapshotTest-268034479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.656s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:14 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-720798eb-564b-4812-a832-de0efca2caec tempest-CreateVolumesFromSnapshotTest-268034479 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:52:14 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-720798eb-564b-4812-a832-de0efca2caec tempest-CreateVolumesFromSnapshotTest-268034479 None] Deleted volume successfully. Jun 17 05:52:14 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-720798eb-564b-4812-a832-de0efca2caec tempest-CreateVolumesFromSnapshotTest-268034479 None] Lock "cinder-095460b4-b525-437a-b8f3-b5f72a2713b3-delete_volume" released by "delete_volume" :: held 2.787s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:52:14 devstack sudo[105430]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-31001738-65b3-4af0-aadd-ad64a6850464 tempest-VolumeTypesAccessTest-1929207709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0ee182a5-8085-4734-ba8a-ca2f101d01dc" returned: 0 in 0.738s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:14 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-31001738-65b3-4af0-aadd-ad64a6850464 tempest-VolumeTypesAccessTest-1929207709 None] <== create_volume: return (1691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:52:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-31001738-65b3-4af0-aadd-ad64a6850464 tempest-VolumeTypesAccessTest-1929207709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.694s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:52:14 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-31001738-65b3-4af0-aadd-ad64a6850464 tempest-VolumeTypesAccessTest-1929207709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae646c9b-ad2e-430d-8080-33762ee5c5b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ee182a5-8085-4734-ba8a-ca2f101d01dc', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:14 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-31001738-65b3-4af0-aadd-ad64a6850464 tempest-VolumeTypesAccessTest-1929207709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5893353-fc48-4d00-8490-2b82a96124f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:14 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-31001738-65b3-4af0-aadd-ad64a6850464 tempest-VolumeTypesAccessTest-1929207709 None] Volume volume-0ee182a5-8085-4734-ba8a-ca2f101d01dc (0ee182a5-8085-4734-ba8a-ca2f101d01dc): created successfully Jun 17 05:52:14 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-31001738-65b3-4af0-aadd-ad64a6850464 tempest-VolumeTypesAccessTest-1929207709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5893353-fc48-4d00-8490-2b82a96124f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:14 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-31001738-65b3-4af0-aadd-ad64a6850464 tempest-VolumeTypesAccessTest-1929207709 None] Flow 'volume_create_manager' (e7790b98-17cf-4a0e-86bc-45f0cccb9e08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:52:14 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-31001738-65b3-4af0-aadd-ad64a6850464 tempest-VolumeTypesAccessTest-1929207709 None] Created volume successfully. Jun 17 05:52:14 devstack sudo[105432]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:14 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-4b867df2-c8c5-4729-b46c-f48279a20cbd tempest-VolumeTypesAccessTest-1929207709 None] Acquiring lock "cinder-0ee182a5-8085-4734-ba8a-ca2f101d01dc-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:52:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6aebfe19-a25f-47d4-8988-ee182f312d0b tempest-CreateVolumesFromSnapshotTest-268034479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-151db657-9708-4e19-86c8-27b884cfcdeb" returned: 0 in 0.832s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6aebfe19-a25f-47d4-8988-ee182f312d0b tempest-CreateVolumesFromSnapshotTest-268034479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-151db657-9708-4e19-86c8-27b884cfcdeb {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:14 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-4b867df2-c8c5-4729-b46c-f48279a20cbd tempest-VolumeTypesAccessTest-1929207709 None] Lock "cinder-0ee182a5-8085-4734-ba8a-ca2f101d01dc-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:52:14 devstack sudo[105440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-151db657-9708-4e19-86c8-27b884cfcdeb Jun 17 05:52:14 devstack sudo[105440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:14 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-4b867df2-c8c5-4729-b46c-f48279a20cbd tempest-VolumeTypesAccessTest-1929207709 None] Acquiring lock "cinder-quobyte-0ee182a5-8085-4734-ba8a-ca2f101d01dc" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:52:14 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-4b867df2-c8c5-4729-b46c-f48279a20cbd tempest-VolumeTypesAccessTest-1929207709 None] Lock "cinder-quobyte-0ee182a5-8085-4734-ba8a-ca2f101d01dc" acquired by "delete_volume" :: waited 0.016s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:52:14 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f56304-1abf-4b93-808f-25832b7b6691]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:52:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4b867df2-c8c5-4729-b46c-f48279a20cbd tempest-VolumeTypesAccessTest-1929207709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0ee182a5-8085-4734-ba8a-ca2f101d01dc {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:14 devstack sudo[105442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0ee182a5-8085-4734-ba8a-ca2f101d01dc Jun 17 05:52:14 devstack sudo[105442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:15 devstack sudo[105440]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6aebfe19-a25f-47d4-8988-ee182f312d0b tempest-CreateVolumesFromSnapshotTest-268034479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-151db657-9708-4e19-86c8-27b884cfcdeb" returned: 0 in 0.613s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:15 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-6aebfe19-a25f-47d4-8988-ee182f312d0b tempest-CreateVolumesFromSnapshotTest-268034479 None] Lock "cinder-quobyte-151db657-9708-4e19-86c8-27b884cfcdeb" released by "delete_volume" :: held 1.502s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:52:15 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-6aebfe19-a25f-47d4-8988-ee182f312d0b tempest-CreateVolumesFromSnapshotTest-268034479 None] Created reservations ['5da1e080-0bd9-4563-a8d1-ca9b99c5d397', '6026febc-24ae-470c-8f32-a0dccf42e4f8', '90389640-bb63-4628-b55f-71134305e157', 'fd9deb45-0e1f-46de-bbff-180dcc4a6edd'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:52:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-6aebfe19-a25f-47d4-8988-ee182f312d0b tempest-CreateVolumesFromSnapshotTest-268034479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:52:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-6aebfe19-a25f-47d4-8988-ee182f312d0b tempest-CreateVolumesFromSnapshotTest-268034479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:52:15 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-6aebfe19-a25f-47d4-8988-ee182f312d0b tempest-CreateVolumesFromSnapshotTest-268034479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:52:15 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-6aebfe19-a25f-47d4-8988-ee182f312d0b tempest-CreateVolumesFromSnapshotTest-268034479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:52:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-6aebfe19-a25f-47d4-8988-ee182f312d0b tempest-CreateVolumesFromSnapshotTest-268034479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:52:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6aebfe19-a25f-47d4-8988-ee182f312d0b tempest-CreateVolumesFromSnapshotTest-268034479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:15 devstack sudo[105448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:52:15 devstack sudo[105448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:15 devstack sudo[105442]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4b867df2-c8c5-4729-b46c-f48279a20cbd tempest-VolumeTypesAccessTest-1929207709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0ee182a5-8085-4734-ba8a-ca2f101d01dc" returned: 0 in 0.756s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4b867df2-c8c5-4729-b46c-f48279a20cbd tempest-VolumeTypesAccessTest-1929207709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0ee182a5-8085-4734-ba8a-ca2f101d01dc {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:15 devstack sudo[105450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0ee182a5-8085-4734-ba8a-ca2f101d01dc Jun 17 05:52:15 devstack sudo[105450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:15 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-889ffa3e-009a-479a-b9f8-6995f1360f7e tempest-CreateVolumesFromSnapshotTest-268034479 None] Acquiring lock "cinder-eff69357-fbe5-4f30-a5e7-b4980abbb27f-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:52:15 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-889ffa3e-009a-479a-b9f8-6995f1360f7e tempest-CreateVolumesFromSnapshotTest-268034479 None] Lock "cinder-eff69357-fbe5-4f30-a5e7-b4980abbb27f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:52:15 devstack sudo[105448]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6aebfe19-a25f-47d4-8988-ee182f312d0b tempest-CreateVolumesFromSnapshotTest-268034479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.645s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:15 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-6aebfe19-a25f-47d4-8988-ee182f312d0b tempest-CreateVolumesFromSnapshotTest-268034479 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:52:15 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-6aebfe19-a25f-47d4-8988-ee182f312d0b tempest-CreateVolumesFromSnapshotTest-268034479 None] Deleted volume successfully. Jun 17 05:52:15 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-889ffa3e-009a-479a-b9f8-6995f1360f7e tempest-CreateVolumesFromSnapshotTest-268034479 None] Acquiring lock "cinder-quobyte-eff69357-fbe5-4f30-a5e7-b4980abbb27f" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:52:15 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-6aebfe19-a25f-47d4-8988-ee182f312d0b tempest-CreateVolumesFromSnapshotTest-268034479 None] Lock "cinder-151db657-9708-4e19-86c8-27b884cfcdeb-delete_volume" released by "delete_volume" :: held 2.367s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:52:15 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-889ffa3e-009a-479a-b9f8-6995f1360f7e tempest-CreateVolumesFromSnapshotTest-268034479 None] Lock "cinder-quobyte-eff69357-fbe5-4f30-a5e7-b4980abbb27f" acquired by "delete_volume" :: waited 0.019s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:52:15 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0e6fcb-f498-43e4-ada4-004789d0a627]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:52:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-889ffa3e-009a-479a-b9f8-6995f1360f7e tempest-CreateVolumesFromSnapshotTest-268034479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-eff69357-fbe5-4f30-a5e7-b4980abbb27f {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:16 devstack sudo[105459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-eff69357-fbe5-4f30-a5e7-b4980abbb27f Jun 17 05:52:16 devstack sudo[105459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:16 devstack sudo[105450]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4b867df2-c8c5-4729-b46c-f48279a20cbd tempest-VolumeTypesAccessTest-1929207709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0ee182a5-8085-4734-ba8a-ca2f101d01dc" returned: 0 in 0.733s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:16 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-4b867df2-c8c5-4729-b46c-f48279a20cbd tempest-VolumeTypesAccessTest-1929207709 None] Lock "cinder-quobyte-0ee182a5-8085-4734-ba8a-ca2f101d01dc" released by "delete_volume" :: held 1.527s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:52:16 devstack cinder-volume[92083]: WARNING cinder.quota [None req-4b867df2-c8c5-4729-b46c-f48279a20cbd tempest-VolumeTypesAccessTest-1929207709 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-630152843 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-630152843, it is now deprecated. Please use the default quota class for default quota. Jun 17 05:52:16 devstack cinder-volume[92083]: WARNING cinder.quota [None req-4b867df2-c8c5-4729-b46c-f48279a20cbd tempest-VolumeTypesAccessTest-1929207709 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-630152843 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-630152843, it is now deprecated. Please use the default quota class for default quota. Jun 17 05:52:16 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-4b867df2-c8c5-4729-b46c-f48279a20cbd tempest-VolumeTypesAccessTest-1929207709 None] Created reservations ['b32f16a7-d87f-4032-ba5d-61fdf3fb67a9', '80d99e3b-61c7-40c3-b8f3-bb0a223cfe6b', '9df02099-b4a1-4bbc-a325-8f6289b57904', '19ff5dad-5f49-4736-a3a9-1317abb9218f'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:52:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-4b867df2-c8c5-4729-b46c-f48279a20cbd tempest-VolumeTypesAccessTest-1929207709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:52:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-4b867df2-c8c5-4729-b46c-f48279a20cbd tempest-VolumeTypesAccessTest-1929207709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:52:16 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-4b867df2-c8c5-4729-b46c-f48279a20cbd tempest-VolumeTypesAccessTest-1929207709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:52:16 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-4b867df2-c8c5-4729-b46c-f48279a20cbd tempest-VolumeTypesAccessTest-1929207709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:52:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-4b867df2-c8c5-4729-b46c-f48279a20cbd tempest-VolumeTypesAccessTest-1929207709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:52:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4b867df2-c8c5-4729-b46c-f48279a20cbd tempest-VolumeTypesAccessTest-1929207709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:16 devstack sudo[105462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:52:16 devstack sudo[105462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:16 devstack sudo[105459]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-889ffa3e-009a-479a-b9f8-6995f1360f7e tempest-CreateVolumesFromSnapshotTest-268034479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-eff69357-fbe5-4f30-a5e7-b4980abbb27f" returned: 0 in 0.759s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-889ffa3e-009a-479a-b9f8-6995f1360f7e tempest-CreateVolumesFromSnapshotTest-268034479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-eff69357-fbe5-4f30-a5e7-b4980abbb27f {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:16 devstack sudo[105469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-eff69357-fbe5-4f30-a5e7-b4980abbb27f Jun 17 05:52:16 devstack sudo[105469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:16 devstack sudo[105462]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4b867df2-c8c5-4729-b46c-f48279a20cbd tempest-VolumeTypesAccessTest-1929207709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.657s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:16 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-4b867df2-c8c5-4729-b46c-f48279a20cbd tempest-VolumeTypesAccessTest-1929207709 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:52:16 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-4b867df2-c8c5-4729-b46c-f48279a20cbd tempest-VolumeTypesAccessTest-1929207709 None] Deleted volume successfully. Jun 17 05:52:16 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-4b867df2-c8c5-4729-b46c-f48279a20cbd tempest-VolumeTypesAccessTest-1929207709 None] Lock "cinder-0ee182a5-8085-4734-ba8a-ca2f101d01dc-delete_volume" released by "delete_volume" :: held 2.386s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:52:17 devstack sudo[105469]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-889ffa3e-009a-479a-b9f8-6995f1360f7e tempest-CreateVolumesFromSnapshotTest-268034479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-eff69357-fbe5-4f30-a5e7-b4980abbb27f" returned: 0 in 0.690s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:17 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-889ffa3e-009a-479a-b9f8-6995f1360f7e tempest-CreateVolumesFromSnapshotTest-268034479 None] Lock "cinder-quobyte-eff69357-fbe5-4f30-a5e7-b4980abbb27f" released by "delete_volume" :: held 1.489s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:52:17 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-889ffa3e-009a-479a-b9f8-6995f1360f7e tempest-CreateVolumesFromSnapshotTest-268034479 None] Created reservations ['7e1833bb-b4f1-494a-b707-b9e56e3cabd9', '79464d1e-5d64-469e-83e3-32dae5b1f3b5', 'c90372f4-cbc2-4bf7-b7d7-5f51e065425e', 'e8ed93c1-ad24-4072-bd58-14a9c17444bd'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:52:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-889ffa3e-009a-479a-b9f8-6995f1360f7e tempest-CreateVolumesFromSnapshotTest-268034479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:52:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-889ffa3e-009a-479a-b9f8-6995f1360f7e tempest-CreateVolumesFromSnapshotTest-268034479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:52:17 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-889ffa3e-009a-479a-b9f8-6995f1360f7e tempest-CreateVolumesFromSnapshotTest-268034479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:52:17 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-889ffa3e-009a-479a-b9f8-6995f1360f7e tempest-CreateVolumesFromSnapshotTest-268034479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:52:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-889ffa3e-009a-479a-b9f8-6995f1360f7e tempest-CreateVolumesFromSnapshotTest-268034479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:52:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-889ffa3e-009a-479a-b9f8-6995f1360f7e tempest-CreateVolumesFromSnapshotTest-268034479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:17 devstack sudo[105472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:52:17 devstack sudo[105472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:18 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-5bb10ab1-b8ac-4211-87f9-9b2311307ad8 tempest-CreateVolumesFromSnapshotTest-268034479 None] Acquiring lock "cinder-774c2145-61a4-4fe1-97cd-ad97466c29c3-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:52:18 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-5bb10ab1-b8ac-4211-87f9-9b2311307ad8 tempest-CreateVolumesFromSnapshotTest-268034479 None] Lock "cinder-774c2145-61a4-4fe1-97cd-ad97466c29c3-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:52:18 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-5bb10ab1-b8ac-4211-87f9-9b2311307ad8 tempest-CreateVolumesFromSnapshotTest-268034479 None] Acquiring lock "cinder-quobyte-774c2145-61a4-4fe1-97cd-ad97466c29c3" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:52:18 devstack sudo[105472]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:18 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-889ffa3e-009a-479a-b9f8-6995f1360f7e tempest-CreateVolumesFromSnapshotTest-268034479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.712s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:18 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-889ffa3e-009a-479a-b9f8-6995f1360f7e tempest-CreateVolumesFromSnapshotTest-268034479 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:52:18 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-5bb10ab1-b8ac-4211-87f9-9b2311307ad8 tempest-CreateVolumesFromSnapshotTest-268034479 None] Lock "cinder-quobyte-774c2145-61a4-4fe1-97cd-ad97466c29c3" acquired by "delete_volume" :: waited 0.022s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:52:18 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-889ffa3e-009a-479a-b9f8-6995f1360f7e tempest-CreateVolumesFromSnapshotTest-268034479 None] Deleted volume successfully. Jun 17 05:52:18 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce43cdd-9ff0-4125-9f7f-56c4ac16c8c9]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:52:18 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-5bb10ab1-b8ac-4211-87f9-9b2311307ad8 tempest-CreateVolumesFromSnapshotTest-268034479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-774c2145-61a4-4fe1-97cd-ad97466c29c3 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:18 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-889ffa3e-009a-479a-b9f8-6995f1360f7e tempest-CreateVolumesFromSnapshotTest-268034479 None] Lock "cinder-eff69357-fbe5-4f30-a5e7-b4980abbb27f-delete_volume" released by "delete_volume" :: held 2.487s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:52:18 devstack sudo[105475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-774c2145-61a4-4fe1-97cd-ad97466c29c3 Jun 17 05:52:18 devstack sudo[105475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:19 devstack sudo[105475]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:19 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-5bb10ab1-b8ac-4211-87f9-9b2311307ad8 tempest-CreateVolumesFromSnapshotTest-268034479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-774c2145-61a4-4fe1-97cd-ad97466c29c3" returned: 0 in 0.846s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:19 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-5bb10ab1-b8ac-4211-87f9-9b2311307ad8 tempest-CreateVolumesFromSnapshotTest-268034479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-774c2145-61a4-4fe1-97cd-ad97466c29c3 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:19 devstack sudo[105481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-774c2145-61a4-4fe1-97cd-ad97466c29c3 Jun 17 05:52:19 devstack sudo[105481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:19 devstack sudo[105481]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:19 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-5bb10ab1-b8ac-4211-87f9-9b2311307ad8 tempest-CreateVolumesFromSnapshotTest-268034479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-774c2145-61a4-4fe1-97cd-ad97466c29c3" returned: 0 in 0.722s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:19 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-5bb10ab1-b8ac-4211-87f9-9b2311307ad8 tempest-CreateVolumesFromSnapshotTest-268034479 None] Lock "cinder-quobyte-774c2145-61a4-4fe1-97cd-ad97466c29c3" released by "delete_volume" :: held 1.625s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:52:19 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-5bb10ab1-b8ac-4211-87f9-9b2311307ad8 tempest-CreateVolumesFromSnapshotTest-268034479 None] Created reservations ['2565498b-a33a-4f72-bee0-81d61bf62c21', '4287f965-b722-4660-baa9-eac9d26aa224', '2da137de-06bd-491b-904e-2ec924c6d656', '4e3fd07e-8f05-46a6-aaa0-290db51874fe'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:52:20 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-5bb10ab1-b8ac-4211-87f9-9b2311307ad8 tempest-CreateVolumesFromSnapshotTest-268034479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:52:20 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-5bb10ab1-b8ac-4211-87f9-9b2311307ad8 tempest-CreateVolumesFromSnapshotTest-268034479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:52:20 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-5bb10ab1-b8ac-4211-87f9-9b2311307ad8 tempest-CreateVolumesFromSnapshotTest-268034479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:52:20 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-5bb10ab1-b8ac-4211-87f9-9b2311307ad8 tempest-CreateVolumesFromSnapshotTest-268034479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:52:20 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-5bb10ab1-b8ac-4211-87f9-9b2311307ad8 tempest-CreateVolumesFromSnapshotTest-268034479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:52:20 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-5bb10ab1-b8ac-4211-87f9-9b2311307ad8 tempest-CreateVolumesFromSnapshotTest-268034479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:20 devstack sudo[105484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:52:20 devstack sudo[105484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:20 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-d30527b9-1775-4a06-a9fb-c040269d0a78 tempest-CreateVolumesFromSnapshotTest-268034479 None] Acquiring lock "cinder-acb2a230-4501-4c20-9213-a854061f4cbb-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:52:20 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-d30527b9-1775-4a06-a9fb-c040269d0a78 tempest-CreateVolumesFromSnapshotTest-268034479 None] Lock "cinder-acb2a230-4501-4c20-9213-a854061f4cbb-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:52:20 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-d30527b9-1775-4a06-a9fb-c040269d0a78 tempest-CreateVolumesFromSnapshotTest-268034479 None] Acquiring lock "cinder-quobyte-acb2a230-4501-4c20-9213-a854061f4cbb" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:52:20 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-d30527b9-1775-4a06-a9fb-c040269d0a78 tempest-CreateVolumesFromSnapshotTest-268034479 None] Lock "cinder-quobyte-acb2a230-4501-4c20-9213-a854061f4cbb" acquired by "delete_volume" :: waited 0.019s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:52:20 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f5b7ba-af95-4f81-8f69-2eb15bbb3ab0]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:52:20 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-d30527b9-1775-4a06-a9fb-c040269d0a78 tempest-CreateVolumesFromSnapshotTest-268034479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-acb2a230-4501-4c20-9213-a854061f4cbb {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:20 devstack sudo[105487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-acb2a230-4501-4c20-9213-a854061f4cbb Jun 17 05:52:20 devstack sudo[105487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:20 devstack sudo[105484]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:20 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-5bb10ab1-b8ac-4211-87f9-9b2311307ad8 tempest-CreateVolumesFromSnapshotTest-268034479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.738s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:20 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-5bb10ab1-b8ac-4211-87f9-9b2311307ad8 tempest-CreateVolumesFromSnapshotTest-268034479 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:52:20 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-5bb10ab1-b8ac-4211-87f9-9b2311307ad8 tempest-CreateVolumesFromSnapshotTest-268034479 None] Deleted volume successfully. Jun 17 05:52:20 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-5bb10ab1-b8ac-4211-87f9-9b2311307ad8 tempest-CreateVolumesFromSnapshotTest-268034479 None] Lock "cinder-774c2145-61a4-4fe1-97cd-ad97466c29c3-delete_volume" released by "delete_volume" :: held 2.721s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:52:21 devstack sudo[105487]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:21 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-d30527b9-1775-4a06-a9fb-c040269d0a78 tempest-CreateVolumesFromSnapshotTest-268034479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-acb2a230-4501-4c20-9213-a854061f4cbb" returned: 0 in 0.864s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:21 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-d30527b9-1775-4a06-a9fb-c040269d0a78 tempest-CreateVolumesFromSnapshotTest-268034479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-acb2a230-4501-4c20-9213-a854061f4cbb {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:21 devstack sudo[105494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-acb2a230-4501-4c20-9213-a854061f4cbb Jun 17 05:52:21 devstack sudo[105494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:22 devstack sudo[105494]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:22 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-d30527b9-1775-4a06-a9fb-c040269d0a78 tempest-CreateVolumesFromSnapshotTest-268034479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-acb2a230-4501-4c20-9213-a854061f4cbb" returned: 0 in 0.627s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:22 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-d30527b9-1775-4a06-a9fb-c040269d0a78 tempest-CreateVolumesFromSnapshotTest-268034479 None] Lock "cinder-quobyte-acb2a230-4501-4c20-9213-a854061f4cbb" released by "delete_volume" :: held 1.543s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:52:22 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-d30527b9-1775-4a06-a9fb-c040269d0a78 tempest-CreateVolumesFromSnapshotTest-268034479 None] Created reservations ['d2ce81b4-5939-412b-bfe4-98980bf5bc99', 'afe52350-a4a1-44ab-9d86-e93aa22b6001', '49633baf-fbc2-492e-9c89-a87c6f7e00df', 'd9f68ece-60ff-4849-87b3-6c68f1f0922b'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:52:22 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-d30527b9-1775-4a06-a9fb-c040269d0a78 tempest-CreateVolumesFromSnapshotTest-268034479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:52:22 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-d30527b9-1775-4a06-a9fb-c040269d0a78 tempest-CreateVolumesFromSnapshotTest-268034479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:52:22 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-d30527b9-1775-4a06-a9fb-c040269d0a78 tempest-CreateVolumesFromSnapshotTest-268034479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:52:22 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-d30527b9-1775-4a06-a9fb-c040269d0a78 tempest-CreateVolumesFromSnapshotTest-268034479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:52:22 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-d30527b9-1775-4a06-a9fb-c040269d0a78 tempest-CreateVolumesFromSnapshotTest-268034479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:52:22 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-d30527b9-1775-4a06-a9fb-c040269d0a78 tempest-CreateVolumesFromSnapshotTest-268034479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:22 devstack sudo[105497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:52:22 devstack sudo[105497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:22 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-ff305af5-49ad-44fe-a87f-a8554c90424c tempest-CreateVolumesFromSnapshotTest-268034479 None] Acquiring lock "cinder-d47b17c7-d523-444f-a6fc-8ac239cdc5ac-delete_snapshot" by "delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:52:22 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-ff305af5-49ad-44fe-a87f-a8554c90424c tempest-CreateVolumesFromSnapshotTest-268034479 None] Lock "cinder-d47b17c7-d523-444f-a6fc-8ac239cdc5ac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:52:22 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-ff305af5-49ad-44fe-a87f-a8554c90424c tempest-CreateVolumesFromSnapshotTest-268034479 None] Acquiring lock "cinder-quobyte-f4c459f4-7021-4f41-9556-e556e063d9a6" by "delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:52:22 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-ff305af5-49ad-44fe-a87f-a8554c90424c tempest-CreateVolumesFromSnapshotTest-268034479 None] Lock "cinder-quobyte-f4c459f4-7021-4f41-9556-e556e063d9a6" acquired by "delete_snapshot" :: waited 0.019s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:52:22 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-ff305af5-49ad-44fe-a87f-a8554c90424c tempest-CreateVolumesFromSnapshotTest-268034479 None] Acquiring lock "cinder-quobyte-d47b17c7-d523-444f-a6fc-8ac239cdc5ac" by "_delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:52:22 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-ff305af5-49ad-44fe-a87f-a8554c90424c tempest-CreateVolumesFromSnapshotTest-268034479 None] Lock "cinder-quobyte-d47b17c7-d523-444f-a6fc-8ac239cdc5ac" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:52:22 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-ff305af5-49ad-44fe-a87f-a8554c90424c tempest-CreateVolumesFromSnapshotTest-268034479 None] Deleting offline snapshot d47b17c7-d523-444f-a6fc-8ac239cdc5ac of volume f4c459f4-7021-4f41-9556-e556e063d9a6 {{(pid=92083) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 17 05:52:22 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-ff305af5-49ad-44fe-a87f-a8554c90424c tempest-CreateVolumesFromSnapshotTest-268034479 None] snapshot_file for this snap is: volume-f4c459f4-7021-4f41-9556-e556e063d9a6.d47b17c7-d523-444f-a6fc-8ac239cdc5ac {{(pid=92083) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 17 05:52:22 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b601e70-1513-44ac-9d10-9f129a394058]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:52:22 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ff305af5-49ad-44fe-a87f-a8554c90424c tempest-CreateVolumesFromSnapshotTest-268034479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f4c459f4-7021-4f41-9556-e556e063d9a6.d47b17c7-d523-444f-a6fc-8ac239cdc5ac {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:22 devstack sudo[105497]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:22 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-d30527b9-1775-4a06-a9fb-c040269d0a78 tempest-CreateVolumesFromSnapshotTest-268034479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.740s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:22 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-d30527b9-1775-4a06-a9fb-c040269d0a78 tempest-CreateVolumesFromSnapshotTest-268034479 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:52:22 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-d30527b9-1775-4a06-a9fb-c040269d0a78 tempest-CreateVolumesFromSnapshotTest-268034479 None] Deleted volume successfully. Jun 17 05:52:22 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-d30527b9-1775-4a06-a9fb-c040269d0a78 tempest-CreateVolumesFromSnapshotTest-268034479 None] Lock "cinder-acb2a230-4501-4c20-9213-a854061f4cbb-delete_volume" released by "delete_volume" :: held 2.541s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:52:23 devstack sudo[105500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f4c459f4-7021-4f41-9556-e556e063d9a6.d47b17c7-d523-444f-a6fc-8ac239cdc5ac Jun 17 05:52:23 devstack sudo[105500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:23 devstack sudo[105500]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:23 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ff305af5-49ad-44fe-a87f-a8554c90424c tempest-CreateVolumesFromSnapshotTest-268034479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f4c459f4-7021-4f41-9556-e556e063d9a6.d47b17c7-d523-444f-a6fc-8ac239cdc5ac" returned: 0 in 0.827s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:23 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-ff305af5-49ad-44fe-a87f-a8554c90424c tempest-CreateVolumesFromSnapshotTest-268034479 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4c459f4-7021-4f41-9556-e556e063d9a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92083) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 05:52:23 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc33b19-c16b-4b9f-9d66-bcb888ba9368]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:52:23 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ff305af5-49ad-44fe-a87f-a8554c90424c tempest-CreateVolumesFromSnapshotTest-268034479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f4c459f4-7021-4f41-9556-e556e063d9a6 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:23 devstack sudo[105505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f4c459f4-7021-4f41-9556-e556e063d9a6 Jun 17 05:52:23 devstack sudo[105505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:24 devstack sudo[105505]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ff305af5-49ad-44fe-a87f-a8554c90424c tempest-CreateVolumesFromSnapshotTest-268034479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f4c459f4-7021-4f41-9556-e556e063d9a6" returned: 0 in 0.872s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ff305af5-49ad-44fe-a87f-a8554c90424c tempest-CreateVolumesFromSnapshotTest-268034479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f4c459f4-7021-4f41-9556-e556e063d9a6.d47b17c7-d523-444f-a6fc-8ac239cdc5ac {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:24 devstack sudo[105510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f4c459f4-7021-4f41-9556-e556e063d9a6.d47b17c7-d523-444f-a6fc-8ac239cdc5ac Jun 17 05:52:24 devstack sudo[105510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:25 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-9c0d089d-40de-4c88-b40e-e0dbeade33c2 tempest-VolumesNegativeTest-758418413 None] Acquiring lock "cinder-294c802b-0e74-43d6-8c92-889fc47b553a-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:52:25 devstack sudo[105510]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ff305af5-49ad-44fe-a87f-a8554c90424c tempest-CreateVolumesFromSnapshotTest-268034479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f4c459f4-7021-4f41-9556-e556e063d9a6.d47b17c7-d523-444f-a6fc-8ac239cdc5ac" returned: 0 in 0.843s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ff305af5-49ad-44fe-a87f-a8554c90424c tempest-CreateVolumesFromSnapshotTest-268034479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f4c459f4-7021-4f41-9556-e556e063d9a6.d47b17c7-d523-444f-a6fc-8ac239cdc5ac {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:25 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-9c0d089d-40de-4c88-b40e-e0dbeade33c2 tempest-VolumesNegativeTest-758418413 None] Lock "cinder-294c802b-0e74-43d6-8c92-889fc47b553a-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:52:25 devstack sudo[105516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f4c459f4-7021-4f41-9556-e556e063d9a6.d47b17c7-d523-444f-a6fc-8ac239cdc5ac Jun 17 05:52:25 devstack sudo[105516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:25 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-9c0d089d-40de-4c88-b40e-e0dbeade33c2 tempest-VolumesNegativeTest-758418413 None] Acquiring lock "cinder-quobyte-294c802b-0e74-43d6-8c92-889fc47b553a" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:52:25 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-9c0d089d-40de-4c88-b40e-e0dbeade33c2 tempest-VolumesNegativeTest-758418413 None] Lock "cinder-quobyte-294c802b-0e74-43d6-8c92-889fc47b553a" acquired by "delete_volume" :: waited 0.022s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:52:25 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f74f7ef-7f40-4bab-b0ab-703a2a1ab058]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:52:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-9c0d089d-40de-4c88-b40e-e0dbeade33c2 tempest-VolumesNegativeTest-758418413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-294c802b-0e74-43d6-8c92-889fc47b553a {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:25 devstack sudo[105518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-294c802b-0e74-43d6-8c92-889fc47b553a Jun 17 05:52:25 devstack sudo[105518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:26 devstack sudo[105516]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:26 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ff305af5-49ad-44fe-a87f-a8554c90424c tempest-CreateVolumesFromSnapshotTest-268034479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f4c459f4-7021-4f41-9556-e556e063d9a6.d47b17c7-d523-444f-a6fc-8ac239cdc5ac" returned: 0 in 0.625s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:26 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-ff305af5-49ad-44fe-a87f-a8554c90424c tempest-CreateVolumesFromSnapshotTest-268034479 None] Lock "cinder-quobyte-d47b17c7-d523-444f-a6fc-8ac239cdc5ac" released by "_delete_snapshot" :: held 3.328s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:52:26 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-ff305af5-49ad-44fe-a87f-a8554c90424c tempest-CreateVolumesFromSnapshotTest-268034479 None] Lock "cinder-quobyte-f4c459f4-7021-4f41-9556-e556e063d9a6" released by "delete_snapshot" :: held 3.360s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:52:26 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-ff305af5-49ad-44fe-a87f-a8554c90424c tempest-CreateVolumesFromSnapshotTest-268034479 None] Created reservations ['0d69898a-4624-4c96-8e93-c82d41811b39', 'b20165c4-3f1c-4253-8ce4-34c166693a58', '9da2a001-c938-4b7c-a947-ea53e2278ba6', '05af7ca2-0f7f-458c-a5ec-fe1b40fe4cbe'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:52:26 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-ff305af5-49ad-44fe-a87f-a8554c90424c tempest-CreateVolumesFromSnapshotTest-268034479 None] Delete snapshot completed successfully. Jun 17 05:52:26 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-ff305af5-49ad-44fe-a87f-a8554c90424c tempest-CreateVolumesFromSnapshotTest-268034479 None] Lock "cinder-d47b17c7-d523-444f-a6fc-8ac239cdc5ac-delete_snapshot" released by "delete_snapshot" :: held 3.509s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:52:26 devstack sudo[105518]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:26 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-9c0d089d-40de-4c88-b40e-e0dbeade33c2 tempest-VolumesNegativeTest-758418413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-294c802b-0e74-43d6-8c92-889fc47b553a" returned: 0 in 0.754s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:26 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-9c0d089d-40de-4c88-b40e-e0dbeade33c2 tempest-VolumesNegativeTest-758418413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-294c802b-0e74-43d6-8c92-889fc47b553a {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:26 devstack sudo[105524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-294c802b-0e74-43d6-8c92-889fc47b553a Jun 17 05:52:26 devstack sudo[105524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:26 devstack sudo[105524]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:26 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-9c0d089d-40de-4c88-b40e-e0dbeade33c2 tempest-VolumesNegativeTest-758418413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-294c802b-0e74-43d6-8c92-889fc47b553a" returned: 0 in 0.635s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:27 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-75e9f43a-2d17-4d36-8a7a-6c8799c5414c tempest-CreateVolumesFromSnapshotTest-268034479 None] Acquiring lock "cinder-f4c459f4-7021-4f41-9556-e556e063d9a6-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:52:27 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-9c0d089d-40de-4c88-b40e-e0dbeade33c2 tempest-VolumesNegativeTest-758418413 None] Lock "cinder-quobyte-294c802b-0e74-43d6-8c92-889fc47b553a" released by "delete_volume" :: held 1.449s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:52:27 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-75e9f43a-2d17-4d36-8a7a-6c8799c5414c tempest-CreateVolumesFromSnapshotTest-268034479 None] Lock "cinder-f4c459f4-7021-4f41-9556-e556e063d9a6-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:52:27 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-75e9f43a-2d17-4d36-8a7a-6c8799c5414c tempest-CreateVolumesFromSnapshotTest-268034479 None] Acquiring lock "cinder-quobyte-f4c459f4-7021-4f41-9556-e556e063d9a6" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:52:27 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-9c0d089d-40de-4c88-b40e-e0dbeade33c2 tempest-VolumesNegativeTest-758418413 None] Created reservations ['4c177649-eeac-4042-a404-79bd41d5aed7', '424567e2-e303-4c08-aa5b-978553d7217b', '80fcdacd-913b-40b8-896f-298c4d12403c', 'a5b7b872-34f5-4da7-b470-bc2f8ef7fad3'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:52:27 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-75e9f43a-2d17-4d36-8a7a-6c8799c5414c tempest-CreateVolumesFromSnapshotTest-268034479 None] Lock "cinder-quobyte-f4c459f4-7021-4f41-9556-e556e063d9a6" acquired by "delete_volume" :: waited 0.023s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:52:27 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9fcf7d6-2530-4bee-b262-2950dc0c2e3f]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:52:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-75e9f43a-2d17-4d36-8a7a-6c8799c5414c tempest-CreateVolumesFromSnapshotTest-268034479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f4c459f4-7021-4f41-9556-e556e063d9a6 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-9c0d089d-40de-4c88-b40e-e0dbeade33c2 tempest-VolumesNegativeTest-758418413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:52:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-9c0d089d-40de-4c88-b40e-e0dbeade33c2 tempest-VolumesNegativeTest-758418413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:52:27 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-9c0d089d-40de-4c88-b40e-e0dbeade33c2 tempest-VolumesNegativeTest-758418413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:52:27 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-9c0d089d-40de-4c88-b40e-e0dbeade33c2 tempest-VolumesNegativeTest-758418413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:52:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-9c0d089d-40de-4c88-b40e-e0dbeade33c2 tempest-VolumesNegativeTest-758418413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:52:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-9c0d089d-40de-4c88-b40e-e0dbeade33c2 tempest-VolumesNegativeTest-758418413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:27 devstack sudo[105528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:52:27 devstack sudo[105528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:27 devstack sudo[105527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f4c459f4-7021-4f41-9556-e556e063d9a6 Jun 17 05:52:27 devstack sudo[105527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:27 devstack cinder-volume[92083]: DEBUG oslo_service.periodic_task [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92083) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 05:52:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:52:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:52:27 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:52:27 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:52:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:52:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:27 devstack sudo[105531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:52:27 devstack sudo[105531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:27 devstack sudo[105528]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-9c0d089d-40de-4c88-b40e-e0dbeade33c2 tempest-VolumesNegativeTest-758418413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.667s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:27 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-9c0d089d-40de-4c88-b40e-e0dbeade33c2 tempest-VolumesNegativeTest-758418413 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:52:27 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-9c0d089d-40de-4c88-b40e-e0dbeade33c2 tempest-VolumesNegativeTest-758418413 None] Deleted volume successfully. Jun 17 05:52:27 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-9c0d089d-40de-4c88-b40e-e0dbeade33c2 tempest-VolumesNegativeTest-758418413 None] Lock "cinder-294c802b-0e74-43d6-8c92-889fc47b553a-delete_volume" released by "delete_volume" :: held 2.420s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:52:28 devstack sudo[105527]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-75e9f43a-2d17-4d36-8a7a-6c8799c5414c tempest-CreateVolumesFromSnapshotTest-268034479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f4c459f4-7021-4f41-9556-e556e063d9a6" returned: 0 in 1.009s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-75e9f43a-2d17-4d36-8a7a-6c8799c5414c tempest-CreateVolumesFromSnapshotTest-268034479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f4c459f4-7021-4f41-9556-e556e063d9a6 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:28 devstack sudo[105538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f4c459f4-7021-4f41-9556-e556e063d9a6 Jun 17 05:52:28 devstack sudo[105538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:28 devstack sudo[105531]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.908s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:28 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:52:28 devstack cinder-volume[92083]: DEBUG oslo_service.periodic_task [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running periodic task VolumeManager._thread_info {{(pid=92083) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 05:52:28 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] thread count: 28 {{(pid=92083) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 17 05:52:28 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] thread info: [<_MainThread(MainThread, started 133483869905024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92083) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 17 05:52:28 devstack sudo[105538]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-75e9f43a-2d17-4d36-8a7a-6c8799c5414c tempest-CreateVolumesFromSnapshotTest-268034479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f4c459f4-7021-4f41-9556-e556e063d9a6" returned: 0 in 0.785s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:28 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-75e9f43a-2d17-4d36-8a7a-6c8799c5414c tempest-CreateVolumesFromSnapshotTest-268034479 None] Lock "cinder-quobyte-f4c459f4-7021-4f41-9556-e556e063d9a6" released by "delete_volume" :: held 1.872s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:52:29 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-75e9f43a-2d17-4d36-8a7a-6c8799c5414c tempest-CreateVolumesFromSnapshotTest-268034479 None] Created reservations ['dcc72409-905c-46de-be42-f6b1eb9995f7', '209c9be0-b907-47d0-b3d3-a202ee732811', '9dc0f67e-c032-4a01-8aee-c94ef382dec9', 'f634d424-cdad-44fc-8d4c-25529a9c7f94'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:52:29 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-75e9f43a-2d17-4d36-8a7a-6c8799c5414c tempest-CreateVolumesFromSnapshotTest-268034479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:52:29 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-75e9f43a-2d17-4d36-8a7a-6c8799c5414c tempest-CreateVolumesFromSnapshotTest-268034479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:52:29 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-75e9f43a-2d17-4d36-8a7a-6c8799c5414c tempest-CreateVolumesFromSnapshotTest-268034479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:52:29 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-75e9f43a-2d17-4d36-8a7a-6c8799c5414c tempest-CreateVolumesFromSnapshotTest-268034479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:52:29 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-75e9f43a-2d17-4d36-8a7a-6c8799c5414c tempest-CreateVolumesFromSnapshotTest-268034479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:52:29 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-75e9f43a-2d17-4d36-8a7a-6c8799c5414c tempest-CreateVolumesFromSnapshotTest-268034479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:29 devstack sudo[105543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:52:29 devstack sudo[105543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:30 devstack sudo[105543]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:30 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-75e9f43a-2d17-4d36-8a7a-6c8799c5414c tempest-CreateVolumesFromSnapshotTest-268034479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 1.019s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:30 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-75e9f43a-2d17-4d36-8a7a-6c8799c5414c tempest-CreateVolumesFromSnapshotTest-268034479 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:52:30 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-75e9f43a-2d17-4d36-8a7a-6c8799c5414c tempest-CreateVolumesFromSnapshotTest-268034479 None] Deleted volume successfully. Jun 17 05:52:30 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-75e9f43a-2d17-4d36-8a7a-6c8799c5414c tempest-CreateVolumesFromSnapshotTest-268034479 None] Lock "cinder-f4c459f4-7021-4f41-9556-e556e063d9a6-delete_volume" released by "delete_volume" :: held 3.170s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:52:34 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-25c51c82-fffb-4d2c-940d-80730e1527eb tempest-CinderUnicodeTest-1400853430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:52:34 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-25c51c82-fffb-4d2c-940d-80730e1527eb tempest-CinderUnicodeTest-1400853430 None] Flow 'volume_create_manager' (ce798da5-6eef-4583-9398-8e010ebd55e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:52:34 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-25c51c82-fffb-4d2c-940d-80730e1527eb tempest-CinderUnicodeTest-1400853430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afec1200-a05f-4f55-bbae-73a45b3821e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:34 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-25c51c82-fffb-4d2c-940d-80730e1527eb tempest-CinderUnicodeTest-1400853430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afec1200-a05f-4f55-bbae-73a45b3821e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:52:34Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f0cd366-d6c1-4470-8ab7-597a1b75b849,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b44f3ea106b74dd18d6d330ba124720d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:52:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:52:35Z,use_quota=True,user_id='2e55a24a0eba4b3288c1f3ea9c27539d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:34 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-25c51c82-fffb-4d2c-940d-80730e1527eb tempest-CinderUnicodeTest-1400853430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d39c8be3-c780-4b5a-b1f6-8748c1f740cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:34 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-25c51c82-fffb-4d2c-940d-80730e1527eb tempest-CinderUnicodeTest-1400853430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d39c8be3-c780-4b5a-b1f6-8748c1f740cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:34 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-25c51c82-fffb-4d2c-940d-80730e1527eb tempest-CinderUnicodeTest-1400853430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d2591e1-5952-4a3c-8c46-a57fc6a8355f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:34 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-25c51c82-fffb-4d2c-940d-80730e1527eb tempest-CinderUnicodeTest-1400853430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d2591e1-5952-4a3c-8c46-a57fc6a8355f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f0cd366-d6c1-4470-8ab7-597a1b75b849', 'volume_name': 'volume-6f0cd366-d6c1-4470-8ab7-597a1b75b849', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:34 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-25c51c82-fffb-4d2c-940d-80730e1527eb tempest-CinderUnicodeTest-1400853430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd012833-12bb-4c41-b8d4-5b8976245133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:34 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-25c51c82-fffb-4d2c-940d-80730e1527eb tempest-CinderUnicodeTest-1400853430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd012833-12bb-4c41-b8d4-5b8976245133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:34 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-25c51c82-fffb-4d2c-940d-80730e1527eb tempest-CinderUnicodeTest-1400853430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7622561f-705a-431b-b160-c7c87c411bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:34 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-25c51c82-fffb-4d2c-940d-80730e1527eb tempest-CinderUnicodeTest-1400853430 None] Volume 6f0cd366-d6c1-4470-8ab7-597a1b75b849: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f0cd366-d6c1-4470-8ab7-597a1b75b849', 'volume_size': 1} Jun 17 05:52:34 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-25c51c82-fffb-4d2c-940d-80730e1527eb tempest-CinderUnicodeTest-1400853430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:52:34 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-25c51c82-fffb-4d2c-940d-80730e1527eb tempest-CinderUnicodeTest-1400853430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:52:34 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-25c51c82-fffb-4d2c-940d-80730e1527eb tempest-CinderUnicodeTest-1400853430 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:52:34Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f0cd366-d6c1-4470-8ab7-597a1b75b849,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b44f3ea106b74dd18d6d330ba124720d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:52:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:52:35Z,use_quota=True,user_id='2e55a24a0eba4b3288c1f3ea9c27539d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:52:34 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-25c51c82-fffb-4d2c-940d-80730e1527eb tempest-CinderUnicodeTest-1400853430 None] Creating volume 6f0cd366-d6c1-4470-8ab7-597a1b75b849 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:52:34 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-25c51c82-fffb-4d2c-940d-80730e1527eb tempest-CinderUnicodeTest-1400853430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:52:34 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-25c51c82-fffb-4d2c-940d-80730e1527eb tempest-CinderUnicodeTest-1400853430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:52:34 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-25c51c82-fffb-4d2c-940d-80730e1527eb tempest-CinderUnicodeTest-1400853430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:52:34 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-25c51c82-fffb-4d2c-940d-80730e1527eb tempest-CinderUnicodeTest-1400853430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:52:34 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-25c51c82-fffb-4d2c-940d-80730e1527eb tempest-CinderUnicodeTest-1400853430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:52:34 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-25c51c82-fffb-4d2c-940d-80730e1527eb tempest-CinderUnicodeTest-1400853430 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:52:34 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-25c51c82-fffb-4d2c-940d-80730e1527eb tempest-CinderUnicodeTest-1400853430 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:52:34 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-25c51c82-fffb-4d2c-940d-80730e1527eb tempest-CinderUnicodeTest-1400853430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6f0cd366-d6c1-4470-8ab7-597a1b75b849 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:34 devstack sudo[105584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6f0cd366-d6c1-4470-8ab7-597a1b75b849 1073741824 Jun 17 05:52:34 devstack sudo[105584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:35 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:52:35 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] Flow 'volume_create_manager' (5c75a4f8-eb24-4718-b746-92eab8cc2be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:52:35 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea6fd7af-5f94-41d0-ae21-d207ce51bd4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:35 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea6fd7af-5f94-41d0-ae21-d207ce51bd4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:52:35Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81a49095-1e66-4625-960d-19d4cf670bf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8077951112744b4b926772da81fe8b22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:52:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:52:35Z,use_quota=True,user_id='500d93daff77415b914dba0a5f9f4ce0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c64c0dc0-7c9b-4bc4-8c40-05af1234ea6d),volume_type_id=c64c0dc0-7c9b-4bc4-8c40-05af1234ea6d)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:35 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4dc386e-967d-4551-9049-0efb1eb2fd43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:35 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4dc386e-967d-4551-9049-0efb1eb2fd43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:35 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (720b9cbd-624b-4fb6-8451-5eb1ca01b6de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:35 devstack cinder-volume[92083]: DEBUG cinder.image.glance [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] Creating Keystone auth plugin from conf {{(pid=92083) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 17 05:52:35 devstack sudo[105584]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:35 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-25c51c82-fffb-4d2c-940d-80730e1527eb tempest-CinderUnicodeTest-1400853430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6f0cd366-d6c1-4470-8ab7-597a1b75b849 1073741824" returned: 0 in 1.037s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:35 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-25c51c82-fffb-4d2c-940d-80730e1527eb tempest-CinderUnicodeTest-1400853430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6f0cd366-d6c1-4470-8ab7-597a1b75b849 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:35 devstack sudo[105591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6f0cd366-d6c1-4470-8ab7-597a1b75b849 Jun 17 05:52:35 devstack sudo[105591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:35 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (720b9cbd-624b-4fb6-8451-5eb1ca01b6de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '81a49095-1e66-4625-960d-19d4cf670bf3', 'volume_name': 'volume-81a49095-1e66-4625-960d-19d4cf670bf3', 'volume_size': 1, 'image_id': 'bc31ffa3-84c3-4f74-ac61-79f0d16c2a5e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bc31ffa3-84c3-4f74-ac61-79f0d16c2a5e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a3cdfe1ce7dfec5d6031d90257e0c8ea', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8077951112744b4b926772da81fe8b22', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f6953ebdec36e2e64829bd5d7e5896dd020aabb94c56cfe1b9dfc9871f59b4276417250bd6931906acf0e51ad03bf3ff62fa2f9adbe69d262a9f066fbb6839c0', 'id': 'bc31ffa3-84c3-4f74-ac61-79f0d16c2a5e', 'created_at': datetime.datetime(2026, 6, 17, 3, 52, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 3, 52, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bc31ffa3-84c3-4f74-ac61-79f0d16c2a5e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:35 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2c1dd6f-6f43-4d16-b333-b0f0236a2403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:35 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2c1dd6f-6f43-4d16-b333-b0f0236a2403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:35 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a74c6d0-37bd-47ae-a1c3-58e84e5e49b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:35 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] Volume 81a49095-1e66-4625-960d-19d4cf670bf3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-81a49095-1e66-4625-960d-19d4cf670bf3', 'volume_size': 1, 'image_id': 'bc31ffa3-84c3-4f74-ac61-79f0d16c2a5e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bc31ffa3-84c3-4f74-ac61-79f0d16c2a5e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a3cdfe1ce7dfec5d6031d90257e0c8ea', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8077951112744b4b926772da81fe8b22', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f6953ebdec36e2e64829bd5d7e5896dd020aabb94c56cfe1b9dfc9871f59b4276417250bd6931906acf0e51ad03bf3ff62fa2f9adbe69d262a9f066fbb6839c0', 'id': 'bc31ffa3-84c3-4f74-ac61-79f0d16c2a5e', 'created_at': datetime.datetime(2026, 6, 17, 3, 52, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 3, 52, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bc31ffa3-84c3-4f74-ac61-79f0d16c2a5e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 17 05:52:35 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] Trying to clone 81a49095-1e66-4625-960d-19d4cf670bf3 from image bc31ffa3-84c3-4f74-ac61-79f0d16c2a5e at location (None, [{'url': 'file:///opt/stack/data/glance/images/bc31ffa3-84c3-4f74-ac61-79f0d16c2a5e', 'metadata': {}}]). {{(pid=92083) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 17 05:52:36 devstack cinder-volume[92083]: DEBUG cinder.image.image_utils [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bc31ffa3-84c3-4f74-ac61-79f0d16c2a5e_br7ldefkdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=92083) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 17 05:52:36 devstack cinder-volume[92083]: INFO cinder.image.image_utils [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] Image download 0.00 MB at 0.00 MB/s Jun 17 05:52:36 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ede15e-81e0-4a77-90d7-28d9796f14c5]: (4, 'raw') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:52:36 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bc31ffa3-84c3-4f74-ac61-79f0d16c2a5e_br7ldefkdevstack@QuobyteHD {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:36 devstack sudo[105593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bc31ffa3-84c3-4f74-ac61-79f0d16c2a5e_br7ldefkdevstack@QuobyteHD Jun 17 05:52:36 devstack sudo[105593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:36 devstack sudo[105591]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:36 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-25c51c82-fffb-4d2c-940d-80730e1527eb tempest-CinderUnicodeTest-1400853430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6f0cd366-d6c1-4470-8ab7-597a1b75b849" returned: 0 in 0.651s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:36 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-25c51c82-fffb-4d2c-940d-80730e1527eb tempest-CinderUnicodeTest-1400853430 None] <== create_volume: return (1737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:52:36 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-25c51c82-fffb-4d2c-940d-80730e1527eb tempest-CinderUnicodeTest-1400853430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.740s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:52:36 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-25c51c82-fffb-4d2c-940d-80730e1527eb tempest-CinderUnicodeTest-1400853430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7622561f-705a-431b-b160-c7c87c411bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f0cd366-d6c1-4470-8ab7-597a1b75b849', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:36 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-25c51c82-fffb-4d2c-940d-80730e1527eb tempest-CinderUnicodeTest-1400853430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbe7bbe9-0f40-42fa-85d4-41a39b4a5fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:36 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-25c51c82-fffb-4d2c-940d-80730e1527eb tempest-CinderUnicodeTest-1400853430 None] Volume volume-6f0cd366-d6c1-4470-8ab7-597a1b75b849 (6f0cd366-d6c1-4470-8ab7-597a1b75b849): created successfully Jun 17 05:52:36 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-25c51c82-fffb-4d2c-940d-80730e1527eb tempest-CinderUnicodeTest-1400853430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbe7bbe9-0f40-42fa-85d4-41a39b4a5fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:36 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-25c51c82-fffb-4d2c-940d-80730e1527eb tempest-CinderUnicodeTest-1400853430 None] Flow 'volume_create_manager' (ce798da5-6eef-4583-9398-8e010ebd55e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:52:36 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-25c51c82-fffb-4d2c-940d-80730e1527eb tempest-CinderUnicodeTest-1400853430 None] Created volume successfully. Jun 17 05:52:36 devstack sudo[105593]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:36 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bc31ffa3-84c3-4f74-ac61-79f0d16c2a5e_br7ldefkdevstack@QuobyteHD" returned: 0 in 0.707s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:36 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bc31ffa3-84c3-4f74-ac61-79f0d16c2a5e_br7ldefkdevstack@QuobyteHD {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:36 devstack sudo[105598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bc31ffa3-84c3-4f74-ac61-79f0d16c2a5e_br7ldefkdevstack@QuobyteHD Jun 17 05:52:36 devstack sudo[105598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:37 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ed51c15-2e1f-4d92-9de4-6760e52e2e6d tempest-CinderUnicodeTest-1400853430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:52:37 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1ed51c15-2e1f-4d92-9de4-6760e52e2e6d tempest-CinderUnicodeTest-1400853430 None] Flow 'volume_create_manager' (e7816dd3-48e8-4166-aca3-0f387eb3d960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:52:37 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1ed51c15-2e1f-4d92-9de4-6760e52e2e6d tempest-CinderUnicodeTest-1400853430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e30766ca-910c-463a-9554-acd55b95ee96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:37 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1ed51c15-2e1f-4d92-9de4-6760e52e2e6d tempest-CinderUnicodeTest-1400853430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e30766ca-910c-463a-9554-acd55b95ee96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:52:37Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1881556772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f0f39e2-0af5-4773-b093-a6ce9863b2f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b44f3ea106b74dd18d6d330ba124720d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:52:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:52:37Z,use_quota=True,user_id='2e55a24a0eba4b3288c1f3ea9c27539d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:37 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1ed51c15-2e1f-4d92-9de4-6760e52e2e6d tempest-CinderUnicodeTest-1400853430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36821df4-c2df-45a3-a4ce-ce7e60525c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:37 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1ed51c15-2e1f-4d92-9de4-6760e52e2e6d tempest-CinderUnicodeTest-1400853430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36821df4-c2df-45a3-a4ce-ce7e60525c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:37 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1ed51c15-2e1f-4d92-9de4-6760e52e2e6d tempest-CinderUnicodeTest-1400853430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71add7e7-0400-4bf9-845e-60dfcbac8b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:37 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1ed51c15-2e1f-4d92-9de4-6760e52e2e6d tempest-CinderUnicodeTest-1400853430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71add7e7-0400-4bf9-845e-60dfcbac8b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f0f39e2-0af5-4773-b093-a6ce9863b2f2', 'volume_name': 'volume-7f0f39e2-0af5-4773-b093-a6ce9863b2f2', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:37 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1ed51c15-2e1f-4d92-9de4-6760e52e2e6d tempest-CinderUnicodeTest-1400853430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b18639ed-cd57-4848-8929-fc91870dcdc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:37 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1ed51c15-2e1f-4d92-9de4-6760e52e2e6d tempest-CinderUnicodeTest-1400853430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b18639ed-cd57-4848-8929-fc91870dcdc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:37 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1ed51c15-2e1f-4d92-9de4-6760e52e2e6d tempest-CinderUnicodeTest-1400853430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c64b305-c6b1-45c8-aca6-c6202a1c487a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:37 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-1ed51c15-2e1f-4d92-9de4-6760e52e2e6d tempest-CinderUnicodeTest-1400853430 None] Volume 7f0f39e2-0af5-4773-b093-a6ce9863b2f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f0f39e2-0af5-4773-b093-a6ce9863b2f2', 'volume_size': 1} Jun 17 05:52:37 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-1ed51c15-2e1f-4d92-9de4-6760e52e2e6d tempest-CinderUnicodeTest-1400853430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:52:37 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-1ed51c15-2e1f-4d92-9de4-6760e52e2e6d tempest-CinderUnicodeTest-1400853430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:52:37 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-1ed51c15-2e1f-4d92-9de4-6760e52e2e6d tempest-CinderUnicodeTest-1400853430 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:52:37Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1881556772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f0f39e2-0af5-4773-b093-a6ce9863b2f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b44f3ea106b74dd18d6d330ba124720d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:52:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:52:37Z,use_quota=True,user_id='2e55a24a0eba4b3288c1f3ea9c27539d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:52:37 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-1ed51c15-2e1f-4d92-9de4-6760e52e2e6d tempest-CinderUnicodeTest-1400853430 None] Creating volume 7f0f39e2-0af5-4773-b093-a6ce9863b2f2 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:52:37 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-1ed51c15-2e1f-4d92-9de4-6760e52e2e6d tempest-CinderUnicodeTest-1400853430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:52:37 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-1ed51c15-2e1f-4d92-9de4-6760e52e2e6d tempest-CinderUnicodeTest-1400853430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:52:37 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-1ed51c15-2e1f-4d92-9de4-6760e52e2e6d tempest-CinderUnicodeTest-1400853430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:52:37 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-1ed51c15-2e1f-4d92-9de4-6760e52e2e6d tempest-CinderUnicodeTest-1400853430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:52:37 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-1ed51c15-2e1f-4d92-9de4-6760e52e2e6d tempest-CinderUnicodeTest-1400853430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:52:37 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-1ed51c15-2e1f-4d92-9de4-6760e52e2e6d tempest-CinderUnicodeTest-1400853430 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:52:37 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-1ed51c15-2e1f-4d92-9de4-6760e52e2e6d tempest-CinderUnicodeTest-1400853430 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:52:37 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1ed51c15-2e1f-4d92-9de4-6760e52e2e6d tempest-CinderUnicodeTest-1400853430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7f0f39e2-0af5-4773-b093-a6ce9863b2f2 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:37 devstack sudo[105600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7f0f39e2-0af5-4773-b093-a6ce9863b2f2 1073741824 Jun 17 05:52:37 devstack sudo[105600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:37 devstack sudo[105598]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:37 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bc31ffa3-84c3-4f74-ac61-79f0d16c2a5e_br7ldefkdevstack@QuobyteHD" returned: 1 in 0.789s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:37 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bc31ffa3-84c3-4f74-ac61-79f0d16c2a5e_br7ldefkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 05:52:37 devstack cinder-volume[92083]: DEBUG cinder.image.image_utils [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] Temporary image bc31ffa3-84c3-4f74-ac61-79f0d16c2a5e is fetched for user 500d93daff77415b914dba0a5f9f4ce0. {{(pid=92083) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 17 05:52:37 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ebaa42-1701-444d-9b22-fcdd75b055ec]: (4, 'raw') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:52:37 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bc31ffa3-84c3-4f74-ac61-79f0d16c2a5e_br7ldefkdevstack@QuobyteHD {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:37 devstack sudo[105605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bc31ffa3-84c3-4f74-ac61-79f0d16c2a5e_br7ldefkdevstack@QuobyteHD Jun 17 05:52:37 devstack sudo[105605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:38 devstack sudo[105600]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:38 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1ed51c15-2e1f-4d92-9de4-6760e52e2e6d tempest-CinderUnicodeTest-1400853430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7f0f39e2-0af5-4773-b093-a6ce9863b2f2 1073741824" returned: 0 in 0.985s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:38 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1ed51c15-2e1f-4d92-9de4-6760e52e2e6d tempest-CinderUnicodeTest-1400853430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7f0f39e2-0af5-4773-b093-a6ce9863b2f2 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:38 devstack sudo[105611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7f0f39e2-0af5-4773-b093-a6ce9863b2f2 Jun 17 05:52:38 devstack sudo[105611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:38 devstack sudo[105605]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:38 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bc31ffa3-84c3-4f74-ac61-79f0d16c2a5e_br7ldefkdevstack@QuobyteHD" returned: 0 in 0.805s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:38 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bc31ffa3-84c3-4f74-ac61-79f0d16c2a5e_br7ldefkdevstack@QuobyteHD {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:38 devstack sudo[105615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bc31ffa3-84c3-4f74-ac61-79f0d16c2a5e_br7ldefkdevstack@QuobyteHD Jun 17 05:52:38 devstack sudo[105615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:39 devstack sudo[105611]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1ed51c15-2e1f-4d92-9de4-6760e52e2e6d tempest-CinderUnicodeTest-1400853430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7f0f39e2-0af5-4773-b093-a6ce9863b2f2" returned: 0 in 0.708s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:39 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-1ed51c15-2e1f-4d92-9de4-6760e52e2e6d tempest-CinderUnicodeTest-1400853430 None] <== create_volume: return (1745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:52:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-1ed51c15-2e1f-4d92-9de4-6760e52e2e6d tempest-CinderUnicodeTest-1400853430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.749s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:52:39 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1ed51c15-2e1f-4d92-9de4-6760e52e2e6d tempest-CinderUnicodeTest-1400853430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c64b305-c6b1-45c8-aca6-c6202a1c487a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f0f39e2-0af5-4773-b093-a6ce9863b2f2', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:39 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1ed51c15-2e1f-4d92-9de4-6760e52e2e6d tempest-CinderUnicodeTest-1400853430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63838b8f-24aa-46e3-b86d-3061b9173f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:39 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-1ed51c15-2e1f-4d92-9de4-6760e52e2e6d tempest-CinderUnicodeTest-1400853430 None] Volume volume-7f0f39e2-0af5-4773-b093-a6ce9863b2f2 (7f0f39e2-0af5-4773-b093-a6ce9863b2f2): created successfully Jun 17 05:52:39 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1ed51c15-2e1f-4d92-9de4-6760e52e2e6d tempest-CinderUnicodeTest-1400853430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63838b8f-24aa-46e3-b86d-3061b9173f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:39 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1ed51c15-2e1f-4d92-9de4-6760e52e2e6d tempest-CinderUnicodeTest-1400853430 None] Flow 'volume_create_manager' (e7816dd3-48e8-4166-aca3-0f387eb3d960) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:52:39 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-1ed51c15-2e1f-4d92-9de4-6760e52e2e6d tempest-CinderUnicodeTest-1400853430 None] Created volume successfully. Jun 17 05:52:39 devstack sudo[105615]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bc31ffa3-84c3-4f74-ac61-79f0d16c2a5e_br7ldefkdevstack@QuobyteHD" returned: 1 in 0.912s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bc31ffa3-84c3-4f74-ac61-79f0d16c2a5e_br7ldefkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 05:52:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:52:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:52:39 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:52:35Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81a49095-1e66-4625-960d-19d4cf670bf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8077951112744b4b926772da81fe8b22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:52:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:52:35Z,use_quota=True,user_id='500d93daff77415b914dba0a5f9f4ce0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c64c0dc0-7c9b-4bc4-8c40-05af1234ea6d),volume_type_id=c64c0dc0-7c9b-4bc4-8c40-05af1234ea6d)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:52:39 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] Creating volume 81a49095-1e66-4625-960d-19d4cf670bf3 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:52:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:52:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:52:39 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:52:39 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:52:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:52:39 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:52:39 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:52:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-81a49095-1e66-4625-960d-19d4cf670bf3 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:39 devstack sudo[105622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-81a49095-1e66-4625-960d-19d4cf670bf3 1073741824 Jun 17 05:52:39 devstack sudo[105622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-3c3fd263-fdce-49c1-98b9-22d2394f0cf5 tempest-CinderUnicodeTest-1400853430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:52:40 devstack sudo[105622]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:40 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-81a49095-1e66-4625-960d-19d4cf670bf3 1073741824" returned: 0 in 0.859s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:40 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-81a49095-1e66-4625-960d-19d4cf670bf3 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:40 devstack sudo[105628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-81a49095-1e66-4625-960d-19d4cf670bf3 Jun 17 05:52:40 devstack sudo[105628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:41 devstack sudo[105628]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:41 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-81a49095-1e66-4625-960d-19d4cf670bf3" returned: 0 in 0.653s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:41 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] <== create_volume: return (1554ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:52:41 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.557s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:52:41 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-3c3fd263-fdce-49c1-98b9-22d2394f0cf5 tempest-CinderUnicodeTest-1400853430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.401s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:52:41 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-3c3fd263-fdce-49c1-98b9-22d2394f0cf5 tempest-CinderUnicodeTest-1400853430 None] Creating offline snapshot 67519525-951f-4810-bc78-511cb9a67038 of volume 7f0f39e2-0af5-4773-b093-a6ce9863b2f2 {{(pid=92083) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 17 05:52:41 devstack cinder-volume[92083]: DEBUG cinder.volume.volume_utils [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] Attempting download of bc31ffa3-84c3-4f74-ac61-79f0d16c2a5e ((None, [{'url': 'file:///opt/stack/data/glance/images/bc31ffa3-84c3-4f74-ac61-79f0d16c2a5e', 'metadata': {}}])) to volume 81a49095-1e66-4625-960d-19d4cf670bf3. {{(pid=92083) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 17 05:52:41 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[62287bd0-4c37-4ef2-8090-5a67e5e1f18a]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:52:41 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-3c3fd263-fdce-49c1-98b9-22d2394f0cf5 tempest-CinderUnicodeTest-1400853430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7f0f39e2-0af5-4773-b093-a6ce9863b2f2 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:41 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1d522c-a8a2-42c9-b678-eea53c2d8f5b]: (4, 'raw') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:52:41 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bc31ffa3-84c3-4f74-ac61-79f0d16c2a5e_097zkd6h {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:41 devstack sudo[105631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7f0f39e2-0af5-4773-b093-a6ce9863b2f2 Jun 17 05:52:41 devstack sudo[105631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:41 devstack sudo[105632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bc31ffa3-84c3-4f74-ac61-79f0d16c2a5e_097zkd6h Jun 17 05:52:41 devstack sudo[105632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:41 devstack sudo[105631]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:41 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-3c3fd263-fdce-49c1-98b9-22d2394f0cf5 tempest-CinderUnicodeTest-1400853430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7f0f39e2-0af5-4773-b093-a6ce9863b2f2" returned: 0 in 0.759s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:41 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-3c3fd263-fdce-49c1-98b9-22d2394f0cf5 tempest-CinderUnicodeTest-1400853430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7f0f39e2-0af5-4773-b093-a6ce9863b2f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7f0f39e2-0af5-4773-b093-a6ce9863b2f2.67519525-951f-4810-bc78-511cb9a67038 1G {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:41 devstack sudo[105640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7f0f39e2-0af5-4773-b093-a6ce9863b2f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7f0f39e2-0af5-4773-b093-a6ce9863b2f2.67519525-951f-4810-bc78-511cb9a67038 1G Jun 17 05:52:41 devstack sudo[105640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:41 devstack sudo[105632]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:41 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bc31ffa3-84c3-4f74-ac61-79f0d16c2a5e_097zkd6h" returned: 0 in 0.777s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:41 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bc31ffa3-84c3-4f74-ac61-79f0d16c2a5e_097zkd6h {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:42 devstack sudo[105642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bc31ffa3-84c3-4f74-ac61-79f0d16c2a5e_097zkd6h Jun 17 05:52:42 devstack sudo[105642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:42 devstack sudo[105642]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bc31ffa3-84c3-4f74-ac61-79f0d16c2a5e_097zkd6h" returned: 1 in 0.691s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bc31ffa3-84c3-4f74-ac61-79f0d16c2a5e_097zkd6h' failed. Not Retrying. {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 05:52:42 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[4baa69be-6980-488a-9828-c3a975661d7e]: (4, 'raw') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:52:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bc31ffa3-84c3-4f74-ac61-79f0d16c2a5e_br7ldefkdevstack@QuobyteHD {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:42 devstack sudo[105640]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-3c3fd263-fdce-49c1-98b9-22d2394f0cf5 tempest-CinderUnicodeTest-1400853430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7f0f39e2-0af5-4773-b093-a6ce9863b2f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7f0f39e2-0af5-4773-b093-a6ce9863b2f2.67519525-951f-4810-bc78-511cb9a67038 1G" returned: 0 in 0.796s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-3c3fd263-fdce-49c1-98b9-22d2394f0cf5 tempest-CinderUnicodeTest-1400853430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f0f39e2-0af5-4773-b093-a6ce9863b2f2 -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7f0f39e2-0af5-4773-b093-a6ce9863b2f2.67519525-951f-4810-bc78-511cb9a67038 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:42 devstack sudo[105651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f0f39e2-0af5-4773-b093-a6ce9863b2f2 -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7f0f39e2-0af5-4773-b093-a6ce9863b2f2.67519525-951f-4810-bc78-511cb9a67038 Jun 17 05:52:42 devstack sudo[105651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:42 devstack sudo[105650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bc31ffa3-84c3-4f74-ac61-79f0d16c2a5e_br7ldefkdevstack@QuobyteHD Jun 17 05:52:42 devstack sudo[105650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:43 devstack sudo[105651]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:43 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-3c3fd263-fdce-49c1-98b9-22d2394f0cf5 tempest-CinderUnicodeTest-1400853430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f0f39e2-0af5-4773-b093-a6ce9863b2f2 -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7f0f39e2-0af5-4773-b093-a6ce9863b2f2.67519525-951f-4810-bc78-511cb9a67038" returned: 0 in 0.810s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:43 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [None req-3c3fd263-fdce-49c1-98b9-22d2394f0cf5 tempest-CinderUnicodeTest-1400853430 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7f0f39e2-0af5-4773-b093-a6ce9863b2f2.67519525-951f-4810-bc78-511cb9a67038 is being set with open permissions: ugo+rw Jun 17 05:52:43 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-3c3fd263-fdce-49c1-98b9-22d2394f0cf5 tempest-CinderUnicodeTest-1400853430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7f0f39e2-0af5-4773-b093-a6ce9863b2f2.67519525-951f-4810-bc78-511cb9a67038 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:43 devstack sudo[105659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7f0f39e2-0af5-4773-b093-a6ce9863b2f2.67519525-951f-4810-bc78-511cb9a67038 Jun 17 05:52:43 devstack sudo[105659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:43 devstack sudo[105650]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:43 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bc31ffa3-84c3-4f74-ac61-79f0d16c2a5e_br7ldefkdevstack@QuobyteHD" returned: 0 in 0.900s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:43 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bc31ffa3-84c3-4f74-ac61-79f0d16c2a5e_br7ldefkdevstack@QuobyteHD {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:43 devstack sudo[105661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bc31ffa3-84c3-4f74-ac61-79f0d16c2a5e_br7ldefkdevstack@QuobyteHD Jun 17 05:52:43 devstack sudo[105661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:44 devstack sudo[105659]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:44 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-3c3fd263-fdce-49c1-98b9-22d2394f0cf5 tempest-CinderUnicodeTest-1400853430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7f0f39e2-0af5-4773-b093-a6ce9863b2f2.67519525-951f-4810-bc78-511cb9a67038" returned: 0 in 0.809s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:44 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-3c3fd263-fdce-49c1-98b9-22d2394f0cf5 tempest-CinderUnicodeTest-1400853430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7f0f39e2-0af5-4773-b093-a6ce9863b2f2.info {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:44 devstack sudo[105661]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:44 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bc31ffa3-84c3-4f74-ac61-79f0d16c2a5e_br7ldefkdevstack@QuobyteHD" returned: 1 in 0.808s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:44 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bc31ffa3-84c3-4f74-ac61-79f0d16c2a5e_br7ldefkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 05:52:44 devstack sudo[105667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7f0f39e2-0af5-4773-b093-a6ce9863b2f2.info Jun 17 05:52:44 devstack sudo[105667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:44 devstack cinder-volume[92083]: DEBUG cinder.image.image_utils [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] bc31ffa3-84c3-4f74-ac61-79f0d16c2a5e was raw, converting to raw {{(pid=92083) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 17 05:52:44 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_bc31ffa3-84c3-4f74-ac61-79f0d16c2a5e_br7ldefkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-81a49095-1e66-4625-960d-19d4cf670bf3 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:44 devstack sudo[105669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_bc31ffa3-84c3-4f74-ac61-79f0d16c2a5e_br7ldefkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-81a49095-1e66-4625-960d-19d4cf670bf3 Jun 17 05:52:44 devstack sudo[105669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:44 devstack sudo[105667]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:44 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-3c3fd263-fdce-49c1-98b9-22d2394f0cf5 tempest-CinderUnicodeTest-1400853430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7f0f39e2-0af5-4773-b093-a6ce9863b2f2.info" returned: 0 in 0.653s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:44 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [None req-3c3fd263-fdce-49c1-98b9-22d2394f0cf5 tempest-CinderUnicodeTest-1400853430 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7f0f39e2-0af5-4773-b093-a6ce9863b2f2.info is being set with open permissions: ugo+rw Jun 17 05:52:44 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-3c3fd263-fdce-49c1-98b9-22d2394f0cf5 tempest-CinderUnicodeTest-1400853430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7f0f39e2-0af5-4773-b093-a6ce9863b2f2.info {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:44 devstack sudo[105675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7f0f39e2-0af5-4773-b093-a6ce9863b2f2.info Jun 17 05:52:44 devstack sudo[105675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:45 devstack sudo[105669]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:45 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_bc31ffa3-84c3-4f74-ac61-79f0d16c2a5e_br7ldefkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-81a49095-1e66-4625-960d-19d4cf670bf3" returned: 0 in 0.723s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:45 devstack cinder-volume[92083]: DEBUG cinder.image.image_utils [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bc31ffa3-84c3-4f74-ac61-79f0d16c2a5e_br7ldefkdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-81a49095-1e66-4625-960d-19d4cf670bf3 {{(pid=92083) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 17 05:52:45 devstack cinder-volume[92083]: INFO cinder.image.image_utils [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] Converted 0.00 MB image at 0.00 MB/s Jun 17 05:52:45 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-81a49095-1e66-4625-960d-19d4cf670bf3 1G {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:45 devstack sudo[105677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-81a49095-1e66-4625-960d-19d4cf670bf3 1G Jun 17 05:52:45 devstack sudo[105677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:45 devstack sudo[105675]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:45 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-3c3fd263-fdce-49c1-98b9-22d2394f0cf5 tempest-CinderUnicodeTest-1400853430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7f0f39e2-0af5-4773-b093-a6ce9863b2f2.info" returned: 0 in 0.706s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:45 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-3c3fd263-fdce-49c1-98b9-22d2394f0cf5 tempest-CinderUnicodeTest-1400853430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.632s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:52:45 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-3c3fd263-fdce-49c1-98b9-22d2394f0cf5 tempest-CinderUnicodeTest-1400853430 None] Create snapshot completed successfully Jun 17 05:52:45 devstack sudo[105677]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:45 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-81a49095-1e66-4625-960d-19d4cf670bf3 1G" returned: 0 in 0.737s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:45 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc742e30-8276-4185-9b6b-e736a75fdb56]: (4, 'raw') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:52:45 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-81a49095-1e66-4625-960d-19d4cf670bf3 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:45 devstack sudo[105685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-81a49095-1e66-4625-960d-19d4cf670bf3 Jun 17 05:52:45 devstack sudo[105685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:45 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-1109b5de-af26-4d7a-9a68-ad6d9aece54a tempest-CinderUnicodeTest-1400853430 None] Acquiring lock "cinder-67519525-951f-4810-bc78-511cb9a67038-delete_snapshot" by "delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:52:46 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-1109b5de-af26-4d7a-9a68-ad6d9aece54a tempest-CinderUnicodeTest-1400853430 None] Lock "cinder-67519525-951f-4810-bc78-511cb9a67038-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:52:46 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-1109b5de-af26-4d7a-9a68-ad6d9aece54a tempest-CinderUnicodeTest-1400853430 None] Acquiring lock "cinder-quobyte-7f0f39e2-0af5-4773-b093-a6ce9863b2f2" by "delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:52:46 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-1109b5de-af26-4d7a-9a68-ad6d9aece54a tempest-CinderUnicodeTest-1400853430 None] Lock "cinder-quobyte-7f0f39e2-0af5-4773-b093-a6ce9863b2f2" acquired by "delete_snapshot" :: waited 0.019s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:52:46 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-1109b5de-af26-4d7a-9a68-ad6d9aece54a tempest-CinderUnicodeTest-1400853430 None] Acquiring lock "cinder-quobyte-67519525-951f-4810-bc78-511cb9a67038" by "_delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:52:46 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-1109b5de-af26-4d7a-9a68-ad6d9aece54a tempest-CinderUnicodeTest-1400853430 None] Lock "cinder-quobyte-67519525-951f-4810-bc78-511cb9a67038" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:52:46 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-1109b5de-af26-4d7a-9a68-ad6d9aece54a tempest-CinderUnicodeTest-1400853430 None] Deleting offline snapshot 67519525-951f-4810-bc78-511cb9a67038 of volume 7f0f39e2-0af5-4773-b093-a6ce9863b2f2 {{(pid=92083) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 17 05:52:46 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-1109b5de-af26-4d7a-9a68-ad6d9aece54a tempest-CinderUnicodeTest-1400853430 None] snapshot_file for this snap is: volume-7f0f39e2-0af5-4773-b093-a6ce9863b2f2.67519525-951f-4810-bc78-511cb9a67038 {{(pid=92083) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 17 05:52:46 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ae348a-61f7-4e50-9213-5137bf23fda0]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:52:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1109b5de-af26-4d7a-9a68-ad6d9aece54a tempest-CinderUnicodeTest-1400853430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7f0f39e2-0af5-4773-b093-a6ce9863b2f2.67519525-951f-4810-bc78-511cb9a67038 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:46 devstack sudo[105687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7f0f39e2-0af5-4773-b093-a6ce9863b2f2.67519525-951f-4810-bc78-511cb9a67038 Jun 17 05:52:46 devstack sudo[105687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:46 devstack sudo[105685]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-81a49095-1e66-4625-960d-19d4cf670bf3" returned: 0 in 0.737s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-81a49095-1e66-4625-960d-19d4cf670bf3 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:46 devstack sudo[105691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-81a49095-1e66-4625-960d-19d4cf670bf3 Jun 17 05:52:46 devstack sudo[105691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:46 devstack sudo[105687]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1109b5de-af26-4d7a-9a68-ad6d9aece54a tempest-CinderUnicodeTest-1400853430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7f0f39e2-0af5-4773-b093-a6ce9863b2f2.67519525-951f-4810-bc78-511cb9a67038" returned: 0 in 0.793s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:46 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-1109b5de-af26-4d7a-9a68-ad6d9aece54a tempest-CinderUnicodeTest-1400853430 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f0f39e2-0af5-4773-b093-a6ce9863b2f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92083) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 05:52:46 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[489aeb70-546d-4270-a884-6fd1c5df2acf]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:52:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1109b5de-af26-4d7a-9a68-ad6d9aece54a tempest-CinderUnicodeTest-1400853430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7f0f39e2-0af5-4773-b093-a6ce9863b2f2 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:47 devstack sudo[105696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7f0f39e2-0af5-4773-b093-a6ce9863b2f2 Jun 17 05:52:47 devstack sudo[105696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:47 devstack sudo[105691]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:47 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-81a49095-1e66-4625-960d-19d4cf670bf3" returned: 1 in 0.719s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:47 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-81a49095-1e66-4625-960d-19d4cf670bf3' failed. Not Retrying. {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 05:52:47 devstack cinder-volume[92083]: DEBUG cinder.volume.volume_utils [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] Downloaded image bc31ffa3-84c3-4f74-ac61-79f0d16c2a5e ((None, [{'url': 'file:///opt/stack/data/glance/images/bc31ffa3-84c3-4f74-ac61-79f0d16c2a5e', 'metadata': {}}])) to volume 81a49095-1e66-4625-960d-19d4cf670bf3 successfully. {{(pid=92083) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 17 05:52:47 devstack cinder-volume[92083]: DEBUG cinder.image.image_utils [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] Temporary image bc31ffa3-84c3-4f74-ac61-79f0d16c2a5e for user 500d93daff77415b914dba0a5f9f4ce0 is deleted. {{(pid=92083) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 17 05:52:47 devstack cinder-volume[92083]: DEBUG cinder.volume.volume_utils [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] Marking volume 81a49095-1e66-4625-960d-19d4cf670bf3 as bootable. {{(pid=92083) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 17 05:52:47 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] Copying metadata from image bc31ffa3-84c3-4f74-ac61-79f0d16c2a5e to 81a49095-1e66-4625-960d-19d4cf670bf3. {{(pid=92083) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 17 05:52:47 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] Creating volume glance metadata for volume 81a49095-1e66-4625-960d-19d4cf670bf3 backed by image bc31ffa3-84c3-4f74-ac61-79f0d16c2a5e with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'bc31ffa3-84c3-4f74-ac61-79f0d16c2a5e', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'a3cdfe1ce7dfec5d6031d90257e0c8ea', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=92083) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 17 05:52:47 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a74c6d0-37bd-47ae-a1c3-58e84e5e49b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81a49095-1e66-4625-960d-19d4cf670bf3', 'volume_size': 1, 'image_id': 'bc31ffa3-84c3-4f74-ac61-79f0d16c2a5e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bc31ffa3-84c3-4f74-ac61-79f0d16c2a5e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a3cdfe1ce7dfec5d6031d90257e0c8ea', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8077951112744b4b926772da81fe8b22', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f6953ebdec36e2e64829bd5d7e5896dd020aabb94c56cfe1b9dfc9871f59b4276417250bd6931906acf0e51ad03bf3ff62fa2f9adbe69d262a9f066fbb6839c0', 'id': 'bc31ffa3-84c3-4f74-ac61-79f0d16c2a5e', 'created_at': datetime.datetime(2026, 6, 17, 3, 52, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 3, 52, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bc31ffa3-84c3-4f74-ac61-79f0d16c2a5e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:47 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db36f962-3243-4d34-86e1-df3fbc21a16f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:47 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] Volume volume-81a49095-1e66-4625-960d-19d4cf670bf3 (81a49095-1e66-4625-960d-19d4cf670bf3): created successfully Jun 17 05:52:47 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db36f962-3243-4d34-86e1-df3fbc21a16f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:47 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] Flow 'volume_create_manager' (5c75a4f8-eb24-4718-b746-92eab8cc2be8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:52:47 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-59e6f38d-8df3-406f-8bd6-03b9c779a4e6 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] Created volume successfully. Jun 17 05:52:47 devstack sudo[105696]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:47 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1109b5de-af26-4d7a-9a68-ad6d9aece54a tempest-CinderUnicodeTest-1400853430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7f0f39e2-0af5-4773-b093-a6ce9863b2f2" returned: 0 in 0.746s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:47 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1109b5de-af26-4d7a-9a68-ad6d9aece54a tempest-CinderUnicodeTest-1400853430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7f0f39e2-0af5-4773-b093-a6ce9863b2f2.67519525-951f-4810-bc78-511cb9a67038 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:47 devstack sudo[105705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7f0f39e2-0af5-4773-b093-a6ce9863b2f2.67519525-951f-4810-bc78-511cb9a67038 Jun 17 05:52:47 devstack sudo[105705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:48 devstack sudo[105705]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:48 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1109b5de-af26-4d7a-9a68-ad6d9aece54a tempest-CinderUnicodeTest-1400853430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7f0f39e2-0af5-4773-b093-a6ce9863b2f2.67519525-951f-4810-bc78-511cb9a67038" returned: 0 in 0.694s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:48 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1109b5de-af26-4d7a-9a68-ad6d9aece54a tempest-CinderUnicodeTest-1400853430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7f0f39e2-0af5-4773-b093-a6ce9863b2f2.67519525-951f-4810-bc78-511cb9a67038 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:48 devstack sudo[105710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7f0f39e2-0af5-4773-b093-a6ce9863b2f2.67519525-951f-4810-bc78-511cb9a67038 Jun 17 05:52:48 devstack sudo[105710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:48 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-dd5d5ab6-a6a7-4e86-8db5-f2bcb7fe66e1 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] Acquiring lock "cinder-81a49095-1e66-4625-960d-19d4cf670bf3-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:52:48 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-dd5d5ab6-a6a7-4e86-8db5-f2bcb7fe66e1 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] Lock "cinder-81a49095-1e66-4625-960d-19d4cf670bf3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:52:48 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-dd5d5ab6-a6a7-4e86-8db5-f2bcb7fe66e1 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] Acquiring lock "cinder-quobyte-81a49095-1e66-4625-960d-19d4cf670bf3" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:52:48 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-dd5d5ab6-a6a7-4e86-8db5-f2bcb7fe66e1 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] Lock "cinder-quobyte-81a49095-1e66-4625-960d-19d4cf670bf3" acquired by "delete_volume" :: waited 0.018s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:52:48 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0746142-ddf4-4cd4-8a7c-415482e5a645]: (4, 'raw') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:52:48 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-dd5d5ab6-a6a7-4e86-8db5-f2bcb7fe66e1 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-81a49095-1e66-4625-960d-19d4cf670bf3 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:48 devstack sudo[105712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-81a49095-1e66-4625-960d-19d4cf670bf3 Jun 17 05:52:48 devstack sudo[105712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:49 devstack sudo[105710]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:49 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1109b5de-af26-4d7a-9a68-ad6d9aece54a tempest-CinderUnicodeTest-1400853430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7f0f39e2-0af5-4773-b093-a6ce9863b2f2.67519525-951f-4810-bc78-511cb9a67038" returned: 0 in 0.665s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:49 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-1109b5de-af26-4d7a-9a68-ad6d9aece54a tempest-CinderUnicodeTest-1400853430 None] Lock "cinder-quobyte-67519525-951f-4810-bc78-511cb9a67038" released by "_delete_snapshot" :: held 3.017s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:52:49 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-1109b5de-af26-4d7a-9a68-ad6d9aece54a tempest-CinderUnicodeTest-1400853430 None] Lock "cinder-quobyte-7f0f39e2-0af5-4773-b093-a6ce9863b2f2" released by "delete_snapshot" :: held 3.042s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:52:49 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-1109b5de-af26-4d7a-9a68-ad6d9aece54a tempest-CinderUnicodeTest-1400853430 None] Created reservations ['a043e4ce-4e1e-4da4-bcab-94b67071e299', '3ed0aeba-c232-46ba-9079-65c4434899b9', '0e5070a4-422d-43d6-a800-7c2cd249a7de', '91d2e3da-fa26-4ac3-af9d-bac6279e6314'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:52:49 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-1109b5de-af26-4d7a-9a68-ad6d9aece54a tempest-CinderUnicodeTest-1400853430 None] Delete snapshot completed successfully. Jun 17 05:52:49 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-1109b5de-af26-4d7a-9a68-ad6d9aece54a tempest-CinderUnicodeTest-1400853430 None] Lock "cinder-67519525-951f-4810-bc78-511cb9a67038-delete_snapshot" released by "delete_snapshot" :: held 3.187s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:52:49 devstack sudo[105712]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:49 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-dd5d5ab6-a6a7-4e86-8db5-f2bcb7fe66e1 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-81a49095-1e66-4625-960d-19d4cf670bf3" returned: 0 in 0.761s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:49 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-dd5d5ab6-a6a7-4e86-8db5-f2bcb7fe66e1 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-81a49095-1e66-4625-960d-19d4cf670bf3 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:49 devstack sudo[105718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-81a49095-1e66-4625-960d-19d4cf670bf3 Jun 17 05:52:49 devstack sudo[105718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:50 devstack sudo[105718]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:50 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-dd5d5ab6-a6a7-4e86-8db5-f2bcb7fe66e1 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-81a49095-1e66-4625-960d-19d4cf670bf3" returned: 1 in 0.703s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:50 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-dd5d5ab6-a6a7-4e86-8db5-f2bcb7fe66e1 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-81a49095-1e66-4625-960d-19d4cf670bf3' failed. Not Retrying. {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 05:52:50 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-dd5d5ab6-a6a7-4e86-8db5-f2bcb7fe66e1 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-81a49095-1e66-4625-960d-19d4cf670bf3 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:50 devstack sudo[105723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-81a49095-1e66-4625-960d-19d4cf670bf3 Jun 17 05:52:50 devstack sudo[105723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:50 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-af846014-ffd6-45e7-a6aa-ce7f2e8aa63c tempest-CinderUnicodeTest-1400853430 None] Acquiring lock "cinder-7f0f39e2-0af5-4773-b093-a6ce9863b2f2-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:52:50 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-af846014-ffd6-45e7-a6aa-ce7f2e8aa63c tempest-CinderUnicodeTest-1400853430 None] Lock "cinder-7f0f39e2-0af5-4773-b093-a6ce9863b2f2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:52:50 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-af846014-ffd6-45e7-a6aa-ce7f2e8aa63c tempest-CinderUnicodeTest-1400853430 None] Acquiring lock "cinder-quobyte-7f0f39e2-0af5-4773-b093-a6ce9863b2f2" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:52:50 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-af846014-ffd6-45e7-a6aa-ce7f2e8aa63c tempest-CinderUnicodeTest-1400853430 None] Lock "cinder-quobyte-7f0f39e2-0af5-4773-b093-a6ce9863b2f2" acquired by "delete_volume" :: waited 0.019s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:52:50 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb51e39-6d4f-4066-a023-cee117344892]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:52:50 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-af846014-ffd6-45e7-a6aa-ce7f2e8aa63c tempest-CinderUnicodeTest-1400853430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7f0f39e2-0af5-4773-b093-a6ce9863b2f2 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:50 devstack sudo[105725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7f0f39e2-0af5-4773-b093-a6ce9863b2f2 Jun 17 05:52:50 devstack sudo[105725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:50 devstack sudo[105723]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:50 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-dd5d5ab6-a6a7-4e86-8db5-f2bcb7fe66e1 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-81a49095-1e66-4625-960d-19d4cf670bf3" returned: 0 in 0.726s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:50 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-dd5d5ab6-a6a7-4e86-8db5-f2bcb7fe66e1 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] Lock "cinder-quobyte-81a49095-1e66-4625-960d-19d4cf670bf3" released by "delete_volume" :: held 2.263s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:52:50 devstack cinder-volume[92083]: WARNING cinder.quota [None req-dd5d5ab6-a6a7-4e86-8db5-f2bcb7fe66e1 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 17 05:52:50 devstack cinder-volume[92083]: WARNING cinder.quota [None req-dd5d5ab6-a6a7-4e86-8db5-f2bcb7fe66e1 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 17 05:52:50 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-dd5d5ab6-a6a7-4e86-8db5-f2bcb7fe66e1 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] Created reservations ['cc83c061-aa24-42a3-928e-a09efe65e4b9', '3e4d076a-ef06-47b8-bb98-94139f58074a', '9bc28bd6-b929-411e-9ff7-82c4faef885f', 'de223d4e-af5c-4bcc-a073-36a104459387'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:52:50 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-dd5d5ab6-a6a7-4e86-8db5-f2bcb7fe66e1 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:52:50 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-dd5d5ab6-a6a7-4e86-8db5-f2bcb7fe66e1 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:52:50 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-dd5d5ab6-a6a7-4e86-8db5-f2bcb7fe66e1 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:52:50 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-dd5d5ab6-a6a7-4e86-8db5-f2bcb7fe66e1 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:52:50 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-dd5d5ab6-a6a7-4e86-8db5-f2bcb7fe66e1 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:52:50 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-dd5d5ab6-a6a7-4e86-8db5-f2bcb7fe66e1 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:50 devstack sudo[105728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:52:50 devstack sudo[105728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:51 devstack sudo[105725]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:51 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-af846014-ffd6-45e7-a6aa-ce7f2e8aa63c tempest-CinderUnicodeTest-1400853430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7f0f39e2-0af5-4773-b093-a6ce9863b2f2" returned: 0 in 0.858s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:51 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-af846014-ffd6-45e7-a6aa-ce7f2e8aa63c tempest-CinderUnicodeTest-1400853430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7f0f39e2-0af5-4773-b093-a6ce9863b2f2 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:51 devstack sudo[105733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7f0f39e2-0af5-4773-b093-a6ce9863b2f2 Jun 17 05:52:51 devstack sudo[105733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:51 devstack sudo[105728]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:51 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-dd5d5ab6-a6a7-4e86-8db5-f2bcb7fe66e1 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.758s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:51 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-dd5d5ab6-a6a7-4e86-8db5-f2bcb7fe66e1 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:52:51 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-dd5d5ab6-a6a7-4e86-8db5-f2bcb7fe66e1 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] Deleted volume successfully. Jun 17 05:52:51 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-dd5d5ab6-a6a7-4e86-8db5-f2bcb7fe66e1 tempest-VolumeAndVolumeTypeFromImageTest-2093369398 None] Lock "cinder-81a49095-1e66-4625-960d-19d4cf670bf3-delete_volume" released by "delete_volume" :: held 3.301s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:52:51 devstack sudo[105733]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:51 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-af846014-ffd6-45e7-a6aa-ce7f2e8aa63c tempest-CinderUnicodeTest-1400853430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7f0f39e2-0af5-4773-b093-a6ce9863b2f2" returned: 0 in 0.727s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:52 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-af846014-ffd6-45e7-a6aa-ce7f2e8aa63c tempest-CinderUnicodeTest-1400853430 None] Lock "cinder-quobyte-7f0f39e2-0af5-4773-b093-a6ce9863b2f2" released by "delete_volume" :: held 1.661s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:52:52 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-af846014-ffd6-45e7-a6aa-ce7f2e8aa63c tempest-CinderUnicodeTest-1400853430 None] Created reservations ['d40ce6a6-3889-4e23-9b0c-cbd17a45cffd', '2a6675a7-dc77-4df7-8b71-fed7844b8fd9', '822b81f2-d95c-4e82-acd5-4cf21a057a6f', '38f6bf23-5fbd-4d5f-ade7-d23fbacf0d78'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:52:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-af846014-ffd6-45e7-a6aa-ce7f2e8aa63c tempest-CinderUnicodeTest-1400853430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:52:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-af846014-ffd6-45e7-a6aa-ce7f2e8aa63c tempest-CinderUnicodeTest-1400853430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:52:52 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-af846014-ffd6-45e7-a6aa-ce7f2e8aa63c tempest-CinderUnicodeTest-1400853430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:52:52 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-af846014-ffd6-45e7-a6aa-ce7f2e8aa63c tempest-CinderUnicodeTest-1400853430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:52:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-af846014-ffd6-45e7-a6aa-ce7f2e8aa63c tempest-CinderUnicodeTest-1400853430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:52:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-af846014-ffd6-45e7-a6aa-ce7f2e8aa63c tempest-CinderUnicodeTest-1400853430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:52 devstack sudo[105737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:52:52 devstack sudo[105737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:52 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-e12a0091-4556-48ec-8b47-b43237269edf tempest-CinderUnicodeTest-1400853430 None] Acquiring lock "cinder-6f0cd366-d6c1-4470-8ab7-597a1b75b849-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:52:52 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-e12a0091-4556-48ec-8b47-b43237269edf tempest-CinderUnicodeTest-1400853430 None] Lock "cinder-6f0cd366-d6c1-4470-8ab7-597a1b75b849-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:52:52 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-e12a0091-4556-48ec-8b47-b43237269edf tempest-CinderUnicodeTest-1400853430 None] Acquiring lock "cinder-quobyte-6f0cd366-d6c1-4470-8ab7-597a1b75b849" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:52:52 devstack sudo[105737]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-af846014-ffd6-45e7-a6aa-ce7f2e8aa63c tempest-CinderUnicodeTest-1400853430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.765s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:52 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-af846014-ffd6-45e7-a6aa-ce7f2e8aa63c tempest-CinderUnicodeTest-1400853430 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:52:52 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-e12a0091-4556-48ec-8b47-b43237269edf tempest-CinderUnicodeTest-1400853430 None] Lock "cinder-quobyte-6f0cd366-d6c1-4470-8ab7-597a1b75b849" acquired by "delete_volume" :: waited 0.038s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:52:52 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-af846014-ffd6-45e7-a6aa-ce7f2e8aa63c tempest-CinderUnicodeTest-1400853430 None] Deleted volume successfully. Jun 17 05:52:52 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[894287ac-bfad-4dfa-880b-44b19dc25d15]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:52:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e12a0091-4556-48ec-8b47-b43237269edf tempest-CinderUnicodeTest-1400853430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6f0cd366-d6c1-4470-8ab7-597a1b75b849 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:52 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-af846014-ffd6-45e7-a6aa-ce7f2e8aa63c tempest-CinderUnicodeTest-1400853430 None] Lock "cinder-7f0f39e2-0af5-4773-b093-a6ce9863b2f2-delete_volume" released by "delete_volume" :: held 2.699s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:52:53 devstack sudo[105755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6f0cd366-d6c1-4470-8ab7-597a1b75b849 Jun 17 05:52:53 devstack sudo[105755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:53 devstack sudo[105755]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:53 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e12a0091-4556-48ec-8b47-b43237269edf tempest-CinderUnicodeTest-1400853430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6f0cd366-d6c1-4470-8ab7-597a1b75b849" returned: 0 in 0.798s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:53 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e12a0091-4556-48ec-8b47-b43237269edf tempest-CinderUnicodeTest-1400853430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6f0cd366-d6c1-4470-8ab7-597a1b75b849 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:53 devstack sudo[105764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6f0cd366-d6c1-4470-8ab7-597a1b75b849 Jun 17 05:52:53 devstack sudo[105764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:54 devstack sudo[105764]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e12a0091-4556-48ec-8b47-b43237269edf tempest-CinderUnicodeTest-1400853430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6f0cd366-d6c1-4470-8ab7-597a1b75b849" returned: 0 in 0.875s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:54 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-e12a0091-4556-48ec-8b47-b43237269edf tempest-CinderUnicodeTest-1400853430 None] Lock "cinder-quobyte-6f0cd366-d6c1-4470-8ab7-597a1b75b849" released by "delete_volume" :: held 1.735s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:52:54 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-e12a0091-4556-48ec-8b47-b43237269edf tempest-CinderUnicodeTest-1400853430 None] Created reservations ['543c7309-2ea3-4103-b1aa-25e34f9fb45d', 'c3d99c02-02bb-471f-836a-8b7663629e3d', 'e2ec11d5-da72-4cfd-bcb8-5bb39a6475fd', 'd25a1dda-b0c6-4bf5-ac43-1c093c9fda3e'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:52:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e12a0091-4556-48ec-8b47-b43237269edf tempest-CinderUnicodeTest-1400853430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:52:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e12a0091-4556-48ec-8b47-b43237269edf tempest-CinderUnicodeTest-1400853430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:52:54 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-e12a0091-4556-48ec-8b47-b43237269edf tempest-CinderUnicodeTest-1400853430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:52:54 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-e12a0091-4556-48ec-8b47-b43237269edf tempest-CinderUnicodeTest-1400853430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:52:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e12a0091-4556-48ec-8b47-b43237269edf tempest-CinderUnicodeTest-1400853430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:52:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e12a0091-4556-48ec-8b47-b43237269edf tempest-CinderUnicodeTest-1400853430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:54 devstack sudo[105768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:52:54 devstack sudo[105768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:55 devstack sudo[105768]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e12a0091-4556-48ec-8b47-b43237269edf tempest-CinderUnicodeTest-1400853430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.718s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:55 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-e12a0091-4556-48ec-8b47-b43237269edf tempest-CinderUnicodeTest-1400853430 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:52:55 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-e12a0091-4556-48ec-8b47-b43237269edf tempest-CinderUnicodeTest-1400853430 None] Deleted volume successfully. Jun 17 05:52:55 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-e12a0091-4556-48ec-8b47-b43237269edf tempest-CinderUnicodeTest-1400853430 None] Lock "cinder-6f0cd366-d6c1-4470-8ab7-597a1b75b849-delete_volume" released by "delete_volume" :: held 2.795s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:52:57 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-a19dae48-6c33-4b8c-8e79-2a56d324d087 tempest-CreateVolumesFromImageTest-915358460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:52:57 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a19dae48-6c33-4b8c-8e79-2a56d324d087 tempest-CreateVolumesFromImageTest-915358460 None] Flow 'volume_create_manager' (446db45f-aee2-49af-8591-8a90a9c53b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:52:57 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a19dae48-6c33-4b8c-8e79-2a56d324d087 tempest-CreateVolumesFromImageTest-915358460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd1ba8a9-f46b-4589-8ec6-26da874fb013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:57 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a19dae48-6c33-4b8c-8e79-2a56d324d087 tempest-CreateVolumesFromImageTest-915358460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd1ba8a9-f46b-4589-8ec6-26da874fb013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:52:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-78741780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae3e907d-5e58-4c4c-9e66-6468bdce07c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5552c9afac924d8d8504bfa68b2dfd19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:52:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:52:57Z,use_quota=True,user_id='5fed9dad2b00422eb5abf368238a76e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:57 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a19dae48-6c33-4b8c-8e79-2a56d324d087 tempest-CreateVolumesFromImageTest-915358460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5965d316-d923-42ad-a311-357dcfb93daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:57 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a19dae48-6c33-4b8c-8e79-2a56d324d087 tempest-CreateVolumesFromImageTest-915358460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5965d316-d923-42ad-a311-357dcfb93daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:57 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a19dae48-6c33-4b8c-8e79-2a56d324d087 tempest-CreateVolumesFromImageTest-915358460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e55df2bc-dc73-472a-a68e-6b4da9d1a344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:57 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a19dae48-6c33-4b8c-8e79-2a56d324d087 tempest-CreateVolumesFromImageTest-915358460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e55df2bc-dc73-472a-a68e-6b4da9d1a344) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae3e907d-5e58-4c4c-9e66-6468bdce07c2', 'volume_name': 'volume-ae3e907d-5e58-4c4c-9e66-6468bdce07c2', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:57 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a19dae48-6c33-4b8c-8e79-2a56d324d087 tempest-CreateVolumesFromImageTest-915358460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c068da48-8176-44d1-b3ba-e4cf915767bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:57 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a19dae48-6c33-4b8c-8e79-2a56d324d087 tempest-CreateVolumesFromImageTest-915358460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c068da48-8176-44d1-b3ba-e4cf915767bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:57 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a19dae48-6c33-4b8c-8e79-2a56d324d087 tempest-CreateVolumesFromImageTest-915358460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16eb4ed9-ba43-413b-aeeb-1c1ca2f5a71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:57 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-a19dae48-6c33-4b8c-8e79-2a56d324d087 tempest-CreateVolumesFromImageTest-915358460 None] Volume ae3e907d-5e58-4c4c-9e66-6468bdce07c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae3e907d-5e58-4c4c-9e66-6468bdce07c2', 'volume_size': 1} Jun 17 05:52:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-a19dae48-6c33-4b8c-8e79-2a56d324d087 tempest-CreateVolumesFromImageTest-915358460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:52:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-a19dae48-6c33-4b8c-8e79-2a56d324d087 tempest-CreateVolumesFromImageTest-915358460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:52:57 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-a19dae48-6c33-4b8c-8e79-2a56d324d087 tempest-CreateVolumesFromImageTest-915358460 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:52:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-78741780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae3e907d-5e58-4c4c-9e66-6468bdce07c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5552c9afac924d8d8504bfa68b2dfd19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:52:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:52:57Z,use_quota=True,user_id='5fed9dad2b00422eb5abf368238a76e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:52:57 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-a19dae48-6c33-4b8c-8e79-2a56d324d087 tempest-CreateVolumesFromImageTest-915358460 None] Creating volume ae3e907d-5e58-4c4c-9e66-6468bdce07c2 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:52:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-a19dae48-6c33-4b8c-8e79-2a56d324d087 tempest-CreateVolumesFromImageTest-915358460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:52:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-a19dae48-6c33-4b8c-8e79-2a56d324d087 tempest-CreateVolumesFromImageTest-915358460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:52:57 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-a19dae48-6c33-4b8c-8e79-2a56d324d087 tempest-CreateVolumesFromImageTest-915358460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:52:57 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-a19dae48-6c33-4b8c-8e79-2a56d324d087 tempest-CreateVolumesFromImageTest-915358460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:52:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-a19dae48-6c33-4b8c-8e79-2a56d324d087 tempest-CreateVolumesFromImageTest-915358460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:52:57 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-a19dae48-6c33-4b8c-8e79-2a56d324d087 tempest-CreateVolumesFromImageTest-915358460 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:52:57 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-a19dae48-6c33-4b8c-8e79-2a56d324d087 tempest-CreateVolumesFromImageTest-915358460 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:52:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a19dae48-6c33-4b8c-8e79-2a56d324d087 tempest-CreateVolumesFromImageTest-915358460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ae3e907d-5e58-4c4c-9e66-6468bdce07c2 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:57 devstack sudo[105774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ae3e907d-5e58-4c4c-9e66-6468bdce07c2 1073741824 Jun 17 05:52:57 devstack sudo[105774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:57 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-e168acee-e99b-46f0-aef2-39f47ae2b9fb tempest-CreateVolumesFromImageTest-915358460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:52:57 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e168acee-e99b-46f0-aef2-39f47ae2b9fb tempest-CreateVolumesFromImageTest-915358460 None] Flow 'volume_create_manager' (e0337691-bb2a-43e6-860d-0d41b01a4047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:52:57 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e168acee-e99b-46f0-aef2-39f47ae2b9fb tempest-CreateVolumesFromImageTest-915358460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d0d6ff7-0213-4048-85c4-eb758e3a7da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:57 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e168acee-e99b-46f0-aef2-39f47ae2b9fb tempest-CreateVolumesFromImageTest-915358460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d0d6ff7-0213-4048-85c4-eb758e3a7da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:52:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-748406679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bba22df-52fd-41d6-8ab5-318a0ba972bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5552c9afac924d8d8504bfa68b2dfd19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:52:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:52:57Z,use_quota=True,user_id='5fed9dad2b00422eb5abf368238a76e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:57 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e168acee-e99b-46f0-aef2-39f47ae2b9fb tempest-CreateVolumesFromImageTest-915358460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50477666-b5d8-48a4-a655-ed43ee0046f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:57 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e168acee-e99b-46f0-aef2-39f47ae2b9fb tempest-CreateVolumesFromImageTest-915358460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50477666-b5d8-48a4-a655-ed43ee0046f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:57 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e168acee-e99b-46f0-aef2-39f47ae2b9fb tempest-CreateVolumesFromImageTest-915358460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e27b600-48b0-414c-aa98-4951df345512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:57 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e168acee-e99b-46f0-aef2-39f47ae2b9fb tempest-CreateVolumesFromImageTest-915358460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e27b600-48b0-414c-aa98-4951df345512) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bba22df-52fd-41d6-8ab5-318a0ba972bb', 'volume_name': 'volume-0bba22df-52fd-41d6-8ab5-318a0ba972bb', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:57 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e168acee-e99b-46f0-aef2-39f47ae2b9fb tempest-CreateVolumesFromImageTest-915358460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c2d8c70-dc9e-42f9-b7e0-3df946b95d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:57 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e168acee-e99b-46f0-aef2-39f47ae2b9fb tempest-CreateVolumesFromImageTest-915358460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c2d8c70-dc9e-42f9-b7e0-3df946b95d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:57 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e168acee-e99b-46f0-aef2-39f47ae2b9fb tempest-CreateVolumesFromImageTest-915358460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aa3813a-dfa3-4711-a826-39872008ff4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:57 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-e168acee-e99b-46f0-aef2-39f47ae2b9fb tempest-CreateVolumesFromImageTest-915358460 None] Volume 0bba22df-52fd-41d6-8ab5-318a0ba972bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bba22df-52fd-41d6-8ab5-318a0ba972bb', 'volume_size': 1} Jun 17 05:52:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e168acee-e99b-46f0-aef2-39f47ae2b9fb tempest-CreateVolumesFromImageTest-915358460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:52:57 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-57d50740-ed8f-4d51-ae62-e71cbc46cfe9 tempest-CreateVolumesFromImageTest-915358460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:52:57 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-57d50740-ed8f-4d51-ae62-e71cbc46cfe9 tempest-CreateVolumesFromImageTest-915358460 None] Flow 'volume_create_manager' (2bdc6e03-eb63-4a7c-b3a9-55f344022eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:52:57 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-57d50740-ed8f-4d51-ae62-e71cbc46cfe9 tempest-CreateVolumesFromImageTest-915358460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d837ee7c-de10-426c-90dd-9d39af4de4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:57 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-57d50740-ed8f-4d51-ae62-e71cbc46cfe9 tempest-CreateVolumesFromImageTest-915358460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d837ee7c-de10-426c-90dd-9d39af4de4c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:52:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-358012348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d479a8d0-fef1-46ea-a262-797768e6ac8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5552c9afac924d8d8504bfa68b2dfd19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:52:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:52:58Z,use_quota=True,user_id='5fed9dad2b00422eb5abf368238a76e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:57 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-57d50740-ed8f-4d51-ae62-e71cbc46cfe9 tempest-CreateVolumesFromImageTest-915358460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25c193a7-2f66-4c55-ad5f-c9c587289df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:57 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-57d50740-ed8f-4d51-ae62-e71cbc46cfe9 tempest-CreateVolumesFromImageTest-915358460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25c193a7-2f66-4c55-ad5f-c9c587289df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:57 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-57d50740-ed8f-4d51-ae62-e71cbc46cfe9 tempest-CreateVolumesFromImageTest-915358460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0a4a34d-8807-4e74-b584-26a354a24622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:57 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-57d50740-ed8f-4d51-ae62-e71cbc46cfe9 tempest-CreateVolumesFromImageTest-915358460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0a4a34d-8807-4e74-b584-26a354a24622) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd479a8d0-fef1-46ea-a262-797768e6ac8b', 'volume_name': 'volume-d479a8d0-fef1-46ea-a262-797768e6ac8b', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:57 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-57d50740-ed8f-4d51-ae62-e71cbc46cfe9 tempest-CreateVolumesFromImageTest-915358460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3eb7edf-6aa4-495f-81bc-d035c1f51691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:57 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-57d50740-ed8f-4d51-ae62-e71cbc46cfe9 tempest-CreateVolumesFromImageTest-915358460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3eb7edf-6aa4-495f-81bc-d035c1f51691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:57 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-57d50740-ed8f-4d51-ae62-e71cbc46cfe9 tempest-CreateVolumesFromImageTest-915358460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0f86464-5a1c-482b-8626-ae6ccdb7cdb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:57 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-57d50740-ed8f-4d51-ae62-e71cbc46cfe9 tempest-CreateVolumesFromImageTest-915358460 None] Volume d479a8d0-fef1-46ea-a262-797768e6ac8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d479a8d0-fef1-46ea-a262-797768e6ac8b', 'volume_size': 1} Jun 17 05:52:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-57d50740-ed8f-4d51-ae62-e71cbc46cfe9 tempest-CreateVolumesFromImageTest-915358460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:52:58 devstack cinder-volume[92083]: DEBUG dbcounter [-] [92083] Writing DB stats cinder:UPDATE=143,cinder:SELECT=104,cinder:INSERT=32,cinder:DELETE=11 {{(pid=92083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:52:58 devstack cinder-volume[92083]: DEBUG dbcounter [-] [92083] Writing DB stats cinder:SELECT=102,cinder:INSERT=45,cinder:UPDATE=137,cinder:DELETE=12 {{(pid=92083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:52:58 devstack sudo[105774]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:58 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a19dae48-6c33-4b8c-8e79-2a56d324d087 tempest-CreateVolumesFromImageTest-915358460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ae3e907d-5e58-4c4c-9e66-6468bdce07c2 1073741824" returned: 0 in 0.928s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:58 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-35ec4d15-e0bb-43dc-bfc9-aa9400c5242b tempest-CreateVolumesFromImageTest-915358460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:52:58 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-35ec4d15-e0bb-43dc-bfc9-aa9400c5242b tempest-CreateVolumesFromImageTest-915358460 None] Flow 'volume_create_manager' (2d6be905-c549-4ba4-8ca6-afbe59554668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:52:58 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-35ec4d15-e0bb-43dc-bfc9-aa9400c5242b tempest-CreateVolumesFromImageTest-915358460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (883ca1ea-fe0c-47c1-9303-545198b5b3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:58 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-35ec4d15-e0bb-43dc-bfc9-aa9400c5242b tempest-CreateVolumesFromImageTest-915358460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (883ca1ea-fe0c-47c1-9303-545198b5b3fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:52:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-332937966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=861c9695-3408-4268-b14c-0f29ff56f33f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5552c9afac924d8d8504bfa68b2dfd19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:52:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:52:58Z,use_quota=True,user_id='5fed9dad2b00422eb5abf368238a76e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:58 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-35ec4d15-e0bb-43dc-bfc9-aa9400c5242b tempest-CreateVolumesFromImageTest-915358460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49147997-cc8f-4712-9e70-bf273b8e6747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:58 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-35ec4d15-e0bb-43dc-bfc9-aa9400c5242b tempest-CreateVolumesFromImageTest-915358460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49147997-cc8f-4712-9e70-bf273b8e6747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:58 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-35ec4d15-e0bb-43dc-bfc9-aa9400c5242b tempest-CreateVolumesFromImageTest-915358460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf824a55-ea9b-43b9-a4ba-a96e6ae57c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:58 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-35ec4d15-e0bb-43dc-bfc9-aa9400c5242b tempest-CreateVolumesFromImageTest-915358460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf824a55-ea9b-43b9-a4ba-a96e6ae57c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '861c9695-3408-4268-b14c-0f29ff56f33f', 'volume_name': 'volume-861c9695-3408-4268-b14c-0f29ff56f33f', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:58 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-35ec4d15-e0bb-43dc-bfc9-aa9400c5242b tempest-CreateVolumesFromImageTest-915358460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8621bfeb-6e61-411c-b7ee-c60de8ff4a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:58 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-35ec4d15-e0bb-43dc-bfc9-aa9400c5242b tempest-CreateVolumesFromImageTest-915358460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8621bfeb-6e61-411c-b7ee-c60de8ff4a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:58 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-35ec4d15-e0bb-43dc-bfc9-aa9400c5242b tempest-CreateVolumesFromImageTest-915358460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e4073f6-bb25-49da-9a9a-0400f7b75f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:58 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-35ec4d15-e0bb-43dc-bfc9-aa9400c5242b tempest-CreateVolumesFromImageTest-915358460 None] Volume 861c9695-3408-4268-b14c-0f29ff56f33f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-861c9695-3408-4268-b14c-0f29ff56f33f', 'volume_size': 1} Jun 17 05:52:58 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-35ec4d15-e0bb-43dc-bfc9-aa9400c5242b tempest-CreateVolumesFromImageTest-915358460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:52:58 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a19dae48-6c33-4b8c-8e79-2a56d324d087 tempest-CreateVolumesFromImageTest-915358460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ae3e907d-5e58-4c4c-9e66-6468bdce07c2 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:58 devstack sudo[105780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ae3e907d-5e58-4c4c-9e66-6468bdce07c2 Jun 17 05:52:58 devstack sudo[105780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:58 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-65f82353-2063-47bb-a411-91a6ced1727f tempest-CreateVolumesFromImageTest-915358460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:52:58 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-65f82353-2063-47bb-a411-91a6ced1727f tempest-CreateVolumesFromImageTest-915358460 None] Flow 'volume_create_manager' (3ea67d8b-c17d-4fb8-a8c5-e3a08bc970e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:52:58 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-65f82353-2063-47bb-a411-91a6ced1727f tempest-CreateVolumesFromImageTest-915358460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71cc7d0a-09f4-4413-84bd-59fa857bafbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:58 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-65f82353-2063-47bb-a411-91a6ced1727f tempest-CreateVolumesFromImageTest-915358460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71cc7d0a-09f4-4413-84bd-59fa857bafbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:52:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1878729447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ed105f2-8e1f-4994-826a-f3c21a2ac6e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5552c9afac924d8d8504bfa68b2dfd19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:52:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:52:58Z,use_quota=True,user_id='5fed9dad2b00422eb5abf368238a76e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:58 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-65f82353-2063-47bb-a411-91a6ced1727f tempest-CreateVolumesFromImageTest-915358460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f3e15d9-e3d8-4044-be0f-003d9bfa90c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:58 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-65f82353-2063-47bb-a411-91a6ced1727f tempest-CreateVolumesFromImageTest-915358460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f3e15d9-e3d8-4044-be0f-003d9bfa90c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:58 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-65f82353-2063-47bb-a411-91a6ced1727f tempest-CreateVolumesFromImageTest-915358460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a40949d-d4fa-4eed-9e2f-319d7eb85fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:58 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-65f82353-2063-47bb-a411-91a6ced1727f tempest-CreateVolumesFromImageTest-915358460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a40949d-d4fa-4eed-9e2f-319d7eb85fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ed105f2-8e1f-4994-826a-f3c21a2ac6e7', 'volume_name': 'volume-9ed105f2-8e1f-4994-826a-f3c21a2ac6e7', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:58 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-65f82353-2063-47bb-a411-91a6ced1727f tempest-CreateVolumesFromImageTest-915358460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c11a5600-3090-413a-a64e-850c6ce212f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:58 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-65f82353-2063-47bb-a411-91a6ced1727f tempest-CreateVolumesFromImageTest-915358460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c11a5600-3090-413a-a64e-850c6ce212f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:58 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-65f82353-2063-47bb-a411-91a6ced1727f tempest-CreateVolumesFromImageTest-915358460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00606f96-3749-4544-9240-f21e64a69e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:58 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-65f82353-2063-47bb-a411-91a6ced1727f tempest-CreateVolumesFromImageTest-915358460 None] Volume 9ed105f2-8e1f-4994-826a-f3c21a2ac6e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ed105f2-8e1f-4994-826a-f3c21a2ac6e7', 'volume_size': 1} Jun 17 05:52:58 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-65f82353-2063-47bb-a411-91a6ced1727f tempest-CreateVolumesFromImageTest-915358460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:52:59 devstack sudo[105780]: pam_unix(sudo:session): session closed for user root Jun 17 05:52:59 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a19dae48-6c33-4b8c-8e79-2a56d324d087 tempest-CreateVolumesFromImageTest-915358460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ae3e907d-5e58-4c4c-9e66-6468bdce07c2" returned: 0 in 1.136s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:52:59 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-a19dae48-6c33-4b8c-8e79-2a56d324d087 tempest-CreateVolumesFromImageTest-915358460 None] <== create_volume: return (2188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:52:59 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-a19dae48-6c33-4b8c-8e79-2a56d324d087 tempest-CreateVolumesFromImageTest-915358460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.190s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:52:59 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e168acee-e99b-46f0-aef2-39f47ae2b9fb tempest-CreateVolumesFromImageTest-915358460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.879s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:52:59 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-e168acee-e99b-46f0-aef2-39f47ae2b9fb tempest-CreateVolumesFromImageTest-915358460 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:52:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-748406679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bba22df-52fd-41d6-8ab5-318a0ba972bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5552c9afac924d8d8504bfa68b2dfd19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:52:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:52:57Z,use_quota=True,user_id='5fed9dad2b00422eb5abf368238a76e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:52:59 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-e168acee-e99b-46f0-aef2-39f47ae2b9fb tempest-CreateVolumesFromImageTest-915358460 None] Creating volume 0bba22df-52fd-41d6-8ab5-318a0ba972bb {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:52:59 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e168acee-e99b-46f0-aef2-39f47ae2b9fb tempest-CreateVolumesFromImageTest-915358460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:52:59 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e168acee-e99b-46f0-aef2-39f47ae2b9fb tempest-CreateVolumesFromImageTest-915358460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:52:59 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-e168acee-e99b-46f0-aef2-39f47ae2b9fb tempest-CreateVolumesFromImageTest-915358460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:52:59 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-e168acee-e99b-46f0-aef2-39f47ae2b9fb tempest-CreateVolumesFromImageTest-915358460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:52:59 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e168acee-e99b-46f0-aef2-39f47ae2b9fb tempest-CreateVolumesFromImageTest-915358460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:52:59 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-e168acee-e99b-46f0-aef2-39f47ae2b9fb tempest-CreateVolumesFromImageTest-915358460 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:52:59 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-e168acee-e99b-46f0-aef2-39f47ae2b9fb tempest-CreateVolumesFromImageTest-915358460 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:52:59 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e168acee-e99b-46f0-aef2-39f47ae2b9fb tempest-CreateVolumesFromImageTest-915358460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0bba22df-52fd-41d6-8ab5-318a0ba972bb 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:52:59 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a19dae48-6c33-4b8c-8e79-2a56d324d087 tempest-CreateVolumesFromImageTest-915358460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16eb4ed9-ba43-413b-aeeb-1c1ca2f5a71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae3e907d-5e58-4c4c-9e66-6468bdce07c2', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:59 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a19dae48-6c33-4b8c-8e79-2a56d324d087 tempest-CreateVolumesFromImageTest-915358460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fead42a3-2f3a-4ad4-b4fd-f379eeed8461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:52:59 devstack sudo[105844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0bba22df-52fd-41d6-8ab5-318a0ba972bb 1073741824 Jun 17 05:52:59 devstack sudo[105844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:52:59 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-a19dae48-6c33-4b8c-8e79-2a56d324d087 tempest-CreateVolumesFromImageTest-915358460 None] Volume volume-ae3e907d-5e58-4c4c-9e66-6468bdce07c2 (ae3e907d-5e58-4c4c-9e66-6468bdce07c2): created successfully Jun 17 05:52:59 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a19dae48-6c33-4b8c-8e79-2a56d324d087 tempest-CreateVolumesFromImageTest-915358460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fead42a3-2f3a-4ad4-b4fd-f379eeed8461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:52:59 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a19dae48-6c33-4b8c-8e79-2a56d324d087 tempest-CreateVolumesFromImageTest-915358460 None] Flow 'volume_create_manager' (446db45f-aee2-49af-8591-8a90a9c53b19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:52:59 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-a19dae48-6c33-4b8c-8e79-2a56d324d087 tempest-CreateVolumesFromImageTest-915358460 None] Created volume successfully. Jun 17 05:53:00 devstack sudo[105844]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:00 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e168acee-e99b-46f0-aef2-39f47ae2b9fb tempest-CreateVolumesFromImageTest-915358460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0bba22df-52fd-41d6-8ab5-318a0ba972bb 1073741824" returned: 0 in 0.914s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:00 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e168acee-e99b-46f0-aef2-39f47ae2b9fb tempest-CreateVolumesFromImageTest-915358460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0bba22df-52fd-41d6-8ab5-318a0ba972bb {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:00 devstack sudo[105852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0bba22df-52fd-41d6-8ab5-318a0ba972bb Jun 17 05:53:00 devstack sudo[105852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:00 devstack sudo[105852]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:00 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e168acee-e99b-46f0-aef2-39f47ae2b9fb tempest-CreateVolumesFromImageTest-915358460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0bba22df-52fd-41d6-8ab5-318a0ba972bb" returned: 0 in 0.653s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:00 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-e168acee-e99b-46f0-aef2-39f47ae2b9fb tempest-CreateVolumesFromImageTest-915358460 None] <== create_volume: return (1638ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:53:00 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e168acee-e99b-46f0-aef2-39f47ae2b9fb tempest-CreateVolumesFromImageTest-915358460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.643s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:53:00 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-57d50740-ed8f-4d51-ae62-e71cbc46cfe9 tempest-CreateVolumesFromImageTest-915358460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.198s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:53:00 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-57d50740-ed8f-4d51-ae62-e71cbc46cfe9 tempest-CreateVolumesFromImageTest-915358460 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:52:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-358012348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d479a8d0-fef1-46ea-a262-797768e6ac8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5552c9afac924d8d8504bfa68b2dfd19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:52:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:52:58Z,use_quota=True,user_id='5fed9dad2b00422eb5abf368238a76e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:53:00 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-57d50740-ed8f-4d51-ae62-e71cbc46cfe9 tempest-CreateVolumesFromImageTest-915358460 None] Creating volume d479a8d0-fef1-46ea-a262-797768e6ac8b {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:53:00 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-57d50740-ed8f-4d51-ae62-e71cbc46cfe9 tempest-CreateVolumesFromImageTest-915358460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:53:00 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-57d50740-ed8f-4d51-ae62-e71cbc46cfe9 tempest-CreateVolumesFromImageTest-915358460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:53:01 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-57d50740-ed8f-4d51-ae62-e71cbc46cfe9 tempest-CreateVolumesFromImageTest-915358460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:53:01 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-57d50740-ed8f-4d51-ae62-e71cbc46cfe9 tempest-CreateVolumesFromImageTest-915358460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:53:01 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-57d50740-ed8f-4d51-ae62-e71cbc46cfe9 tempest-CreateVolumesFromImageTest-915358460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:53:01 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-57d50740-ed8f-4d51-ae62-e71cbc46cfe9 tempest-CreateVolumesFromImageTest-915358460 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:53:01 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-57d50740-ed8f-4d51-ae62-e71cbc46cfe9 tempest-CreateVolumesFromImageTest-915358460 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:53:01 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-57d50740-ed8f-4d51-ae62-e71cbc46cfe9 tempest-CreateVolumesFromImageTest-915358460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d479a8d0-fef1-46ea-a262-797768e6ac8b 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:01 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e168acee-e99b-46f0-aef2-39f47ae2b9fb tempest-CreateVolumesFromImageTest-915358460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aa3813a-dfa3-4711-a826-39872008ff4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bba22df-52fd-41d6-8ab5-318a0ba972bb', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:53:01 devstack sudo[105855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d479a8d0-fef1-46ea-a262-797768e6ac8b 1073741824 Jun 17 05:53:01 devstack sudo[105855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:01 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e168acee-e99b-46f0-aef2-39f47ae2b9fb tempest-CreateVolumesFromImageTest-915358460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28fcba34-83b8-422d-ba7b-fb47f3f4d915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:53:01 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-e168acee-e99b-46f0-aef2-39f47ae2b9fb tempest-CreateVolumesFromImageTest-915358460 None] Volume volume-0bba22df-52fd-41d6-8ab5-318a0ba972bb (0bba22df-52fd-41d6-8ab5-318a0ba972bb): created successfully Jun 17 05:53:01 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e168acee-e99b-46f0-aef2-39f47ae2b9fb tempest-CreateVolumesFromImageTest-915358460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28fcba34-83b8-422d-ba7b-fb47f3f4d915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:53:01 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e168acee-e99b-46f0-aef2-39f47ae2b9fb tempest-CreateVolumesFromImageTest-915358460 None] Flow 'volume_create_manager' (e0337691-bb2a-43e6-860d-0d41b01a4047) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:53:01 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-e168acee-e99b-46f0-aef2-39f47ae2b9fb tempest-CreateVolumesFromImageTest-915358460 None] Created volume successfully. Jun 17 05:53:01 devstack sudo[105855]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:01 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-57d50740-ed8f-4d51-ae62-e71cbc46cfe9 tempest-CreateVolumesFromImageTest-915358460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d479a8d0-fef1-46ea-a262-797768e6ac8b 1073741824" returned: 0 in 0.800s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:01 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-57d50740-ed8f-4d51-ae62-e71cbc46cfe9 tempest-CreateVolumesFromImageTest-915358460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d479a8d0-fef1-46ea-a262-797768e6ac8b {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:01 devstack sudo[105861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d479a8d0-fef1-46ea-a262-797768e6ac8b Jun 17 05:53:01 devstack sudo[105861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:02 devstack sudo[105861]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:02 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-57d50740-ed8f-4d51-ae62-e71cbc46cfe9 tempest-CreateVolumesFromImageTest-915358460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d479a8d0-fef1-46ea-a262-797768e6ac8b" returned: 0 in 0.662s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:02 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-57d50740-ed8f-4d51-ae62-e71cbc46cfe9 tempest-CreateVolumesFromImageTest-915358460 None] <== create_volume: return (1515ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:53:02 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-57d50740-ed8f-4d51-ae62-e71cbc46cfe9 tempest-CreateVolumesFromImageTest-915358460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.519s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:53:02 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-35ec4d15-e0bb-43dc-bfc9-aa9400c5242b tempest-CreateVolumesFromImageTest-915358460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.341s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:53:02 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-35ec4d15-e0bb-43dc-bfc9-aa9400c5242b tempest-CreateVolumesFromImageTest-915358460 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:52:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-332937966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=861c9695-3408-4268-b14c-0f29ff56f33f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5552c9afac924d8d8504bfa68b2dfd19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:52:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:52:58Z,use_quota=True,user_id='5fed9dad2b00422eb5abf368238a76e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:53:02 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-35ec4d15-e0bb-43dc-bfc9-aa9400c5242b tempest-CreateVolumesFromImageTest-915358460 None] Creating volume 861c9695-3408-4268-b14c-0f29ff56f33f {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:53:02 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-35ec4d15-e0bb-43dc-bfc9-aa9400c5242b tempest-CreateVolumesFromImageTest-915358460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:53:02 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-35ec4d15-e0bb-43dc-bfc9-aa9400c5242b tempest-CreateVolumesFromImageTest-915358460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:53:02 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-35ec4d15-e0bb-43dc-bfc9-aa9400c5242b tempest-CreateVolumesFromImageTest-915358460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:53:02 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-35ec4d15-e0bb-43dc-bfc9-aa9400c5242b tempest-CreateVolumesFromImageTest-915358460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:53:02 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-35ec4d15-e0bb-43dc-bfc9-aa9400c5242b tempest-CreateVolumesFromImageTest-915358460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:53:02 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-35ec4d15-e0bb-43dc-bfc9-aa9400c5242b tempest-CreateVolumesFromImageTest-915358460 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:53:02 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-35ec4d15-e0bb-43dc-bfc9-aa9400c5242b tempest-CreateVolumesFromImageTest-915358460 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:53:02 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-35ec4d15-e0bb-43dc-bfc9-aa9400c5242b tempest-CreateVolumesFromImageTest-915358460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-861c9695-3408-4268-b14c-0f29ff56f33f 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:02 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-57d50740-ed8f-4d51-ae62-e71cbc46cfe9 tempest-CreateVolumesFromImageTest-915358460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0f86464-5a1c-482b-8626-ae6ccdb7cdb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d479a8d0-fef1-46ea-a262-797768e6ac8b', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:53:02 devstack sudo[105864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-861c9695-3408-4268-b14c-0f29ff56f33f 1073741824 Jun 17 05:53:02 devstack sudo[105864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:02 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-57d50740-ed8f-4d51-ae62-e71cbc46cfe9 tempest-CreateVolumesFromImageTest-915358460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (644dd97a-0ab3-4dbd-878c-c466e4b59564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:53:02 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-57d50740-ed8f-4d51-ae62-e71cbc46cfe9 tempest-CreateVolumesFromImageTest-915358460 None] Volume volume-d479a8d0-fef1-46ea-a262-797768e6ac8b (d479a8d0-fef1-46ea-a262-797768e6ac8b): created successfully Jun 17 05:53:02 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-57d50740-ed8f-4d51-ae62-e71cbc46cfe9 tempest-CreateVolumesFromImageTest-915358460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (644dd97a-0ab3-4dbd-878c-c466e4b59564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:53:02 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-57d50740-ed8f-4d51-ae62-e71cbc46cfe9 tempest-CreateVolumesFromImageTest-915358460 None] Flow 'volume_create_manager' (2bdc6e03-eb63-4a7c-b3a9-55f344022eec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:53:02 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-57d50740-ed8f-4d51-ae62-e71cbc46cfe9 tempest-CreateVolumesFromImageTest-915358460 None] Created volume successfully. Jun 17 05:53:02 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-33c16d09-f53c-44de-a7fc-db75b180677e tempest-VolumesActionsTest-1107896766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:53:02 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-33c16d09-f53c-44de-a7fc-db75b180677e tempest-VolumesActionsTest-1107896766 None] Flow 'volume_create_manager' (878cedbc-7c81-46b1-b804-ea30e540456c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:53:02 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-33c16d09-f53c-44de-a7fc-db75b180677e tempest-VolumesActionsTest-1107896766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f103b1c-9423-4455-be44-3003f8b8ddb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:53:02 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-33c16d09-f53c-44de-a7fc-db75b180677e tempest-VolumesActionsTest-1107896766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f103b1c-9423-4455-be44-3003f8b8ddb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:53:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-242350454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea605e14-c35a-4c9c-ae2e-08805173214a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09654981722e4d16a9c750aa12b9b7b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:53:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:53:03Z,use_quota=True,user_id='5c9f4322025c417da6d2f736ae055e8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:53:02 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-33c16d09-f53c-44de-a7fc-db75b180677e tempest-VolumesActionsTest-1107896766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8768def7-a627-490e-a826-2c01f4f4047e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:53:02 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-33c16d09-f53c-44de-a7fc-db75b180677e tempest-VolumesActionsTest-1107896766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8768def7-a627-490e-a826-2c01f4f4047e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:53:02 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-33c16d09-f53c-44de-a7fc-db75b180677e tempest-VolumesActionsTest-1107896766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aed0f4ad-cac8-42de-88a1-a861dd7a1ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:53:02 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-33c16d09-f53c-44de-a7fc-db75b180677e tempest-VolumesActionsTest-1107896766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aed0f4ad-cac8-42de-88a1-a861dd7a1ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea605e14-c35a-4c9c-ae2e-08805173214a', 'volume_name': 'volume-ea605e14-c35a-4c9c-ae2e-08805173214a', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:53:02 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-33c16d09-f53c-44de-a7fc-db75b180677e tempest-VolumesActionsTest-1107896766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac7c4951-dcef-4dbe-ab5f-3efdfe9ccdf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:53:02 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-33c16d09-f53c-44de-a7fc-db75b180677e tempest-VolumesActionsTest-1107896766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac7c4951-dcef-4dbe-ab5f-3efdfe9ccdf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:53:02 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-33c16d09-f53c-44de-a7fc-db75b180677e tempest-VolumesActionsTest-1107896766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33377c78-6290-400c-96e9-6c7fbdde2f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:53:02 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-33c16d09-f53c-44de-a7fc-db75b180677e tempest-VolumesActionsTest-1107896766 None] Volume ea605e14-c35a-4c9c-ae2e-08805173214a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea605e14-c35a-4c9c-ae2e-08805173214a', 'volume_size': 1} Jun 17 05:53:02 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-33c16d09-f53c-44de-a7fc-db75b180677e tempest-VolumesActionsTest-1107896766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:53:03 devstack sudo[105864]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:03 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-35ec4d15-e0bb-43dc-bfc9-aa9400c5242b tempest-CreateVolumesFromImageTest-915358460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-861c9695-3408-4268-b14c-0f29ff56f33f 1073741824" returned: 0 in 0.804s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:03 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-35ec4d15-e0bb-43dc-bfc9-aa9400c5242b tempest-CreateVolumesFromImageTest-915358460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-861c9695-3408-4268-b14c-0f29ff56f33f {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:03 devstack sudo[105869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-861c9695-3408-4268-b14c-0f29ff56f33f Jun 17 05:53:03 devstack sudo[105869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:03 devstack sudo[105869]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:03 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-35ec4d15-e0bb-43dc-bfc9-aa9400c5242b tempest-CreateVolumesFromImageTest-915358460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-861c9695-3408-4268-b14c-0f29ff56f33f" returned: 0 in 0.610s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:03 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-35ec4d15-e0bb-43dc-bfc9-aa9400c5242b tempest-CreateVolumesFromImageTest-915358460 None] <== create_volume: return (1463ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:53:03 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-35ec4d15-e0bb-43dc-bfc9-aa9400c5242b tempest-CreateVolumesFromImageTest-915358460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.466s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:53:03 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-65f82353-2063-47bb-a411-91a6ced1727f tempest-CreateVolumesFromImageTest-915358460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.404s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:53:03 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-65f82353-2063-47bb-a411-91a6ced1727f tempest-CreateVolumesFromImageTest-915358460 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:52:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1878729447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ed105f2-8e1f-4994-826a-f3c21a2ac6e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5552c9afac924d8d8504bfa68b2dfd19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:52:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:52:58Z,use_quota=True,user_id='5fed9dad2b00422eb5abf368238a76e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:53:03 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-65f82353-2063-47bb-a411-91a6ced1727f tempest-CreateVolumesFromImageTest-915358460 None] Creating volume 9ed105f2-8e1f-4994-826a-f3c21a2ac6e7 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:53:03 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-65f82353-2063-47bb-a411-91a6ced1727f tempest-CreateVolumesFromImageTest-915358460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:53:03 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-65f82353-2063-47bb-a411-91a6ced1727f tempest-CreateVolumesFromImageTest-915358460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:53:03 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-65f82353-2063-47bb-a411-91a6ced1727f tempest-CreateVolumesFromImageTest-915358460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:53:03 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-65f82353-2063-47bb-a411-91a6ced1727f tempest-CreateVolumesFromImageTest-915358460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:53:03 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-65f82353-2063-47bb-a411-91a6ced1727f tempest-CreateVolumesFromImageTest-915358460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:53:03 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-65f82353-2063-47bb-a411-91a6ced1727f tempest-CreateVolumesFromImageTest-915358460 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:53:03 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-65f82353-2063-47bb-a411-91a6ced1727f tempest-CreateVolumesFromImageTest-915358460 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:53:03 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-65f82353-2063-47bb-a411-91a6ced1727f tempest-CreateVolumesFromImageTest-915358460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9ed105f2-8e1f-4994-826a-f3c21a2ac6e7 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:04 devstack sudo[105872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9ed105f2-8e1f-4994-826a-f3c21a2ac6e7 1073741824 Jun 17 05:53:04 devstack sudo[105872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:04 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-35ec4d15-e0bb-43dc-bfc9-aa9400c5242b tempest-CreateVolumesFromImageTest-915358460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e4073f6-bb25-49da-9a9a-0400f7b75f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-861c9695-3408-4268-b14c-0f29ff56f33f', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:53:04 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-35ec4d15-e0bb-43dc-bfc9-aa9400c5242b tempest-CreateVolumesFromImageTest-915358460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e18164a6-dc05-4ca7-9e05-f2376e68f262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:53:04 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-35ec4d15-e0bb-43dc-bfc9-aa9400c5242b tempest-CreateVolumesFromImageTest-915358460 None] Volume volume-861c9695-3408-4268-b14c-0f29ff56f33f (861c9695-3408-4268-b14c-0f29ff56f33f): created successfully Jun 17 05:53:04 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-35ec4d15-e0bb-43dc-bfc9-aa9400c5242b tempest-CreateVolumesFromImageTest-915358460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e18164a6-dc05-4ca7-9e05-f2376e68f262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:53:04 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-35ec4d15-e0bb-43dc-bfc9-aa9400c5242b tempest-CreateVolumesFromImageTest-915358460 None] Flow 'volume_create_manager' (2d6be905-c549-4ba4-8ca6-afbe59554668) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:53:04 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-35ec4d15-e0bb-43dc-bfc9-aa9400c5242b tempest-CreateVolumesFromImageTest-915358460 None] Created volume successfully. Jun 17 05:53:04 devstack sudo[105872]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:04 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-65f82353-2063-47bb-a411-91a6ced1727f tempest-CreateVolumesFromImageTest-915358460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9ed105f2-8e1f-4994-826a-f3c21a2ac6e7 1073741824" returned: 0 in 0.760s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:04 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-65f82353-2063-47bb-a411-91a6ced1727f tempest-CreateVolumesFromImageTest-915358460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9ed105f2-8e1f-4994-826a-f3c21a2ac6e7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:04 devstack sudo[105877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9ed105f2-8e1f-4994-826a-f3c21a2ac6e7 Jun 17 05:53:04 devstack sudo[105877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:05 devstack sudo[105877]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-65f82353-2063-47bb-a411-91a6ced1727f tempest-CreateVolumesFromImageTest-915358460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9ed105f2-8e1f-4994-826a-f3c21a2ac6e7" returned: 0 in 0.581s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:05 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-65f82353-2063-47bb-a411-91a6ced1727f tempest-CreateVolumesFromImageTest-915358460 None] <== create_volume: return (1384ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:53:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-65f82353-2063-47bb-a411-91a6ced1727f tempest-CreateVolumesFromImageTest-915358460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.387s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:53:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-33c16d09-f53c-44de-a7fc-db75b180677e tempest-VolumesActionsTest-1107896766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.619s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:53:05 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-33c16d09-f53c-44de-a7fc-db75b180677e tempest-VolumesActionsTest-1107896766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:53:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-242350454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea605e14-c35a-4c9c-ae2e-08805173214a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09654981722e4d16a9c750aa12b9b7b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:53:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:53:03Z,use_quota=True,user_id='5c9f4322025c417da6d2f736ae055e8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:53:05 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-33c16d09-f53c-44de-a7fc-db75b180677e tempest-VolumesActionsTest-1107896766 None] Creating volume ea605e14-c35a-4c9c-ae2e-08805173214a {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:53:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-33c16d09-f53c-44de-a7fc-db75b180677e tempest-VolumesActionsTest-1107896766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:53:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-33c16d09-f53c-44de-a7fc-db75b180677e tempest-VolumesActionsTest-1107896766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:53:05 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-33c16d09-f53c-44de-a7fc-db75b180677e tempest-VolumesActionsTest-1107896766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:53:05 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-33c16d09-f53c-44de-a7fc-db75b180677e tempest-VolumesActionsTest-1107896766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:53:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-33c16d09-f53c-44de-a7fc-db75b180677e tempest-VolumesActionsTest-1107896766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:53:05 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-33c16d09-f53c-44de-a7fc-db75b180677e tempest-VolumesActionsTest-1107896766 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:53:05 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-33c16d09-f53c-44de-a7fc-db75b180677e tempest-VolumesActionsTest-1107896766 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:53:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-33c16d09-f53c-44de-a7fc-db75b180677e tempest-VolumesActionsTest-1107896766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ea605e14-c35a-4c9c-ae2e-08805173214a 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:05 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-65f82353-2063-47bb-a411-91a6ced1727f tempest-CreateVolumesFromImageTest-915358460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00606f96-3749-4544-9240-f21e64a69e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ed105f2-8e1f-4994-826a-f3c21a2ac6e7', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:53:05 devstack sudo[105880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ea605e14-c35a-4c9c-ae2e-08805173214a 1073741824 Jun 17 05:53:05 devstack sudo[105880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:05 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-65f82353-2063-47bb-a411-91a6ced1727f tempest-CreateVolumesFromImageTest-915358460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e25e8f0d-eab7-4732-b52f-c9e006f4e4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:53:05 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-65f82353-2063-47bb-a411-91a6ced1727f tempest-CreateVolumesFromImageTest-915358460 None] Volume volume-9ed105f2-8e1f-4994-826a-f3c21a2ac6e7 (9ed105f2-8e1f-4994-826a-f3c21a2ac6e7): created successfully Jun 17 05:53:05 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-65f82353-2063-47bb-a411-91a6ced1727f tempest-CreateVolumesFromImageTest-915358460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e25e8f0d-eab7-4732-b52f-c9e006f4e4f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:53:05 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-65f82353-2063-47bb-a411-91a6ced1727f tempest-CreateVolumesFromImageTest-915358460 None] Flow 'volume_create_manager' (3ea67d8b-c17d-4fb8-a8c5-e3a08bc970e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:53:05 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-65f82353-2063-47bb-a411-91a6ced1727f tempest-CreateVolumesFromImageTest-915358460 None] Created volume successfully. Jun 17 05:53:06 devstack sudo[105880]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-33c16d09-f53c-44de-a7fc-db75b180677e tempest-VolumesActionsTest-1107896766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ea605e14-c35a-4c9c-ae2e-08805173214a 1073741824" returned: 0 in 0.742s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-33c16d09-f53c-44de-a7fc-db75b180677e tempest-VolumesActionsTest-1107896766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ea605e14-c35a-4c9c-ae2e-08805173214a {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:06 devstack sudo[105885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ea605e14-c35a-4c9c-ae2e-08805173214a Jun 17 05:53:06 devstack sudo[105885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:06 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-07ca3746-4ef9-4d89-a23d-010b683e47d3 tempest-CreateVolumesFromImageTest-915358460 None] Acquiring lock "cinder-9ed105f2-8e1f-4994-826a-f3c21a2ac6e7-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:53:06 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-07ca3746-4ef9-4d89-a23d-010b683e47d3 tempest-CreateVolumesFromImageTest-915358460 None] Lock "cinder-9ed105f2-8e1f-4994-826a-f3c21a2ac6e7-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:53:06 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-07ca3746-4ef9-4d89-a23d-010b683e47d3 tempest-CreateVolumesFromImageTest-915358460 None] Acquiring lock "cinder-quobyte-9ed105f2-8e1f-4994-826a-f3c21a2ac6e7" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:53:06 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-07ca3746-4ef9-4d89-a23d-010b683e47d3 tempest-CreateVolumesFromImageTest-915358460 None] Lock "cinder-quobyte-9ed105f2-8e1f-4994-826a-f3c21a2ac6e7" acquired by "delete_volume" :: waited 0.016s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:53:06 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[99923f89-abff-4b2b-b99c-221ad5255a50]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:53:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-07ca3746-4ef9-4d89-a23d-010b683e47d3 tempest-CreateVolumesFromImageTest-915358460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9ed105f2-8e1f-4994-826a-f3c21a2ac6e7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:06 devstack sudo[105887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9ed105f2-8e1f-4994-826a-f3c21a2ac6e7 Jun 17 05:53:06 devstack sudo[105887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:06 devstack sudo[105885]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-33c16d09-f53c-44de-a7fc-db75b180677e tempest-VolumesActionsTest-1107896766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ea605e14-c35a-4c9c-ae2e-08805173214a" returned: 0 in 0.668s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:06 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-33c16d09-f53c-44de-a7fc-db75b180677e tempest-VolumesActionsTest-1107896766 None] <== create_volume: return (1452ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:53:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-33c16d09-f53c-44de-a7fc-db75b180677e tempest-VolumesActionsTest-1107896766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.456s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:53:06 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-33c16d09-f53c-44de-a7fc-db75b180677e tempest-VolumesActionsTest-1107896766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33377c78-6290-400c-96e9-6c7fbdde2f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea605e14-c35a-4c9c-ae2e-08805173214a', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:53:06 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-33c16d09-f53c-44de-a7fc-db75b180677e tempest-VolumesActionsTest-1107896766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d0ea590-a2dd-46db-9d1e-cf9c83d2e684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:53:06 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-33c16d09-f53c-44de-a7fc-db75b180677e tempest-VolumesActionsTest-1107896766 None] Volume volume-ea605e14-c35a-4c9c-ae2e-08805173214a (ea605e14-c35a-4c9c-ae2e-08805173214a): created successfully Jun 17 05:53:06 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-33c16d09-f53c-44de-a7fc-db75b180677e tempest-VolumesActionsTest-1107896766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d0ea590-a2dd-46db-9d1e-cf9c83d2e684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:53:06 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-33c16d09-f53c-44de-a7fc-db75b180677e tempest-VolumesActionsTest-1107896766 None] Flow 'volume_create_manager' (878cedbc-7c81-46b1-b804-ea30e540456c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:53:06 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-33c16d09-f53c-44de-a7fc-db75b180677e tempest-VolumesActionsTest-1107896766 None] Created volume successfully. Jun 17 05:53:07 devstack sudo[105887]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-07ca3746-4ef9-4d89-a23d-010b683e47d3 tempest-CreateVolumesFromImageTest-915358460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9ed105f2-8e1f-4994-826a-f3c21a2ac6e7" returned: 0 in 0.776s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-07ca3746-4ef9-4d89-a23d-010b683e47d3 tempest-CreateVolumesFromImageTest-915358460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9ed105f2-8e1f-4994-826a-f3c21a2ac6e7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:07 devstack sudo[105893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9ed105f2-8e1f-4994-826a-f3c21a2ac6e7 Jun 17 05:53:07 devstack sudo[105893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:07 devstack sudo[105893]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-07ca3746-4ef9-4d89-a23d-010b683e47d3 tempest-CreateVolumesFromImageTest-915358460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9ed105f2-8e1f-4994-826a-f3c21a2ac6e7" returned: 0 in 0.581s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:07 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-07ca3746-4ef9-4d89-a23d-010b683e47d3 tempest-CreateVolumesFromImageTest-915358460 None] Lock "cinder-quobyte-9ed105f2-8e1f-4994-826a-f3c21a2ac6e7" released by "delete_volume" :: held 1.411s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:53:07 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-07ca3746-4ef9-4d89-a23d-010b683e47d3 tempest-CreateVolumesFromImageTest-915358460 None] Created reservations ['07424315-9e27-4484-b254-8b92bdbe4142', '210699a0-bd14-46a1-9cab-fb3c0d891cbe', 'd59a7cc7-4302-4304-81f8-bbc8344757ff', 'b4a0d4be-0a24-41e1-9691-ed9237ff8a0a'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:53:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-07ca3746-4ef9-4d89-a23d-010b683e47d3 tempest-CreateVolumesFromImageTest-915358460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:53:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-07ca3746-4ef9-4d89-a23d-010b683e47d3 tempest-CreateVolumesFromImageTest-915358460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:53:07 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-07ca3746-4ef9-4d89-a23d-010b683e47d3 tempest-CreateVolumesFromImageTest-915358460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:53:07 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-07ca3746-4ef9-4d89-a23d-010b683e47d3 tempest-CreateVolumesFromImageTest-915358460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:53:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-07ca3746-4ef9-4d89-a23d-010b683e47d3 tempest-CreateVolumesFromImageTest-915358460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:53:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-07ca3746-4ef9-4d89-a23d-010b683e47d3 tempest-CreateVolumesFromImageTest-915358460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:07 devstack sudo[105896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:53:07 devstack sudo[105896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:08 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-5bfc0a63-d95b-4228-a406-e31ea9621ca0 tempest-VolumesActionsTest-1107896766 None] Acquiring lock "cinder-ea605e14-c35a-4c9c-ae2e-08805173214a" by "attach_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:53:08 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-5bfc0a63-d95b-4228-a406-e31ea9621ca0 tempest-VolumesActionsTest-1107896766 None] Lock "cinder-ea605e14-c35a-4c9c-ae2e-08805173214a" acquired by "attach_volume" :: waited 0.021s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:53:08 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-5bfc0a63-d95b-4228-a406-e31ea9621ca0 tempest-VolumesActionsTest-1107896766 None] Attaching volume ea605e14-c35a-4c9c-ae2e-08805173214a to instance fb40be31-702f-4fb4-842b-9ec3b19326d8 at mountpoint /dev/vdb on host None. Jun 17 05:53:08 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-5bfc0a63-d95b-4228-a406-e31ea9621ca0 tempest-VolumesActionsTest-1107896766 None] Attach volume completed successfully. Jun 17 05:53:08 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-5bfc0a63-d95b-4228-a406-e31ea9621ca0 tempest-VolumesActionsTest-1107896766 None] Lock "cinder-ea605e14-c35a-4c9c-ae2e-08805173214a" released by "attach_volume" :: held 0.093s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:53:08 devstack sudo[105896]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:08 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-3e50b502-a87b-40d5-86a0-923f594e9ac3 tempest-CreateVolumesFromImageTest-915358460 None] Acquiring lock "cinder-861c9695-3408-4268-b14c-0f29ff56f33f-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:53:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-07ca3746-4ef9-4d89-a23d-010b683e47d3 tempest-CreateVolumesFromImageTest-915358460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.645s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:08 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-07ca3746-4ef9-4d89-a23d-010b683e47d3 tempest-CreateVolumesFromImageTest-915358460 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:53:08 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-07ca3746-4ef9-4d89-a23d-010b683e47d3 tempest-CreateVolumesFromImageTest-915358460 None] Deleted volume successfully. Jun 17 05:53:08 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-3e50b502-a87b-40d5-86a0-923f594e9ac3 tempest-CreateVolumesFromImageTest-915358460 None] Lock "cinder-861c9695-3408-4268-b14c-0f29ff56f33f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:53:08 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-07ca3746-4ef9-4d89-a23d-010b683e47d3 tempest-CreateVolumesFromImageTest-915358460 None] Lock "cinder-9ed105f2-8e1f-4994-826a-f3c21a2ac6e7-delete_volume" released by "delete_volume" :: held 2.287s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:53:08 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-3e50b502-a87b-40d5-86a0-923f594e9ac3 tempest-CreateVolumesFromImageTest-915358460 None] Acquiring lock "cinder-quobyte-861c9695-3408-4268-b14c-0f29ff56f33f" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:53:08 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-3e50b502-a87b-40d5-86a0-923f594e9ac3 tempest-CreateVolumesFromImageTest-915358460 None] Lock "cinder-quobyte-861c9695-3408-4268-b14c-0f29ff56f33f" acquired by "delete_volume" :: waited 0.028s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:53:08 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[839cabd9-5593-41e7-a17d-f475855f7999]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:53:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-3e50b502-a87b-40d5-86a0-923f594e9ac3 tempest-CreateVolumesFromImageTest-915358460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-861c9695-3408-4268-b14c-0f29ff56f33f {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:08 devstack sudo[105900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-861c9695-3408-4268-b14c-0f29ff56f33f Jun 17 05:53:08 devstack sudo[105900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:09 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-82504aca-1e72-4032-8b8d-93baaee8c239 tempest-VolumesActionsTest-2019259401 None] Terminate volume connection completed successfully. Jun 17 05:53:09 devstack sudo[105900]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-3e50b502-a87b-40d5-86a0-923f594e9ac3 tempest-CreateVolumesFromImageTest-915358460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-861c9695-3408-4268-b14c-0f29ff56f33f" returned: 0 in 0.745s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-3e50b502-a87b-40d5-86a0-923f594e9ac3 tempest-CreateVolumesFromImageTest-915358460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-861c9695-3408-4268-b14c-0f29ff56f33f {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:09 devstack sudo[105906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-861c9695-3408-4268-b14c-0f29ff56f33f Jun 17 05:53:09 devstack sudo[105906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:09 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-82504aca-1e72-4032-8b8d-93baaee8c239 tempest-VolumesActionsTest-2019259401 None] Acquiring lock "cinder-ea605e14-c35a-4c9c-ae2e-08805173214a-detach_volume" by "detach_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:53:09 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-82504aca-1e72-4032-8b8d-93baaee8c239 tempest-VolumesActionsTest-2019259401 None] Lock "cinder-ea605e14-c35a-4c9c-ae2e-08805173214a-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:53:09 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-82504aca-1e72-4032-8b8d-93baaee8c239 tempest-VolumesActionsTest-2019259401 None] Detaching volume ea605e14-c35a-4c9c-ae2e-08805173214a from instance fb40be31-702f-4fb4-842b-9ec3b19326d8. Jun 17 05:53:09 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-82504aca-1e72-4032-8b8d-93baaee8c239 tempest-VolumesActionsTest-2019259401 None] Detach volume completed successfully. Jun 17 05:53:09 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-82504aca-1e72-4032-8b8d-93baaee8c239 tempest-VolumesActionsTest-2019259401 None] Lock "cinder-ea605e14-c35a-4c9c-ae2e-08805173214a-detach_volume" released by "detach_volume" :: held 0.074s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:53:10 devstack sudo[105906]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-3e50b502-a87b-40d5-86a0-923f594e9ac3 tempest-CreateVolumesFromImageTest-915358460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-861c9695-3408-4268-b14c-0f29ff56f33f" returned: 0 in 0.606s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:10 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-3e50b502-a87b-40d5-86a0-923f594e9ac3 tempest-CreateVolumesFromImageTest-915358460 None] Lock "cinder-quobyte-861c9695-3408-4268-b14c-0f29ff56f33f" released by "delete_volume" :: held 1.391s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:53:10 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-3e50b502-a87b-40d5-86a0-923f594e9ac3 tempest-CreateVolumesFromImageTest-915358460 None] Created reservations ['d3b8546c-7ddc-4989-80f2-dec9a63c029b', 'ebe96db9-5d46-4a45-9d9e-a0976cd48393', '31ccbf69-0327-4f3a-84ec-93c0587b7f2d', 'ecf90fe0-d7bf-46d8-909d-3209d8fa30fa'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:53:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-3e50b502-a87b-40d5-86a0-923f594e9ac3 tempest-CreateVolumesFromImageTest-915358460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:53:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-3e50b502-a87b-40d5-86a0-923f594e9ac3 tempest-CreateVolumesFromImageTest-915358460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:53:10 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-3e50b502-a87b-40d5-86a0-923f594e9ac3 tempest-CreateVolumesFromImageTest-915358460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:53:10 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-3e50b502-a87b-40d5-86a0-923f594e9ac3 tempest-CreateVolumesFromImageTest-915358460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:53:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-3e50b502-a87b-40d5-86a0-923f594e9ac3 tempest-CreateVolumesFromImageTest-915358460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:53:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-3e50b502-a87b-40d5-86a0-923f594e9ac3 tempest-CreateVolumesFromImageTest-915358460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:10 devstack sudo[105909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:53:10 devstack sudo[105909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:10 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-d6153c1b-fcd2-40ef-8610-0b8fef5b9aa2 tempest-VolumesActionsTest-1107896766 None] Acquiring lock "cinder-ea605e14-c35a-4c9c-ae2e-08805173214a-detach_volume" by "detach_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:53:10 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-d6153c1b-fcd2-40ef-8610-0b8fef5b9aa2 tempest-VolumesActionsTest-1107896766 None] Lock "cinder-ea605e14-c35a-4c9c-ae2e-08805173214a-detach_volume" acquired by "detach_volume" :: waited 0.025s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:53:10 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-d6153c1b-fcd2-40ef-8610-0b8fef5b9aa2 tempest-VolumesActionsTest-1107896766 None] Volume detach called, but volume not attached. Jun 17 05:53:10 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-d6153c1b-fcd2-40ef-8610-0b8fef5b9aa2 tempest-VolumesActionsTest-1107896766 None] Lock "cinder-ea605e14-c35a-4c9c-ae2e-08805173214a-detach_volume" released by "detach_volume" :: held 0.019s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:53:10 devstack sudo[105909]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-3e50b502-a87b-40d5-86a0-923f594e9ac3 tempest-CreateVolumesFromImageTest-915358460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.665s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:10 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-3e50b502-a87b-40d5-86a0-923f594e9ac3 tempest-CreateVolumesFromImageTest-915358460 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:53:10 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-3e50b502-a87b-40d5-86a0-923f594e9ac3 tempest-CreateVolumesFromImageTest-915358460 None] Deleted volume successfully. Jun 17 05:53:10 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-e94ac022-569d-4c47-b486-81d1a73605a6 tempest-CreateVolumesFromImageTest-915358460 None] Acquiring lock "cinder-d479a8d0-fef1-46ea-a262-797768e6ac8b-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:53:10 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-3e50b502-a87b-40d5-86a0-923f594e9ac3 tempest-CreateVolumesFromImageTest-915358460 None] Lock "cinder-861c9695-3408-4268-b14c-0f29ff56f33f-delete_volume" released by "delete_volume" :: held 2.305s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:53:10 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-e94ac022-569d-4c47-b486-81d1a73605a6 tempest-CreateVolumesFromImageTest-915358460 None] Lock "cinder-d479a8d0-fef1-46ea-a262-797768e6ac8b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:53:10 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-e94ac022-569d-4c47-b486-81d1a73605a6 tempest-CreateVolumesFromImageTest-915358460 None] Acquiring lock "cinder-quobyte-d479a8d0-fef1-46ea-a262-797768e6ac8b" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:53:10 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-e94ac022-569d-4c47-b486-81d1a73605a6 tempest-CreateVolumesFromImageTest-915358460 None] Lock "cinder-quobyte-d479a8d0-fef1-46ea-a262-797768e6ac8b" acquired by "delete_volume" :: waited 0.014s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:53:10 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c2630af-7e6b-4635-9b75-bc352706fe35]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:53:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e94ac022-569d-4c47-b486-81d1a73605a6 tempest-CreateVolumesFromImageTest-915358460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d479a8d0-fef1-46ea-a262-797768e6ac8b {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:11 devstack sudo[105912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d479a8d0-fef1-46ea-a262-797768e6ac8b Jun 17 05:53:11 devstack sudo[105912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:11 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-7bbe62ff-963d-4249-8c8b-87791aeb0329 tempest-VolumesActionsTest-1107896766 None] Acquiring lock "cinder-ea605e14-c35a-4c9c-ae2e-08805173214a-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:53:11 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-7bbe62ff-963d-4249-8c8b-87791aeb0329 tempest-VolumesActionsTest-1107896766 None] Lock "cinder-ea605e14-c35a-4c9c-ae2e-08805173214a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:53:11 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-7bbe62ff-963d-4249-8c8b-87791aeb0329 tempest-VolumesActionsTest-1107896766 None] Acquiring lock "cinder-quobyte-ea605e14-c35a-4c9c-ae2e-08805173214a" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:53:11 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-7bbe62ff-963d-4249-8c8b-87791aeb0329 tempest-VolumesActionsTest-1107896766 None] Lock "cinder-quobyte-ea605e14-c35a-4c9c-ae2e-08805173214a" acquired by "delete_volume" :: waited 0.026s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:53:11 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd34519d-701f-44c6-a7e1-7a0b9fcff7b3]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:53:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-7bbe62ff-963d-4249-8c8b-87791aeb0329 tempest-VolumesActionsTest-1107896766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ea605e14-c35a-4c9c-ae2e-08805173214a {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:11 devstack sudo[105914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ea605e14-c35a-4c9c-ae2e-08805173214a Jun 17 05:53:11 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:11 devstack sudo[105912]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e94ac022-569d-4c47-b486-81d1a73605a6 tempest-CreateVolumesFromImageTest-915358460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d479a8d0-fef1-46ea-a262-797768e6ac8b" returned: 0 in 0.822s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e94ac022-569d-4c47-b486-81d1a73605a6 tempest-CreateVolumesFromImageTest-915358460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d479a8d0-fef1-46ea-a262-797768e6ac8b {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:11 devstack sudo[105950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d479a8d0-fef1-46ea-a262-797768e6ac8b Jun 17 05:53:11 devstack sudo[105950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:12 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-7bbe62ff-963d-4249-8c8b-87791aeb0329 tempest-VolumesActionsTest-1107896766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ea605e14-c35a-4c9c-ae2e-08805173214a" returned: 0 in 0.809s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-7bbe62ff-963d-4249-8c8b-87791aeb0329 tempest-VolumesActionsTest-1107896766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ea605e14-c35a-4c9c-ae2e-08805173214a {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:12 devstack sudo[105955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ea605e14-c35a-4c9c-ae2e-08805173214a Jun 17 05:53:12 devstack sudo[105955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:12 devstack sudo[105950]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e94ac022-569d-4c47-b486-81d1a73605a6 tempest-CreateVolumesFromImageTest-915358460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d479a8d0-fef1-46ea-a262-797768e6ac8b" returned: 0 in 0.631s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:12 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-e94ac022-569d-4c47-b486-81d1a73605a6 tempest-CreateVolumesFromImageTest-915358460 None] Lock "cinder-quobyte-d479a8d0-fef1-46ea-a262-797768e6ac8b" released by "delete_volume" :: held 1.504s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:53:12 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-e94ac022-569d-4c47-b486-81d1a73605a6 tempest-CreateVolumesFromImageTest-915358460 None] Created reservations ['0f6a0df1-fe50-4adf-aa1a-ce503b07d18f', 'bb12be77-8d79-4067-b162-5d5c5cbf7ec2', '436715bd-e658-4fcf-8390-bbf606c4297f', '1040a036-1326-4b94-bbfb-f373ba9c8730'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:53:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e94ac022-569d-4c47-b486-81d1a73605a6 tempest-CreateVolumesFromImageTest-915358460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:53:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e94ac022-569d-4c47-b486-81d1a73605a6 tempest-CreateVolumesFromImageTest-915358460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:53:12 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-e94ac022-569d-4c47-b486-81d1a73605a6 tempest-CreateVolumesFromImageTest-915358460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:53:12 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-e94ac022-569d-4c47-b486-81d1a73605a6 tempest-CreateVolumesFromImageTest-915358460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:53:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e94ac022-569d-4c47-b486-81d1a73605a6 tempest-CreateVolumesFromImageTest-915358460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:53:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e94ac022-569d-4c47-b486-81d1a73605a6 tempest-CreateVolumesFromImageTest-915358460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:12 devstack sudo[105958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:53:12 devstack sudo[105958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:12 devstack sudo[105955]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-7bbe62ff-963d-4249-8c8b-87791aeb0329 tempest-VolumesActionsTest-1107896766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ea605e14-c35a-4c9c-ae2e-08805173214a" returned: 0 in 0.630s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:12 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-7bbe62ff-963d-4249-8c8b-87791aeb0329 tempest-VolumesActionsTest-1107896766 None] Lock "cinder-quobyte-ea605e14-c35a-4c9c-ae2e-08805173214a" released by "delete_volume" :: held 1.487s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:53:12 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-7bbe62ff-963d-4249-8c8b-87791aeb0329 tempest-VolumesActionsTest-1107896766 None] Created reservations ['4248ecc4-4949-4174-81ae-702ea56fa538', '36afb290-a6cc-4d8e-87e0-5d10465d5e81', '29a4d64d-1a19-4b29-9f55-db06589c0df6', '4ec7a853-cd5e-45df-b9ae-67c8050c4205'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:53:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-7bbe62ff-963d-4249-8c8b-87791aeb0329 tempest-VolumesActionsTest-1107896766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:53:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-7bbe62ff-963d-4249-8c8b-87791aeb0329 tempest-VolumesActionsTest-1107896766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:53:12 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-7bbe62ff-963d-4249-8c8b-87791aeb0329 tempest-VolumesActionsTest-1107896766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:53:12 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-7bbe62ff-963d-4249-8c8b-87791aeb0329 tempest-VolumesActionsTest-1107896766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:53:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-7bbe62ff-963d-4249-8c8b-87791aeb0329 tempest-VolumesActionsTest-1107896766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:53:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-7bbe62ff-963d-4249-8c8b-87791aeb0329 tempest-VolumesActionsTest-1107896766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:12 devstack sudo[105961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:53:12 devstack sudo[105961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:13 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-a1901198-c2f7-4009-a3f5-5d90121276f2 tempest-CreateVolumesFromImageTest-915358460 None] Acquiring lock "cinder-0bba22df-52fd-41d6-8ab5-318a0ba972bb-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:53:13 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-a1901198-c2f7-4009-a3f5-5d90121276f2 tempest-CreateVolumesFromImageTest-915358460 None] Lock "cinder-0bba22df-52fd-41d6-8ab5-318a0ba972bb-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:53:13 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-a1901198-c2f7-4009-a3f5-5d90121276f2 tempest-CreateVolumesFromImageTest-915358460 None] Acquiring lock "cinder-quobyte-0bba22df-52fd-41d6-8ab5-318a0ba972bb" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:53:13 devstack sudo[105958]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:13 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e94ac022-569d-4c47-b486-81d1a73605a6 tempest-CreateVolumesFromImageTest-915358460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.625s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:13 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-e94ac022-569d-4c47-b486-81d1a73605a6 tempest-CreateVolumesFromImageTest-915358460 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:53:13 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-e94ac022-569d-4c47-b486-81d1a73605a6 tempest-CreateVolumesFromImageTest-915358460 None] Deleted volume successfully. Jun 17 05:53:13 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-a1901198-c2f7-4009-a3f5-5d90121276f2 tempest-CreateVolumesFromImageTest-915358460 None] Lock "cinder-quobyte-0bba22df-52fd-41d6-8ab5-318a0ba972bb" acquired by "delete_volume" :: waited 0.023s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:53:13 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[322127b0-1d71-43d2-bdff-6e0873e18566]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:53:13 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a1901198-c2f7-4009-a3f5-5d90121276f2 tempest-CreateVolumesFromImageTest-915358460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0bba22df-52fd-41d6-8ab5-318a0ba972bb {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:13 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-e94ac022-569d-4c47-b486-81d1a73605a6 tempest-CreateVolumesFromImageTest-915358460 None] Lock "cinder-d479a8d0-fef1-46ea-a262-797768e6ac8b-delete_volume" released by "delete_volume" :: held 2.360s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:53:13 devstack sudo[105964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0bba22df-52fd-41d6-8ab5-318a0ba972bb Jun 17 05:53:13 devstack sudo[105964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:13 devstack sudo[105961]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:13 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-7bbe62ff-963d-4249-8c8b-87791aeb0329 tempest-VolumesActionsTest-1107896766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.701s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:13 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-7bbe62ff-963d-4249-8c8b-87791aeb0329 tempest-VolumesActionsTest-1107896766 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:53:13 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-7bbe62ff-963d-4249-8c8b-87791aeb0329 tempest-VolumesActionsTest-1107896766 None] Deleted volume successfully. Jun 17 05:53:13 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-7bbe62ff-963d-4249-8c8b-87791aeb0329 tempest-VolumesActionsTest-1107896766 None] Lock "cinder-ea605e14-c35a-4c9c-ae2e-08805173214a-delete_volume" released by "delete_volume" :: held 2.411s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:53:13 devstack sudo[105964]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a1901198-c2f7-4009-a3f5-5d90121276f2 tempest-CreateVolumesFromImageTest-915358460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0bba22df-52fd-41d6-8ab5-318a0ba972bb" returned: 0 in 0.794s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a1901198-c2f7-4009-a3f5-5d90121276f2 tempest-CreateVolumesFromImageTest-915358460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0bba22df-52fd-41d6-8ab5-318a0ba972bb {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:14 devstack sudo[105970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0bba22df-52fd-41d6-8ab5-318a0ba972bb Jun 17 05:53:14 devstack sudo[105970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:14 devstack sudo[105970]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a1901198-c2f7-4009-a3f5-5d90121276f2 tempest-CreateVolumesFromImageTest-915358460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0bba22df-52fd-41d6-8ab5-318a0ba972bb" returned: 0 in 0.692s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:14 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-a1901198-c2f7-4009-a3f5-5d90121276f2 tempest-CreateVolumesFromImageTest-915358460 None] Lock "cinder-quobyte-0bba22df-52fd-41d6-8ab5-318a0ba972bb" released by "delete_volume" :: held 1.543s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:53:14 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-a1901198-c2f7-4009-a3f5-5d90121276f2 tempest-CreateVolumesFromImageTest-915358460 None] Created reservations ['7b10a3a0-6898-4aa9-90b4-5a072e7d5b68', '70f21fdd-0d53-4124-9397-e4e31e382c20', '03631e7d-ca83-4ff7-b958-1f1cdc110d6f', '62aa5d14-70ae-4035-b7b5-c85d545fdb40'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:53:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-a1901198-c2f7-4009-a3f5-5d90121276f2 tempest-CreateVolumesFromImageTest-915358460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:53:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-a1901198-c2f7-4009-a3f5-5d90121276f2 tempest-CreateVolumesFromImageTest-915358460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:53:14 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-a1901198-c2f7-4009-a3f5-5d90121276f2 tempest-CreateVolumesFromImageTest-915358460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:53:14 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-a1901198-c2f7-4009-a3f5-5d90121276f2 tempest-CreateVolumesFromImageTest-915358460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:53:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-a1901198-c2f7-4009-a3f5-5d90121276f2 tempest-CreateVolumesFromImageTest-915358460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:53:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a1901198-c2f7-4009-a3f5-5d90121276f2 tempest-CreateVolumesFromImageTest-915358460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:14 devstack sudo[106014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:53:14 devstack sudo[106014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:15 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-b6c47fac-9a30-46e7-973f-c8ad94ea16fc tempest-CreateVolumesFromImageTest-915358460 None] Acquiring lock "cinder-ae3e907d-5e58-4c4c-9e66-6468bdce07c2-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:53:15 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-b6c47fac-9a30-46e7-973f-c8ad94ea16fc tempest-CreateVolumesFromImageTest-915358460 None] Lock "cinder-ae3e907d-5e58-4c4c-9e66-6468bdce07c2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:53:15 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-b6c47fac-9a30-46e7-973f-c8ad94ea16fc tempest-CreateVolumesFromImageTest-915358460 None] Acquiring lock "cinder-quobyte-ae3e907d-5e58-4c4c-9e66-6468bdce07c2" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:53:15 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-b6c47fac-9a30-46e7-973f-c8ad94ea16fc tempest-CreateVolumesFromImageTest-915358460 None] Lock "cinder-quobyte-ae3e907d-5e58-4c4c-9e66-6468bdce07c2" acquired by "delete_volume" :: waited 0.025s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:53:15 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[1093a5d8-c22b-4fac-884c-fba6b5f548c3]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:53:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b6c47fac-9a30-46e7-973f-c8ad94ea16fc tempest-CreateVolumesFromImageTest-915358460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ae3e907d-5e58-4c4c-9e66-6468bdce07c2 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:15 devstack sudo[106014]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:15 devstack sudo[106017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ae3e907d-5e58-4c4c-9e66-6468bdce07c2 Jun 17 05:53:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a1901198-c2f7-4009-a3f5-5d90121276f2 tempest-CreateVolumesFromImageTest-915358460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.688s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:15 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-a1901198-c2f7-4009-a3f5-5d90121276f2 tempest-CreateVolumesFromImageTest-915358460 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:53:15 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:15 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-a1901198-c2f7-4009-a3f5-5d90121276f2 tempest-CreateVolumesFromImageTest-915358460 None] Deleted volume successfully. Jun 17 05:53:15 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-a1901198-c2f7-4009-a3f5-5d90121276f2 tempest-CreateVolumesFromImageTest-915358460 None] Lock "cinder-0bba22df-52fd-41d6-8ab5-318a0ba972bb-delete_volume" released by "delete_volume" :: held 2.474s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:53:16 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b6c47fac-9a30-46e7-973f-c8ad94ea16fc tempest-CreateVolumesFromImageTest-915358460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ae3e907d-5e58-4c4c-9e66-6468bdce07c2" returned: 0 in 0.726s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b6c47fac-9a30-46e7-973f-c8ad94ea16fc tempest-CreateVolumesFromImageTest-915358460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ae3e907d-5e58-4c4c-9e66-6468bdce07c2 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:16 devstack sudo[106029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ae3e907d-5e58-4c4c-9e66-6468bdce07c2 Jun 17 05:53:16 devstack sudo[106029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:16 devstack sudo[106029]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b6c47fac-9a30-46e7-973f-c8ad94ea16fc tempest-CreateVolumesFromImageTest-915358460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ae3e907d-5e58-4c4c-9e66-6468bdce07c2" returned: 0 in 0.683s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:16 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-b6c47fac-9a30-46e7-973f-c8ad94ea16fc tempest-CreateVolumesFromImageTest-915358460 None] Lock "cinder-quobyte-ae3e907d-5e58-4c4c-9e66-6468bdce07c2" released by "delete_volume" :: held 1.450s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:53:16 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-b6c47fac-9a30-46e7-973f-c8ad94ea16fc tempest-CreateVolumesFromImageTest-915358460 None] Created reservations ['f1e09b36-dc4c-4553-8bd5-54c4b8f16fdd', '7f64fc86-e4c7-4dc5-b5b3-71af7f349323', '7878409a-42ff-42ad-8faf-e3953721cbfe', '89a975b3-f6d5-4381-bec4-f3978be34151'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:53:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-b6c47fac-9a30-46e7-973f-c8ad94ea16fc tempest-CreateVolumesFromImageTest-915358460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:53:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-b6c47fac-9a30-46e7-973f-c8ad94ea16fc tempest-CreateVolumesFromImageTest-915358460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:53:16 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-b6c47fac-9a30-46e7-973f-c8ad94ea16fc tempest-CreateVolumesFromImageTest-915358460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:53:16 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-b6c47fac-9a30-46e7-973f-c8ad94ea16fc tempest-CreateVolumesFromImageTest-915358460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:53:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-b6c47fac-9a30-46e7-973f-c8ad94ea16fc tempest-CreateVolumesFromImageTest-915358460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:53:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b6c47fac-9a30-46e7-973f-c8ad94ea16fc tempest-CreateVolumesFromImageTest-915358460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:17 devstack sudo[106033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:53:17 devstack sudo[106033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:17 devstack sudo[106033]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b6c47fac-9a30-46e7-973f-c8ad94ea16fc tempest-CreateVolumesFromImageTest-915358460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.623s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:17 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-b6c47fac-9a30-46e7-973f-c8ad94ea16fc tempest-CreateVolumesFromImageTest-915358460 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:53:17 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-b6c47fac-9a30-46e7-973f-c8ad94ea16fc tempest-CreateVolumesFromImageTest-915358460 None] Deleted volume successfully. Jun 17 05:53:17 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-b6c47fac-9a30-46e7-973f-c8ad94ea16fc tempest-CreateVolumesFromImageTest-915358460 None] Lock "cinder-ae3e907d-5e58-4c4c-9e66-6468bdce07c2-delete_volume" released by "delete_volume" :: held 2.288s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:53:20 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3d8ac68-5bc4-4d73-a0d3-e9b8478a73fe tempest-VolumesActionsTest-1107896766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:53:20 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e3d8ac68-5bc4-4d73-a0d3-e9b8478a73fe tempest-VolumesActionsTest-1107896766 None] Flow 'volume_create_manager' (fefb2538-bbd9-44e0-bd1d-28d32e53d143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:53:20 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e3d8ac68-5bc4-4d73-a0d3-e9b8478a73fe tempest-VolumesActionsTest-1107896766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aad8afe2-59cc-4112-bd8b-f8e26ea10de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:53:20 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e3d8ac68-5bc4-4d73-a0d3-e9b8478a73fe tempest-VolumesActionsTest-1107896766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aad8afe2-59cc-4112-bd8b-f8e26ea10de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:53:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1679864679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c77bb13-77ab-4fd5-b47b-b77d38ec249a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09654981722e4d16a9c750aa12b9b7b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:53:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:53:20Z,use_quota=True,user_id='5c9f4322025c417da6d2f736ae055e8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:53:20 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e3d8ac68-5bc4-4d73-a0d3-e9b8478a73fe tempest-VolumesActionsTest-1107896766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44c6dd24-652f-4990-9c02-c867eeb8a51c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:53:20 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e3d8ac68-5bc4-4d73-a0d3-e9b8478a73fe tempest-VolumesActionsTest-1107896766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44c6dd24-652f-4990-9c02-c867eeb8a51c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:53:20 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e3d8ac68-5bc4-4d73-a0d3-e9b8478a73fe tempest-VolumesActionsTest-1107896766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a14a99a5-52eb-40f4-a7ff-a083ee2af6fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:53:20 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e3d8ac68-5bc4-4d73-a0d3-e9b8478a73fe tempest-VolumesActionsTest-1107896766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a14a99a5-52eb-40f4-a7ff-a083ee2af6fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c77bb13-77ab-4fd5-b47b-b77d38ec249a', 'volume_name': 'volume-0c77bb13-77ab-4fd5-b47b-b77d38ec249a', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:53:20 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e3d8ac68-5bc4-4d73-a0d3-e9b8478a73fe tempest-VolumesActionsTest-1107896766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be786508-418e-4c1f-9451-b17c55acd9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:53:20 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e3d8ac68-5bc4-4d73-a0d3-e9b8478a73fe tempest-VolumesActionsTest-1107896766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be786508-418e-4c1f-9451-b17c55acd9e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:53:20 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e3d8ac68-5bc4-4d73-a0d3-e9b8478a73fe tempest-VolumesActionsTest-1107896766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8499d95e-3013-43b4-8e0b-c6290d38d48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:53:20 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-e3d8ac68-5bc4-4d73-a0d3-e9b8478a73fe tempest-VolumesActionsTest-1107896766 None] Volume 0c77bb13-77ab-4fd5-b47b-b77d38ec249a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c77bb13-77ab-4fd5-b47b-b77d38ec249a', 'volume_size': 1} Jun 17 05:53:20 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e3d8ac68-5bc4-4d73-a0d3-e9b8478a73fe tempest-VolumesActionsTest-1107896766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:53:20 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e3d8ac68-5bc4-4d73-a0d3-e9b8478a73fe tempest-VolumesActionsTest-1107896766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:53:20 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-e3d8ac68-5bc4-4d73-a0d3-e9b8478a73fe tempest-VolumesActionsTest-1107896766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:53:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1679864679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c77bb13-77ab-4fd5-b47b-b77d38ec249a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09654981722e4d16a9c750aa12b9b7b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:53:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:53:20Z,use_quota=True,user_id='5c9f4322025c417da6d2f736ae055e8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:53:20 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-e3d8ac68-5bc4-4d73-a0d3-e9b8478a73fe tempest-VolumesActionsTest-1107896766 None] Creating volume 0c77bb13-77ab-4fd5-b47b-b77d38ec249a {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:53:20 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e3d8ac68-5bc4-4d73-a0d3-e9b8478a73fe tempest-VolumesActionsTest-1107896766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:53:20 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e3d8ac68-5bc4-4d73-a0d3-e9b8478a73fe tempest-VolumesActionsTest-1107896766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:53:20 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-e3d8ac68-5bc4-4d73-a0d3-e9b8478a73fe tempest-VolumesActionsTest-1107896766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:53:20 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-e3d8ac68-5bc4-4d73-a0d3-e9b8478a73fe tempest-VolumesActionsTest-1107896766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:53:20 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e3d8ac68-5bc4-4d73-a0d3-e9b8478a73fe tempest-VolumesActionsTest-1107896766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:53:20 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-e3d8ac68-5bc4-4d73-a0d3-e9b8478a73fe tempest-VolumesActionsTest-1107896766 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:53:20 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-e3d8ac68-5bc4-4d73-a0d3-e9b8478a73fe tempest-VolumesActionsTest-1107896766 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:53:20 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e3d8ac68-5bc4-4d73-a0d3-e9b8478a73fe tempest-VolumesActionsTest-1107896766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0c77bb13-77ab-4fd5-b47b-b77d38ec249a 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:20 devstack sudo[106037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0c77bb13-77ab-4fd5-b47b-b77d38ec249a 1073741824 Jun 17 05:53:20 devstack sudo[106037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:20 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2d916e6-7b04-4005-89da-2344e85b95f0 tempest-VolumeDependencyTests-386071043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:53:20 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c2d916e6-7b04-4005-89da-2344e85b95f0 tempest-VolumeDependencyTests-386071043 None] Flow 'volume_create_manager' (d67b233d-ad20-4b6d-a23d-da8a75b56f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:53:20 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c2d916e6-7b04-4005-89da-2344e85b95f0 tempest-VolumeDependencyTests-386071043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e3ab463-c639-4adb-8214-1b4635ad7b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:53:20 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c2d916e6-7b04-4005-89da-2344e85b95f0 tempest-VolumeDependencyTests-386071043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e3ab463-c639-4adb-8214-1b4635ad7b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:53:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-479078054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26276f85-a9f6-40c2-acf9-94b7010eed5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d3049c4857d46cfafff6d2acc95dc78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:53:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:53:20Z,use_quota=True,user_id='71d788de4c4c40569d2a8b133db4e3bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:53:20 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c2d916e6-7b04-4005-89da-2344e85b95f0 tempest-VolumeDependencyTests-386071043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4de80bc2-27e0-4da8-b022-cc3da9fd5eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:53:20 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c2d916e6-7b04-4005-89da-2344e85b95f0 tempest-VolumeDependencyTests-386071043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4de80bc2-27e0-4da8-b022-cc3da9fd5eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:53:20 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c2d916e6-7b04-4005-89da-2344e85b95f0 tempest-VolumeDependencyTests-386071043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b03c328-352c-46b0-94f1-1031d5c30ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:53:20 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c2d916e6-7b04-4005-89da-2344e85b95f0 tempest-VolumeDependencyTests-386071043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b03c328-352c-46b0-94f1-1031d5c30ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26276f85-a9f6-40c2-acf9-94b7010eed5b', 'volume_name': 'volume-26276f85-a9f6-40c2-acf9-94b7010eed5b', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:53:20 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c2d916e6-7b04-4005-89da-2344e85b95f0 tempest-VolumeDependencyTests-386071043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b54cf25f-9338-4a6f-8c6e-155798296ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:53:20 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c2d916e6-7b04-4005-89da-2344e85b95f0 tempest-VolumeDependencyTests-386071043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b54cf25f-9338-4a6f-8c6e-155798296ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:53:20 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c2d916e6-7b04-4005-89da-2344e85b95f0 tempest-VolumeDependencyTests-386071043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61a94e2e-4c2c-4620-b36d-b00a63df73db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:53:20 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-c2d916e6-7b04-4005-89da-2344e85b95f0 tempest-VolumeDependencyTests-386071043 None] Volume 26276f85-a9f6-40c2-acf9-94b7010eed5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26276f85-a9f6-40c2-acf9-94b7010eed5b', 'volume_size': 1} Jun 17 05:53:20 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-c2d916e6-7b04-4005-89da-2344e85b95f0 tempest-VolumeDependencyTests-386071043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:53:21 devstack sudo[106037]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:21 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e3d8ac68-5bc4-4d73-a0d3-e9b8478a73fe tempest-VolumesActionsTest-1107896766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0c77bb13-77ab-4fd5-b47b-b77d38ec249a 1073741824" returned: 0 in 0.781s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:21 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e3d8ac68-5bc4-4d73-a0d3-e9b8478a73fe tempest-VolumesActionsTest-1107896766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0c77bb13-77ab-4fd5-b47b-b77d38ec249a {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:21 devstack sudo[106042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0c77bb13-77ab-4fd5-b47b-b77d38ec249a Jun 17 05:53:21 devstack sudo[106042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:21 devstack sudo[106042]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:21 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e3d8ac68-5bc4-4d73-a0d3-e9b8478a73fe tempest-VolumesActionsTest-1107896766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0c77bb13-77ab-4fd5-b47b-b77d38ec249a" returned: 0 in 0.596s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:21 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-e3d8ac68-5bc4-4d73-a0d3-e9b8478a73fe tempest-VolumesActionsTest-1107896766 None] <== create_volume: return (1416ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:53:21 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e3d8ac68-5bc4-4d73-a0d3-e9b8478a73fe tempest-VolumesActionsTest-1107896766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.418s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:53:21 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-c2d916e6-7b04-4005-89da-2344e85b95f0 tempest-VolumeDependencyTests-386071043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.296s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:53:21 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-c2d916e6-7b04-4005-89da-2344e85b95f0 tempest-VolumeDependencyTests-386071043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:53:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-479078054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26276f85-a9f6-40c2-acf9-94b7010eed5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d3049c4857d46cfafff6d2acc95dc78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:53:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:53:20Z,use_quota=True,user_id='71d788de4c4c40569d2a8b133db4e3bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:53:21 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-c2d916e6-7b04-4005-89da-2344e85b95f0 tempest-VolumeDependencyTests-386071043 None] Creating volume 26276f85-a9f6-40c2-acf9-94b7010eed5b {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:53:21 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-c2d916e6-7b04-4005-89da-2344e85b95f0 tempest-VolumeDependencyTests-386071043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:53:21 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-c2d916e6-7b04-4005-89da-2344e85b95f0 tempest-VolumeDependencyTests-386071043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:53:21 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-c2d916e6-7b04-4005-89da-2344e85b95f0 tempest-VolumeDependencyTests-386071043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:53:21 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-c2d916e6-7b04-4005-89da-2344e85b95f0 tempest-VolumeDependencyTests-386071043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:53:21 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-c2d916e6-7b04-4005-89da-2344e85b95f0 tempest-VolumeDependencyTests-386071043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:53:21 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-c2d916e6-7b04-4005-89da-2344e85b95f0 tempest-VolumeDependencyTests-386071043 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:53:21 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-c2d916e6-7b04-4005-89da-2344e85b95f0 tempest-VolumeDependencyTests-386071043 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:53:21 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c2d916e6-7b04-4005-89da-2344e85b95f0 tempest-VolumeDependencyTests-386071043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-26276f85-a9f6-40c2-acf9-94b7010eed5b 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:21 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e3d8ac68-5bc4-4d73-a0d3-e9b8478a73fe tempest-VolumesActionsTest-1107896766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8499d95e-3013-43b4-8e0b-c6290d38d48e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c77bb13-77ab-4fd5-b47b-b77d38ec249a', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:53:21 devstack sudo[106045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-26276f85-a9f6-40c2-acf9-94b7010eed5b 1073741824 Jun 17 05:53:21 devstack sudo[106045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:21 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e3d8ac68-5bc4-4d73-a0d3-e9b8478a73fe tempest-VolumesActionsTest-1107896766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaf10927-f40f-4d6d-9dbc-9d2469909e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:53:21 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-e3d8ac68-5bc4-4d73-a0d3-e9b8478a73fe tempest-VolumesActionsTest-1107896766 None] Volume volume-0c77bb13-77ab-4fd5-b47b-b77d38ec249a (0c77bb13-77ab-4fd5-b47b-b77d38ec249a): created successfully Jun 17 05:53:21 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e3d8ac68-5bc4-4d73-a0d3-e9b8478a73fe tempest-VolumesActionsTest-1107896766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaf10927-f40f-4d6d-9dbc-9d2469909e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:53:21 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e3d8ac68-5bc4-4d73-a0d3-e9b8478a73fe tempest-VolumesActionsTest-1107896766 None] Flow 'volume_create_manager' (fefb2538-bbd9-44e0-bd1d-28d32e53d143) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:53:21 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-e3d8ac68-5bc4-4d73-a0d3-e9b8478a73fe tempest-VolumesActionsTest-1107896766 None] Created volume successfully. Jun 17 05:53:22 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-7900b147-b708-4857-b21f-5c8528601b3e tempest-VolumesActionsTest-2019259401 None] Acquiring lock "cinder-0c77bb13-77ab-4fd5-b47b-b77d38ec249a-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:53:22 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-7900b147-b708-4857-b21f-5c8528601b3e tempest-VolumesActionsTest-2019259401 None] Lock "cinder-0c77bb13-77ab-4fd5-b47b-b77d38ec249a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:53:22 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-7900b147-b708-4857-b21f-5c8528601b3e tempest-VolumesActionsTest-2019259401 None] Acquiring lock "cinder-quobyte-0c77bb13-77ab-4fd5-b47b-b77d38ec249a" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:53:22 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-7900b147-b708-4857-b21f-5c8528601b3e tempest-VolumesActionsTest-2019259401 None] Lock "cinder-quobyte-0c77bb13-77ab-4fd5-b47b-b77d38ec249a" acquired by "delete_volume" :: waited 0.019s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:53:22 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a46e3b1-f362-40a1-a2a1-68319079c944]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:53:22 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-7900b147-b708-4857-b21f-5c8528601b3e tempest-VolumesActionsTest-2019259401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0c77bb13-77ab-4fd5-b47b-b77d38ec249a {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:22 devstack sudo[106045]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:22 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c2d916e6-7b04-4005-89da-2344e85b95f0 tempest-VolumeDependencyTests-386071043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-26276f85-a9f6-40c2-acf9-94b7010eed5b 1073741824" returned: 0 in 0.839s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:22 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c2d916e6-7b04-4005-89da-2344e85b95f0 tempest-VolumeDependencyTests-386071043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-26276f85-a9f6-40c2-acf9-94b7010eed5b {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:22 devstack sudo[106052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-26276f85-a9f6-40c2-acf9-94b7010eed5b Jun 17 05:53:22 devstack sudo[106052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:22 devstack sudo[106051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0c77bb13-77ab-4fd5-b47b-b77d38ec249a Jun 17 05:53:22 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:23 devstack sudo[106052]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:23 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c2d916e6-7b04-4005-89da-2344e85b95f0 tempest-VolumeDependencyTests-386071043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-26276f85-a9f6-40c2-acf9-94b7010eed5b" returned: 0 in 0.601s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:23 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-c2d916e6-7b04-4005-89da-2344e85b95f0 tempest-VolumeDependencyTests-386071043 None] <== create_volume: return (1485ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:53:23 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-c2d916e6-7b04-4005-89da-2344e85b95f0 tempest-VolumeDependencyTests-386071043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.487s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:53:23 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c2d916e6-7b04-4005-89da-2344e85b95f0 tempest-VolumeDependencyTests-386071043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61a94e2e-4c2c-4620-b36d-b00a63df73db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26276f85-a9f6-40c2-acf9-94b7010eed5b', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:53:23 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c2d916e6-7b04-4005-89da-2344e85b95f0 tempest-VolumeDependencyTests-386071043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fa0272d-51ed-4cb7-a459-f4359ea7cbdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:53:23 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-c2d916e6-7b04-4005-89da-2344e85b95f0 tempest-VolumeDependencyTests-386071043 None] Volume volume-26276f85-a9f6-40c2-acf9-94b7010eed5b (26276f85-a9f6-40c2-acf9-94b7010eed5b): created successfully Jun 17 05:53:23 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c2d916e6-7b04-4005-89da-2344e85b95f0 tempest-VolumeDependencyTests-386071043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fa0272d-51ed-4cb7-a459-f4359ea7cbdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:53:23 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c2d916e6-7b04-4005-89da-2344e85b95f0 tempest-VolumeDependencyTests-386071043 None] Flow 'volume_create_manager' (d67b233d-ad20-4b6d-a23d-da8a75b56f80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:53:23 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:23 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-c2d916e6-7b04-4005-89da-2344e85b95f0 tempest-VolumeDependencyTests-386071043 None] Created volume successfully. Jun 17 05:53:23 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-7900b147-b708-4857-b21f-5c8528601b3e tempest-VolumesActionsTest-2019259401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0c77bb13-77ab-4fd5-b47b-b77d38ec249a" returned: 0 in 0.715s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:23 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-7900b147-b708-4857-b21f-5c8528601b3e tempest-VolumesActionsTest-2019259401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0c77bb13-77ab-4fd5-b47b-b77d38ec249a {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:23 devstack sudo[106059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0c77bb13-77ab-4fd5-b47b-b77d38ec249a Jun 17 05:53:23 devstack sudo[106059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:23 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-137d9212-adc7-408f-88ca-8290ef3e29f8 tempest-VolumeDependencyTests-386071043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:53:23 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-137d9212-adc7-408f-88ca-8290ef3e29f8 tempest-VolumeDependencyTests-386071043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:53:23 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-137d9212-adc7-408f-88ca-8290ef3e29f8 tempest-VolumeDependencyTests-386071043 None] Creating offline snapshot 654ac342-0fd4-44b1-9701-e71719eabcc8 of volume 26276f85-a9f6-40c2-acf9-94b7010eed5b {{(pid=92083) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 17 05:53:23 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[1661c020-7bf0-4bef-afdb-2b17e0007160]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:53:23 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-137d9212-adc7-408f-88ca-8290ef3e29f8 tempest-VolumeDependencyTests-386071043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-26276f85-a9f6-40c2-acf9-94b7010eed5b {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:23 devstack sudo[106061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-26276f85-a9f6-40c2-acf9-94b7010eed5b Jun 17 05:53:23 devstack sudo[106061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:23 devstack sudo[106059]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:23 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-7900b147-b708-4857-b21f-5c8528601b3e tempest-VolumesActionsTest-2019259401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0c77bb13-77ab-4fd5-b47b-b77d38ec249a" returned: 0 in 0.615s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:23 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-7900b147-b708-4857-b21f-5c8528601b3e tempest-VolumesActionsTest-2019259401 None] Lock "cinder-quobyte-0c77bb13-77ab-4fd5-b47b-b77d38ec249a" released by "delete_volume" :: held 1.374s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:53:23 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-7900b147-b708-4857-b21f-5c8528601b3e tempest-VolumesActionsTest-2019259401 None] Created reservations ['bc9827a8-fd9a-44ad-b217-d26888aaad02', 'e90396fe-2314-4e7f-924e-b19bc020a9b9', 'd25af462-e1f4-45d3-9d99-dd2cdc4f8960', '27cdb4d2-c2aa-4705-909d-97ed0a2e2188'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:53:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-7900b147-b708-4857-b21f-5c8528601b3e tempest-VolumesActionsTest-2019259401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:53:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-7900b147-b708-4857-b21f-5c8528601b3e tempest-VolumesActionsTest-2019259401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:53:24 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-7900b147-b708-4857-b21f-5c8528601b3e tempest-VolumesActionsTest-2019259401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:53:24 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-7900b147-b708-4857-b21f-5c8528601b3e tempest-VolumesActionsTest-2019259401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:53:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-7900b147-b708-4857-b21f-5c8528601b3e tempest-VolumesActionsTest-2019259401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:53:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-7900b147-b708-4857-b21f-5c8528601b3e tempest-VolumesActionsTest-2019259401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:24 devstack sudo[106064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:53:24 devstack sudo[106064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:24 devstack sudo[106061]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-137d9212-adc7-408f-88ca-8290ef3e29f8 tempest-VolumeDependencyTests-386071043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-26276f85-a9f6-40c2-acf9-94b7010eed5b" returned: 0 in 0.723s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-137d9212-adc7-408f-88ca-8290ef3e29f8 tempest-VolumeDependencyTests-386071043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-26276f85-a9f6-40c2-acf9-94b7010eed5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-26276f85-a9f6-40c2-acf9-94b7010eed5b.654ac342-0fd4-44b1-9701-e71719eabcc8 1G {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:24 devstack sudo[106069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-26276f85-a9f6-40c2-acf9-94b7010eed5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-26276f85-a9f6-40c2-acf9-94b7010eed5b.654ac342-0fd4-44b1-9701-e71719eabcc8 1G Jun 17 05:53:24 devstack sudo[106069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:24 devstack sudo[106064]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-7900b147-b708-4857-b21f-5c8528601b3e tempest-VolumesActionsTest-2019259401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.586s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:24 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-7900b147-b708-4857-b21f-5c8528601b3e tempest-VolumesActionsTest-2019259401 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:53:24 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-7900b147-b708-4857-b21f-5c8528601b3e tempest-VolumesActionsTest-2019259401 None] Deleted volume successfully. Jun 17 05:53:24 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-7900b147-b708-4857-b21f-5c8528601b3e tempest-VolumesActionsTest-2019259401 None] Lock "cinder-0c77bb13-77ab-4fd5-b47b-b77d38ec249a-delete_volume" released by "delete_volume" :: held 2.186s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:53:25 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ea14317-040a-4034-bab5-6bc21b28c72b tempest-VolumesActionsTest-1107896766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:53:25 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6ea14317-040a-4034-bab5-6bc21b28c72b tempest-VolumesActionsTest-1107896766 None] Flow 'volume_create_manager' (2d16117c-8e59-4fba-9c9e-6a597f87afbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:53:25 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6ea14317-040a-4034-bab5-6bc21b28c72b tempest-VolumesActionsTest-1107896766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b8454f2-4f36-48fa-ad8b-98cf95df17ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:53:25 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6ea14317-040a-4034-bab5-6bc21b28c72b tempest-VolumesActionsTest-1107896766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b8454f2-4f36-48fa-ad8b-98cf95df17ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:53:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1694541323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fa3a829-8eba-47d8-887e-c6eeae00cb78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09654981722e4d16a9c750aa12b9b7b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:53:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:53:25Z,use_quota=True,user_id='5c9f4322025c417da6d2f736ae055e8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:53:25 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6ea14317-040a-4034-bab5-6bc21b28c72b tempest-VolumesActionsTest-1107896766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41f0f801-97fb-4d81-9505-6912eeed04a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:53:25 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6ea14317-040a-4034-bab5-6bc21b28c72b tempest-VolumesActionsTest-1107896766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41f0f801-97fb-4d81-9505-6912eeed04a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:53:25 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6ea14317-040a-4034-bab5-6bc21b28c72b tempest-VolumesActionsTest-1107896766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f164ca76-b791-4036-abfb-13770a44431e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:53:25 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6ea14317-040a-4034-bab5-6bc21b28c72b tempest-VolumesActionsTest-1107896766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f164ca76-b791-4036-abfb-13770a44431e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fa3a829-8eba-47d8-887e-c6eeae00cb78', 'volume_name': 'volume-9fa3a829-8eba-47d8-887e-c6eeae00cb78', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:53:25 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6ea14317-040a-4034-bab5-6bc21b28c72b tempest-VolumesActionsTest-1107896766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57e69968-f615-41b5-9666-2a1ec365c712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:53:25 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6ea14317-040a-4034-bab5-6bc21b28c72b tempest-VolumesActionsTest-1107896766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57e69968-f615-41b5-9666-2a1ec365c712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:53:25 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6ea14317-040a-4034-bab5-6bc21b28c72b tempest-VolumesActionsTest-1107896766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c38aa15-b82a-4da9-a3f3-87a43287d622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:53:25 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-6ea14317-040a-4034-bab5-6bc21b28c72b tempest-VolumesActionsTest-1107896766 None] Volume 9fa3a829-8eba-47d8-887e-c6eeae00cb78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fa3a829-8eba-47d8-887e-c6eeae00cb78', 'volume_size': 1} Jun 17 05:53:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-6ea14317-040a-4034-bab5-6bc21b28c72b tempest-VolumesActionsTest-1107896766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:53:25 devstack sudo[106069]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-137d9212-adc7-408f-88ca-8290ef3e29f8 tempest-VolumeDependencyTests-386071043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-26276f85-a9f6-40c2-acf9-94b7010eed5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-26276f85-a9f6-40c2-acf9-94b7010eed5b.654ac342-0fd4-44b1-9701-e71719eabcc8 1G" returned: 0 in 0.834s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-137d9212-adc7-408f-88ca-8290ef3e29f8 tempest-VolumeDependencyTests-386071043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26276f85-a9f6-40c2-acf9-94b7010eed5b -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-26276f85-a9f6-40c2-acf9-94b7010eed5b.654ac342-0fd4-44b1-9701-e71719eabcc8 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:25 devstack sudo[106076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26276f85-a9f6-40c2-acf9-94b7010eed5b -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-26276f85-a9f6-40c2-acf9-94b7010eed5b.654ac342-0fd4-44b1-9701-e71719eabcc8 Jun 17 05:53:25 devstack sudo[106076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:25 devstack sudo[106076]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-137d9212-adc7-408f-88ca-8290ef3e29f8 tempest-VolumeDependencyTests-386071043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26276f85-a9f6-40c2-acf9-94b7010eed5b -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-26276f85-a9f6-40c2-acf9-94b7010eed5b.654ac342-0fd4-44b1-9701-e71719eabcc8" returned: 0 in 0.619s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:25 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [None req-137d9212-adc7-408f-88ca-8290ef3e29f8 tempest-VolumeDependencyTests-386071043 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-26276f85-a9f6-40c2-acf9-94b7010eed5b.654ac342-0fd4-44b1-9701-e71719eabcc8 is being set with open permissions: ugo+rw Jun 17 05:53:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-137d9212-adc7-408f-88ca-8290ef3e29f8 tempest-VolumeDependencyTests-386071043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-26276f85-a9f6-40c2-acf9-94b7010eed5b.654ac342-0fd4-44b1-9701-e71719eabcc8 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:25 devstack sudo[106081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-26276f85-a9f6-40c2-acf9-94b7010eed5b.654ac342-0fd4-44b1-9701-e71719eabcc8 Jun 17 05:53:25 devstack sudo[106081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:26 devstack sudo[106081]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:26 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-137d9212-adc7-408f-88ca-8290ef3e29f8 tempest-VolumeDependencyTests-386071043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-26276f85-a9f6-40c2-acf9-94b7010eed5b.654ac342-0fd4-44b1-9701-e71719eabcc8" returned: 0 in 0.588s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:26 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-137d9212-adc7-408f-88ca-8290ef3e29f8 tempest-VolumeDependencyTests-386071043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-26276f85-a9f6-40c2-acf9-94b7010eed5b.info {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:26 devstack sudo[106084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-26276f85-a9f6-40c2-acf9-94b7010eed5b.info Jun 17 05:53:26 devstack sudo[106084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:27 devstack sudo[106084]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-137d9212-adc7-408f-88ca-8290ef3e29f8 tempest-VolumeDependencyTests-386071043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-26276f85-a9f6-40c2-acf9-94b7010eed5b.info" returned: 0 in 0.594s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:27 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [None req-137d9212-adc7-408f-88ca-8290ef3e29f8 tempest-VolumeDependencyTests-386071043 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-26276f85-a9f6-40c2-acf9-94b7010eed5b.info is being set with open permissions: ugo+rw Jun 17 05:53:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-137d9212-adc7-408f-88ca-8290ef3e29f8 tempest-VolumeDependencyTests-386071043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-26276f85-a9f6-40c2-acf9-94b7010eed5b.info {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:27 devstack sudo[106087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-26276f85-a9f6-40c2-acf9-94b7010eed5b.info Jun 17 05:53:27 devstack sudo[106087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:27 devstack cinder-volume[92083]: DEBUG oslo_service.periodic_task [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92083) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 05:53:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:53:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:53:27 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:53:27 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:53:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:53:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:27 devstack sudo[106090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:53:27 devstack sudo[106090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:27 devstack sudo[106087]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-137d9212-adc7-408f-88ca-8290ef3e29f8 tempest-VolumeDependencyTests-386071043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-26276f85-a9f6-40c2-acf9-94b7010eed5b.info" returned: 0 in 0.569s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-137d9212-adc7-408f-88ca-8290ef3e29f8 tempest-VolumeDependencyTests-386071043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.015s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:53:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-6ea14317-040a-4034-bab5-6bc21b28c72b tempest-VolumesActionsTest-1107896766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.486s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:53:27 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-6ea14317-040a-4034-bab5-6bc21b28c72b tempest-VolumesActionsTest-1107896766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:53:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1694541323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fa3a829-8eba-47d8-887e-c6eeae00cb78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09654981722e4d16a9c750aa12b9b7b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:53:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:53:25Z,use_quota=True,user_id='5c9f4322025c417da6d2f736ae055e8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:53:27 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-6ea14317-040a-4034-bab5-6bc21b28c72b tempest-VolumesActionsTest-1107896766 None] Creating volume 9fa3a829-8eba-47d8-887e-c6eeae00cb78 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:53:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-6ea14317-040a-4034-bab5-6bc21b28c72b tempest-VolumesActionsTest-1107896766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:53:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-6ea14317-040a-4034-bab5-6bc21b28c72b tempest-VolumesActionsTest-1107896766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:53:27 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-6ea14317-040a-4034-bab5-6bc21b28c72b tempest-VolumesActionsTest-1107896766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:53:27 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-6ea14317-040a-4034-bab5-6bc21b28c72b tempest-VolumesActionsTest-1107896766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:53:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-6ea14317-040a-4034-bab5-6bc21b28c72b tempest-VolumesActionsTest-1107896766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:53:27 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-6ea14317-040a-4034-bab5-6bc21b28c72b tempest-VolumesActionsTest-1107896766 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:53:27 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-6ea14317-040a-4034-bab5-6bc21b28c72b tempest-VolumesActionsTest-1107896766 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:53:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6ea14317-040a-4034-bab5-6bc21b28c72b tempest-VolumesActionsTest-1107896766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9fa3a829-8eba-47d8-887e-c6eeae00cb78 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:27 devstack sudo[106092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9fa3a829-8eba-47d8-887e-c6eeae00cb78 1073741824 Jun 17 05:53:27 devstack sudo[106092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:27 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-137d9212-adc7-408f-88ca-8290ef3e29f8 tempest-VolumeDependencyTests-386071043 None] Create snapshot completed successfully Jun 17 05:53:28 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-347a47b7-ce75-4604-a801-96ab086f7c5c tempest-VolumeDependencyTests-386071043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:53:28 devstack sudo[106090]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.697s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:28 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:53:28 devstack cinder-volume[92083]: DEBUG oslo_service.periodic_task [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running periodic task VolumeManager._thread_info {{(pid=92083) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 05:53:28 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] thread count: 28 {{(pid=92083) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 17 05:53:28 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] thread info: [<_MainThread(MainThread, started 133483869905024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92083) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 17 05:53:28 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-347a47b7-ce75-4604-a801-96ab086f7c5c tempest-VolumeDependencyTests-386071043 None] Flow 'volume_create_manager' (e58d0ce1-e917-440c-bc85-e55ef69744a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:53:28 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-347a47b7-ce75-4604-a801-96ab086f7c5c tempest-VolumeDependencyTests-386071043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de159acc-2de8-436e-86b6-3576a26a1230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:53:28 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-347a47b7-ce75-4604-a801-96ab086f7c5c tempest-VolumeDependencyTests-386071043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de159acc-2de8-436e-86b6-3576a26a1230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:53:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1026313847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5bf839d-4cf9-41fa-811f-28d44e8ef188,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d3049c4857d46cfafff6d2acc95dc78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:53:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=654ac342-0fd4-44b1-9701-e71719eabcc8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:53:28Z,use_quota=True,user_id='71d788de4c4c40569d2a8b133db4e3bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:53:28 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-347a47b7-ce75-4604-a801-96ab086f7c5c tempest-VolumeDependencyTests-386071043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ea09e8d-391b-4018-90f9-d01ac8158431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:53:28 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-347a47b7-ce75-4604-a801-96ab086f7c5c tempest-VolumeDependencyTests-386071043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ea09e8d-391b-4018-90f9-d01ac8158431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:53:28 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-347a47b7-ce75-4604-a801-96ab086f7c5c tempest-VolumeDependencyTests-386071043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b7810bb-28ef-4b16-a626-bcff5c724efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:53:28 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-347a47b7-ce75-4604-a801-96ab086f7c5c tempest-VolumeDependencyTests-386071043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b7810bb-28ef-4b16-a626-bcff5c724efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b5bf839d-4cf9-41fa-811f-28d44e8ef188', 'volume_name': 'volume-b5bf839d-4cf9-41fa-811f-28d44e8ef188', 'volume_size': 1, 'snapshot_id': '654ac342-0fd4-44b1-9701-e71719eabcc8'}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:53:28 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-347a47b7-ce75-4604-a801-96ab086f7c5c tempest-VolumeDependencyTests-386071043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e761bbae-ae7a-4522-919a-6ac6c35a5665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:53:28 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-347a47b7-ce75-4604-a801-96ab086f7c5c tempest-VolumeDependencyTests-386071043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e761bbae-ae7a-4522-919a-6ac6c35a5665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:53:28 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-347a47b7-ce75-4604-a801-96ab086f7c5c tempest-VolumeDependencyTests-386071043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba6c2819-d18d-4073-8ff0-bc84c7c49115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:53:28 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-347a47b7-ce75-4604-a801-96ab086f7c5c tempest-VolumeDependencyTests-386071043 None] Volume b5bf839d-4cf9-41fa-811f-28d44e8ef188: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b5bf839d-4cf9-41fa-811f-28d44e8ef188', 'volume_size': 1, 'snapshot_id': '654ac342-0fd4-44b1-9701-e71719eabcc8'} Jun 17 05:53:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-347a47b7-ce75-4604-a801-96ab086f7c5c tempest-VolumeDependencyTests-386071043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:53:28 devstack sudo[106092]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6ea14317-040a-4034-bab5-6bc21b28c72b tempest-VolumesActionsTest-1107896766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9fa3a829-8eba-47d8-887e-c6eeae00cb78 1073741824" returned: 0 in 0.798s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6ea14317-040a-4034-bab5-6bc21b28c72b tempest-VolumesActionsTest-1107896766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9fa3a829-8eba-47d8-887e-c6eeae00cb78 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:28 devstack sudo[106100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9fa3a829-8eba-47d8-887e-c6eeae00cb78 Jun 17 05:53:28 devstack sudo[106100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:29 devstack sudo[106100]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:29 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6ea14317-040a-4034-bab5-6bc21b28c72b tempest-VolumesActionsTest-1107896766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9fa3a829-8eba-47d8-887e-c6eeae00cb78" returned: 0 in 0.599s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:29 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-6ea14317-040a-4034-bab5-6bc21b28c72b tempest-VolumesActionsTest-1107896766 None] <== create_volume: return (1433ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:53:29 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-6ea14317-040a-4034-bab5-6bc21b28c72b tempest-VolumesActionsTest-1107896766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.436s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:53:29 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-347a47b7-ce75-4604-a801-96ab086f7c5c tempest-VolumeDependencyTests-386071043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.723s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:53:29 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-347a47b7-ce75-4604-a801-96ab086f7c5c tempest-VolumeDependencyTests-386071043 None] Acquiring lock "cinder-quobyte-654ac342-0fd4-44b1-9701-e71719eabcc8-b5bf839d-4cf9-41fa-811f-28d44e8ef188" by "_create_volume_from_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:53:29 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6ea14317-040a-4034-bab5-6bc21b28c72b tempest-VolumesActionsTest-1107896766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c38aa15-b82a-4da9-a3f3-87a43287d622) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fa3a829-8eba-47d8-887e-c6eeae00cb78', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:53:29 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6ea14317-040a-4034-bab5-6bc21b28c72b tempest-VolumesActionsTest-1107896766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (449939ae-02c0-4aa5-92b7-1e2eee998d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:53:29 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-347a47b7-ce75-4604-a801-96ab086f7c5c tempest-VolumeDependencyTests-386071043 None] Lock "cinder-quobyte-654ac342-0fd4-44b1-9701-e71719eabcc8-b5bf839d-4cf9-41fa-811f-28d44e8ef188" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:53:29 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-347a47b7-ce75-4604-a801-96ab086f7c5c tempest-VolumeDependencyTests-386071043 None] Creating volume b5bf839d-4cf9-41fa-811f-28d44e8ef188 from snapshot 654ac342-0fd4-44b1-9701-e71719eabcc8 {{(pid=92083) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 17 05:53:29 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-347a47b7-ce75-4604-a801-96ab086f7c5c tempest-VolumeDependencyTests-386071043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:53:29 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-347a47b7-ce75-4604-a801-96ab086f7c5c tempest-VolumeDependencyTests-386071043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:53:29 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-347a47b7-ce75-4604-a801-96ab086f7c5c tempest-VolumeDependencyTests-386071043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:53:29 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-347a47b7-ce75-4604-a801-96ab086f7c5c tempest-VolumeDependencyTests-386071043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:53:29 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-347a47b7-ce75-4604-a801-96ab086f7c5c tempest-VolumeDependencyTests-386071043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:53:29 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-347a47b7-ce75-4604-a801-96ab086f7c5c tempest-VolumeDependencyTests-386071043 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:53:29 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-347a47b7-ce75-4604-a801-96ab086f7c5c tempest-VolumeDependencyTests-386071043 None] Acquiring lock "cinder-quobyte-b5bf839d-4cf9-41fa-811f-28d44e8ef188" by "_copy_volume_from_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:53:29 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-6ea14317-040a-4034-bab5-6bc21b28c72b tempest-VolumesActionsTest-1107896766 None] Volume volume-9fa3a829-8eba-47d8-887e-c6eeae00cb78 (9fa3a829-8eba-47d8-887e-c6eeae00cb78): created successfully Jun 17 05:53:29 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6ea14317-040a-4034-bab5-6bc21b28c72b tempest-VolumesActionsTest-1107896766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (449939ae-02c0-4aa5-92b7-1e2eee998d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:53:29 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6ea14317-040a-4034-bab5-6bc21b28c72b tempest-VolumesActionsTest-1107896766 None] Flow 'volume_create_manager' (2d16117c-8e59-4fba-9c9e-6a597f87afbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:53:29 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-347a47b7-ce75-4604-a801-96ab086f7c5c tempest-VolumeDependencyTests-386071043 None] Lock "cinder-quobyte-b5bf839d-4cf9-41fa-811f-28d44e8ef188" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:53:29 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-347a47b7-ce75-4604-a801-96ab086f7c5c tempest-VolumeDependencyTests-386071043 None] snapshot: 654ac342-0fd4-44b1-9701-e71719eabcc8, volume: b5bf839d-4cf9-41fa-811f-28d44e8ef188, {{(pid=92083) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 17 05:53:29 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-6ea14317-040a-4034-bab5-6bc21b28c72b tempest-VolumesActionsTest-1107896766 None] Created volume successfully. Jun 17 05:53:29 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-347a47b7-ce75-4604-a801-96ab086f7c5c tempest-VolumeDependencyTests-386071043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:53:29 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-347a47b7-ce75-4604-a801-96ab086f7c5c tempest-VolumeDependencyTests-386071043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:53:29 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-347a47b7-ce75-4604-a801-96ab086f7c5c tempest-VolumeDependencyTests-386071043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:53:29 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-347a47b7-ce75-4604-a801-96ab086f7c5c tempest-VolumeDependencyTests-386071043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:53:29 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-347a47b7-ce75-4604-a801-96ab086f7c5c tempest-VolumeDependencyTests-386071043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:53:29 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[64eef2bd-3929-4461-b005-b3195af9ac8a]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:53:29 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-347a47b7-ce75-4604-a801-96ab086f7c5c tempest-VolumeDependencyTests-386071043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-26276f85-a9f6-40c2-acf9-94b7010eed5b.654ac342-0fd4-44b1-9701-e71719eabcc8 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:29 devstack sudo[106104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-26276f85-a9f6-40c2-acf9-94b7010eed5b.654ac342-0fd4-44b1-9701-e71719eabcc8 Jun 17 05:53:29 devstack sudo[106104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:29 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-e1d743ed-17a6-449b-afe7-128f4ea3b214 tempest-VolumesActionsTest-2019259401 None] Acquiring lock "cinder-9fa3a829-8eba-47d8-887e-c6eeae00cb78-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:53:29 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-e1d743ed-17a6-449b-afe7-128f4ea3b214 tempest-VolumesActionsTest-2019259401 None] Lock "cinder-9fa3a829-8eba-47d8-887e-c6eeae00cb78-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:53:29 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-e1d743ed-17a6-449b-afe7-128f4ea3b214 tempest-VolumesActionsTest-2019259401 None] Acquiring lock "cinder-quobyte-9fa3a829-8eba-47d8-887e-c6eeae00cb78" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:53:29 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-e1d743ed-17a6-449b-afe7-128f4ea3b214 tempest-VolumesActionsTest-2019259401 None] Lock "cinder-quobyte-9fa3a829-8eba-47d8-887e-c6eeae00cb78" acquired by "delete_volume" :: waited 0.022s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:53:29 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f3a0e9-cdcc-4a91-b23c-249c2d6c0e76]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:53:29 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e1d743ed-17a6-449b-afe7-128f4ea3b214 tempest-VolumesActionsTest-2019259401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9fa3a829-8eba-47d8-887e-c6eeae00cb78 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:29 devstack sudo[106106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9fa3a829-8eba-47d8-887e-c6eeae00cb78 Jun 17 05:53:29 devstack sudo[106106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:30 devstack sudo[106104]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:30 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-347a47b7-ce75-4604-a801-96ab086f7c5c tempest-VolumeDependencyTests-386071043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-26276f85-a9f6-40c2-acf9-94b7010eed5b.654ac342-0fd4-44b1-9701-e71719eabcc8" returned: 0 in 0.755s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:30 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-347a47b7-ce75-4604-a801-96ab086f7c5c tempest-VolumeDependencyTests-386071043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26276f85-a9f6-40c2-acf9-94b7010eed5b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92083) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 05:53:30 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-347a47b7-ce75-4604-a801-96ab086f7c5c tempest-VolumeDependencyTests-386071043 None] will copy from snapshot at /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-26276f85-a9f6-40c2-acf9-94b7010eed5b {{(pid=92083) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 17 05:53:30 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-347a47b7-ce75-4604-a801-96ab086f7c5c tempest-VolumeDependencyTests-386071043 None] Creating direct copy from snapshot {{(pid=92083) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 17 05:53:30 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa452633-fc0a-45e4-aa77-aea5a2b5782e]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:53:30 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-347a47b7-ce75-4604-a801-96ab086f7c5c tempest-VolumeDependencyTests-386071043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-26276f85-a9f6-40c2-acf9-94b7010eed5b {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:30 devstack sudo[106111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-26276f85-a9f6-40c2-acf9-94b7010eed5b Jun 17 05:53:30 devstack sudo[106111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:30 devstack sudo[106106]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:30 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e1d743ed-17a6-449b-afe7-128f4ea3b214 tempest-VolumesActionsTest-2019259401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9fa3a829-8eba-47d8-887e-c6eeae00cb78" returned: 0 in 0.735s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:30 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e1d743ed-17a6-449b-afe7-128f4ea3b214 tempest-VolumesActionsTest-2019259401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9fa3a829-8eba-47d8-887e-c6eeae00cb78 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:30 devstack sudo[106116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9fa3a829-8eba-47d8-887e-c6eeae00cb78 Jun 17 05:53:30 devstack sudo[106116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:30 devstack sudo[106111]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:30 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-347a47b7-ce75-4604-a801-96ab086f7c5c tempest-VolumeDependencyTests-386071043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-26276f85-a9f6-40c2-acf9-94b7010eed5b" returned: 0 in 0.750s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:30 devstack cinder-volume[92083]: DEBUG cinder.utils [None req-347a47b7-ce75-4604-a801-96ab086f7c5c tempest-VolumeDependencyTests-386071043 None] Path /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b5bf839d-4cf9-41fa-811f-28d44e8ef188 not found in is_blk_device check {{(pid=92083) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 17 05:53:30 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-347a47b7-ce75-4604-a801-96ab086f7c5c tempest-VolumeDependencyTests-386071043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-26276f85-a9f6-40c2-acf9-94b7010eed5b /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b5bf839d-4cf9-41fa-811f-28d44e8ef188 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:30 devstack sudo[106121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-26276f85-a9f6-40c2-acf9-94b7010eed5b /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b5bf839d-4cf9-41fa-811f-28d44e8ef188 Jun 17 05:53:30 devstack sudo[106121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:31 devstack sudo[106116]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:31 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e1d743ed-17a6-449b-afe7-128f4ea3b214 tempest-VolumesActionsTest-2019259401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9fa3a829-8eba-47d8-887e-c6eeae00cb78" returned: 0 in 0.623s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:31 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-e1d743ed-17a6-449b-afe7-128f4ea3b214 tempest-VolumesActionsTest-2019259401 None] Lock "cinder-quobyte-9fa3a829-8eba-47d8-887e-c6eeae00cb78" released by "delete_volume" :: held 1.406s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:53:31 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-e1d743ed-17a6-449b-afe7-128f4ea3b214 tempest-VolumesActionsTest-2019259401 None] Created reservations ['8b565ab8-189f-4e90-9a3a-f1dabd393304', '50fd83f7-4d00-4c2c-9be6-07ad60b149f7', '9a5a5023-6302-4a8d-b321-b21c292849be', '0cc067c5-f825-4e3f-bfaa-72fc8467213d'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:53:31 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e1d743ed-17a6-449b-afe7-128f4ea3b214 tempest-VolumesActionsTest-2019259401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:53:31 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e1d743ed-17a6-449b-afe7-128f4ea3b214 tempest-VolumesActionsTest-2019259401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:53:31 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-e1d743ed-17a6-449b-afe7-128f4ea3b214 tempest-VolumesActionsTest-2019259401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:53:31 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-e1d743ed-17a6-449b-afe7-128f4ea3b214 tempest-VolumesActionsTest-2019259401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:53:31 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e1d743ed-17a6-449b-afe7-128f4ea3b214 tempest-VolumesActionsTest-2019259401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:53:31 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e1d743ed-17a6-449b-afe7-128f4ea3b214 tempest-VolumesActionsTest-2019259401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:31 devstack sudo[106160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:53:31 devstack sudo[106160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:32 devstack sudo[106160]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:32 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e1d743ed-17a6-449b-afe7-128f4ea3b214 tempest-VolumesActionsTest-2019259401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 1.283s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:32 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-e1d743ed-17a6-449b-afe7-128f4ea3b214 tempest-VolumesActionsTest-2019259401 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:53:32 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-e1d743ed-17a6-449b-afe7-128f4ea3b214 tempest-VolumesActionsTest-2019259401 None] Deleted volume successfully. Jun 17 05:53:32 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-e1d743ed-17a6-449b-afe7-128f4ea3b214 tempest-VolumesActionsTest-2019259401 None] Lock "cinder-9fa3a829-8eba-47d8-887e-c6eeae00cb78-delete_volume" released by "delete_volume" :: held 2.957s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:53:33 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1d95a99-6797-42ea-903b-aacca2da41e9 tempest-VolumesActionsTest-1107896766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:53:33 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b1d95a99-6797-42ea-903b-aacca2da41e9 tempest-VolumesActionsTest-1107896766 None] Flow 'volume_create_manager' (8e8b547b-0afe-4069-bbb9-a6d88d0d9218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:53:33 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b1d95a99-6797-42ea-903b-aacca2da41e9 tempest-VolumesActionsTest-1107896766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f6cc2c3-2595-46f9-abc3-7abe70dc4d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:53:33 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b1d95a99-6797-42ea-903b-aacca2da41e9 tempest-VolumesActionsTest-1107896766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f6cc2c3-2595-46f9-abc3-7abe70dc4d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:53:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-532743076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8699dd54-95f6-4ef3-971f-879106948a1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09654981722e4d16a9c750aa12b9b7b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:53:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:53:33Z,use_quota=True,user_id='5c9f4322025c417da6d2f736ae055e8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:53:33 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b1d95a99-6797-42ea-903b-aacca2da41e9 tempest-VolumesActionsTest-1107896766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6e8caa2-cf31-4e76-8beb-87c9de957938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:53:33 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b1d95a99-6797-42ea-903b-aacca2da41e9 tempest-VolumesActionsTest-1107896766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6e8caa2-cf31-4e76-8beb-87c9de957938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:53:33 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b1d95a99-6797-42ea-903b-aacca2da41e9 tempest-VolumesActionsTest-1107896766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70fd1dc5-0cf5-4c44-86f3-6eb25dd2f823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:53:33 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b1d95a99-6797-42ea-903b-aacca2da41e9 tempest-VolumesActionsTest-1107896766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70fd1dc5-0cf5-4c44-86f3-6eb25dd2f823) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8699dd54-95f6-4ef3-971f-879106948a1d', 'volume_name': 'volume-8699dd54-95f6-4ef3-971f-879106948a1d', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:53:33 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b1d95a99-6797-42ea-903b-aacca2da41e9 tempest-VolumesActionsTest-1107896766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eae17d36-55a5-46bf-a947-60240c4fc5c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:53:33 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b1d95a99-6797-42ea-903b-aacca2da41e9 tempest-VolumesActionsTest-1107896766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eae17d36-55a5-46bf-a947-60240c4fc5c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:53:33 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b1d95a99-6797-42ea-903b-aacca2da41e9 tempest-VolumesActionsTest-1107896766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1f1b39d-f563-44a1-8378-0f2f2117fbe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:53:33 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-b1d95a99-6797-42ea-903b-aacca2da41e9 tempest-VolumesActionsTest-1107896766 None] Volume 8699dd54-95f6-4ef3-971f-879106948a1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8699dd54-95f6-4ef3-971f-879106948a1d', 'volume_size': 1} Jun 17 05:53:33 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-b1d95a99-6797-42ea-903b-aacca2da41e9 tempest-VolumesActionsTest-1107896766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:53:35 devstack sudo[106121]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:35 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-347a47b7-ce75-4604-a801-96ab086f7c5c tempest-VolumeDependencyTests-386071043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-26276f85-a9f6-40c2-acf9-94b7010eed5b /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b5bf839d-4cf9-41fa-811f-28d44e8ef188" returned: 0 in 4.889s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:35 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[49278328-9642-4973-be06-6958ef707d3f]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:53:35 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-347a47b7-ce75-4604-a801-96ab086f7c5c tempest-VolumeDependencyTests-386071043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-26276f85-a9f6-40c2-acf9-94b7010eed5b {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:35 devstack sudo[106176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-26276f85-a9f6-40c2-acf9-94b7010eed5b Jun 17 05:53:35 devstack sudo[106176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:36 devstack sudo[106176]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:36 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-347a47b7-ce75-4604-a801-96ab086f7c5c tempest-VolumeDependencyTests-386071043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-26276f85-a9f6-40c2-acf9-94b7010eed5b" returned: 0 in 0.869s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:36 devstack cinder-volume[92083]: DEBUG cinder.image.image_utils [None req-347a47b7-ce75-4604-a801-96ab086f7c5c tempest-VolumeDependencyTests-386071043 None] Image conversion details: src /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-26276f85-a9f6-40c2-acf9-94b7010eed5b, size 1024.00 MB, duration 4.89 sec, destination /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b5bf839d-4cf9-41fa-811f-28d44e8ef188 {{(pid=92083) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 17 05:53:36 devstack cinder-volume[92083]: INFO cinder.image.image_utils [None req-347a47b7-ce75-4604-a801-96ab086f7c5c tempest-VolumeDependencyTests-386071043 None] Converted 1024.00 MB image at 209.43 MB/s Jun 17 05:53:36 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [None req-347a47b7-ce75-4604-a801-96ab086f7c5c tempest-VolumeDependencyTests-386071043 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b5bf839d-4cf9-41fa-811f-28d44e8ef188 is being set with open permissions: ugo+rw Jun 17 05:53:36 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-347a47b7-ce75-4604-a801-96ab086f7c5c tempest-VolumeDependencyTests-386071043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b5bf839d-4cf9-41fa-811f-28d44e8ef188 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:36 devstack sudo[106181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b5bf839d-4cf9-41fa-811f-28d44e8ef188 Jun 17 05:53:36 devstack sudo[106181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:37 devstack sudo[106181]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:37 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-347a47b7-ce75-4604-a801-96ab086f7c5c tempest-VolumeDependencyTests-386071043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b5bf839d-4cf9-41fa-811f-28d44e8ef188" returned: 0 in 0.571s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:37 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-347a47b7-ce75-4604-a801-96ab086f7c5c tempest-VolumeDependencyTests-386071043 None] Lock "cinder-quobyte-b5bf839d-4cf9-41fa-811f-28d44e8ef188" released by "_copy_volume_from_snapshot" :: held 7.932s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:53:37 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-347a47b7-ce75-4604-a801-96ab086f7c5c tempest-VolumeDependencyTests-386071043 None] Lock "cinder-quobyte-654ac342-0fd4-44b1-9701-e71719eabcc8-b5bf839d-4cf9-41fa-811f-28d44e8ef188" released by "_create_volume_from_snapshot" :: held 7.973s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:53:37 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-347a47b7-ce75-4604-a801-96ab086f7c5c tempest-VolumeDependencyTests-386071043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.004s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:53:37 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-b1d95a99-6797-42ea-903b-aacca2da41e9 tempest-VolumesActionsTest-1107896766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.841s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:53:37 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-b1d95a99-6797-42ea-903b-aacca2da41e9 tempest-VolumesActionsTest-1107896766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:53:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-532743076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8699dd54-95f6-4ef3-971f-879106948a1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09654981722e4d16a9c750aa12b9b7b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:53:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:53:33Z,use_quota=True,user_id='5c9f4322025c417da6d2f736ae055e8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:53:37 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-b1d95a99-6797-42ea-903b-aacca2da41e9 tempest-VolumesActionsTest-1107896766 None] Creating volume 8699dd54-95f6-4ef3-971f-879106948a1d {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:53:37 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-b1d95a99-6797-42ea-903b-aacca2da41e9 tempest-VolumesActionsTest-1107896766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:53:37 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-b1d95a99-6797-42ea-903b-aacca2da41e9 tempest-VolumesActionsTest-1107896766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:53:37 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-b1d95a99-6797-42ea-903b-aacca2da41e9 tempest-VolumesActionsTest-1107896766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:53:37 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-b1d95a99-6797-42ea-903b-aacca2da41e9 tempest-VolumesActionsTest-1107896766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:53:37 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-b1d95a99-6797-42ea-903b-aacca2da41e9 tempest-VolumesActionsTest-1107896766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:53:37 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-b1d95a99-6797-42ea-903b-aacca2da41e9 tempest-VolumesActionsTest-1107896766 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:53:37 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-b1d95a99-6797-42ea-903b-aacca2da41e9 tempest-VolumesActionsTest-1107896766 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:53:37 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b1d95a99-6797-42ea-903b-aacca2da41e9 tempest-VolumesActionsTest-1107896766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-8699dd54-95f6-4ef3-971f-879106948a1d 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:37 devstack sudo[106184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-8699dd54-95f6-4ef3-971f-879106948a1d 1073741824 Jun 17 05:53:37 devstack sudo[106184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:37 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-347a47b7-ce75-4604-a801-96ab086f7c5c tempest-VolumeDependencyTests-386071043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba6c2819-d18d-4073-8ff0-bc84c7c49115) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5bf839d-4cf9-41fa-811f-28d44e8ef188', 'volume_size': 1, 'snapshot_id': '654ac342-0fd4-44b1-9701-e71719eabcc8'}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:53:37 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-347a47b7-ce75-4604-a801-96ab086f7c5c tempest-VolumeDependencyTests-386071043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b106d699-b73e-45e8-81b6-75ab575f5751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:53:37 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-347a47b7-ce75-4604-a801-96ab086f7c5c tempest-VolumeDependencyTests-386071043 None] Volume volume-b5bf839d-4cf9-41fa-811f-28d44e8ef188 (b5bf839d-4cf9-41fa-811f-28d44e8ef188): created successfully Jun 17 05:53:37 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-347a47b7-ce75-4604-a801-96ab086f7c5c tempest-VolumeDependencyTests-386071043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b106d699-b73e-45e8-81b6-75ab575f5751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:53:37 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-347a47b7-ce75-4604-a801-96ab086f7c5c tempest-VolumeDependencyTests-386071043 None] Flow 'volume_create_manager' (e58d0ce1-e917-440c-bc85-e55ef69744a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:53:37 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-347a47b7-ce75-4604-a801-96ab086f7c5c tempest-VolumeDependencyTests-386071043 None] Created volume successfully. Jun 17 05:53:37 devstack sudo[106184]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:37 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b1d95a99-6797-42ea-903b-aacca2da41e9 tempest-VolumesActionsTest-1107896766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-8699dd54-95f6-4ef3-971f-879106948a1d 1073741824" returned: 0 in 0.737s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:37 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b1d95a99-6797-42ea-903b-aacca2da41e9 tempest-VolumesActionsTest-1107896766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-8699dd54-95f6-4ef3-971f-879106948a1d {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:37 devstack sudo[106189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-8699dd54-95f6-4ef3-971f-879106948a1d Jun 17 05:53:37 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:38 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-f8202e83-0a8c-404a-a29d-7e7b56564017 tempest-VolumeDependencyTests-386071043 None] Acquiring lock "cinder-654ac342-0fd4-44b1-9701-e71719eabcc8-delete_snapshot" by "delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:53:38 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-f8202e83-0a8c-404a-a29d-7e7b56564017 tempest-VolumeDependencyTests-386071043 None] Lock "cinder-654ac342-0fd4-44b1-9701-e71719eabcc8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:53:38 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-f8202e83-0a8c-404a-a29d-7e7b56564017 tempest-VolumeDependencyTests-386071043 None] Acquiring lock "cinder-quobyte-26276f85-a9f6-40c2-acf9-94b7010eed5b" by "delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:53:38 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-f8202e83-0a8c-404a-a29d-7e7b56564017 tempest-VolumeDependencyTests-386071043 None] Lock "cinder-quobyte-26276f85-a9f6-40c2-acf9-94b7010eed5b" acquired by "delete_snapshot" :: waited 0.016s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:53:38 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-f8202e83-0a8c-404a-a29d-7e7b56564017 tempest-VolumeDependencyTests-386071043 None] Acquiring lock "cinder-quobyte-654ac342-0fd4-44b1-9701-e71719eabcc8" by "_delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:53:38 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-f8202e83-0a8c-404a-a29d-7e7b56564017 tempest-VolumeDependencyTests-386071043 None] Lock "cinder-quobyte-654ac342-0fd4-44b1-9701-e71719eabcc8" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:53:38 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-f8202e83-0a8c-404a-a29d-7e7b56564017 tempest-VolumeDependencyTests-386071043 None] Deleting offline snapshot 654ac342-0fd4-44b1-9701-e71719eabcc8 of volume 26276f85-a9f6-40c2-acf9-94b7010eed5b {{(pid=92083) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 17 05:53:38 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-f8202e83-0a8c-404a-a29d-7e7b56564017 tempest-VolumeDependencyTests-386071043 None] snapshot_file for this snap is: volume-26276f85-a9f6-40c2-acf9-94b7010eed5b.654ac342-0fd4-44b1-9701-e71719eabcc8 {{(pid=92083) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 17 05:53:38 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[7008d39f-22ec-4eff-847a-7e05eb03ce9e]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:53:38 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f8202e83-0a8c-404a-a29d-7e7b56564017 tempest-VolumeDependencyTests-386071043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-26276f85-a9f6-40c2-acf9-94b7010eed5b.654ac342-0fd4-44b1-9701-e71719eabcc8 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:38 devstack sudo[106191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-26276f85-a9f6-40c2-acf9-94b7010eed5b.654ac342-0fd4-44b1-9701-e71719eabcc8 Jun 17 05:53:38 devstack sudo[106191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:38 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:38 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b1d95a99-6797-42ea-903b-aacca2da41e9 tempest-VolumesActionsTest-1107896766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-8699dd54-95f6-4ef3-971f-879106948a1d" returned: 0 in 0.575s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:38 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-b1d95a99-6797-42ea-903b-aacca2da41e9 tempest-VolumesActionsTest-1107896766 None] <== create_volume: return (1351ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:53:38 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-b1d95a99-6797-42ea-903b-aacca2da41e9 tempest-VolumesActionsTest-1107896766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.354s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:53:38 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b1d95a99-6797-42ea-903b-aacca2da41e9 tempest-VolumesActionsTest-1107896766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1f1b39d-f563-44a1-8378-0f2f2117fbe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8699dd54-95f6-4ef3-971f-879106948a1d', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:53:38 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b1d95a99-6797-42ea-903b-aacca2da41e9 tempest-VolumesActionsTest-1107896766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (720b39ed-1491-45e3-b84e-4aa0c0a09933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:53:38 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-b1d95a99-6797-42ea-903b-aacca2da41e9 tempest-VolumesActionsTest-1107896766 None] Volume volume-8699dd54-95f6-4ef3-971f-879106948a1d (8699dd54-95f6-4ef3-971f-879106948a1d): created successfully Jun 17 05:53:38 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b1d95a99-6797-42ea-903b-aacca2da41e9 tempest-VolumesActionsTest-1107896766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (720b39ed-1491-45e3-b84e-4aa0c0a09933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:53:38 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b1d95a99-6797-42ea-903b-aacca2da41e9 tempest-VolumesActionsTest-1107896766 None] Flow 'volume_create_manager' (8e8b547b-0afe-4069-bbb9-a6d88d0d9218) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:53:38 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-b1d95a99-6797-42ea-903b-aacca2da41e9 tempest-VolumesActionsTest-1107896766 None] Created volume successfully. Jun 17 05:53:38 devstack sudo[106191]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:38 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f8202e83-0a8c-404a-a29d-7e7b56564017 tempest-VolumeDependencyTests-386071043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-26276f85-a9f6-40c2-acf9-94b7010eed5b.654ac342-0fd4-44b1-9701-e71719eabcc8" returned: 0 in 0.722s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:38 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-f8202e83-0a8c-404a-a29d-7e7b56564017 tempest-VolumeDependencyTests-386071043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26276f85-a9f6-40c2-acf9-94b7010eed5b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92083) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 05:53:38 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[4393fca9-bdd5-4511-bdb0-e6038c6346ef]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:53:38 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f8202e83-0a8c-404a-a29d-7e7b56564017 tempest-VolumeDependencyTests-386071043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-26276f85-a9f6-40c2-acf9-94b7010eed5b {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:39 devstack sudo[106197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-26276f85-a9f6-40c2-acf9-94b7010eed5b Jun 17 05:53:39 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:39 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f8202e83-0a8c-404a-a29d-7e7b56564017 tempest-VolumeDependencyTests-386071043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-26276f85-a9f6-40c2-acf9-94b7010eed5b" returned: 0 in 0.668s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f8202e83-0a8c-404a-a29d-7e7b56564017 tempest-VolumeDependencyTests-386071043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-26276f85-a9f6-40c2-acf9-94b7010eed5b.654ac342-0fd4-44b1-9701-e71719eabcc8 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:39 devstack sudo[106203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-26276f85-a9f6-40c2-acf9-94b7010eed5b.654ac342-0fd4-44b1-9701-e71719eabcc8 Jun 17 05:53:39 devstack sudo[106203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:39 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-eec18e9c-c52e-4da4-828f-dd45f583e179 tempest-VolumesActionsTest-2019259401 None] Acquiring lock "cinder-8699dd54-95f6-4ef3-971f-879106948a1d-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:53:39 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-eec18e9c-c52e-4da4-828f-dd45f583e179 tempest-VolumesActionsTest-2019259401 None] Lock "cinder-8699dd54-95f6-4ef3-971f-879106948a1d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:53:39 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-eec18e9c-c52e-4da4-828f-dd45f583e179 tempest-VolumesActionsTest-2019259401 None] Acquiring lock "cinder-quobyte-8699dd54-95f6-4ef3-971f-879106948a1d" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:53:39 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-eec18e9c-c52e-4da4-828f-dd45f583e179 tempest-VolumesActionsTest-2019259401 None] Lock "cinder-quobyte-8699dd54-95f6-4ef3-971f-879106948a1d" acquired by "delete_volume" :: waited 0.019s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:53:39 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b30a1d-2fbe-4fd2-ad57-77c44ba6fa53]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:53:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-eec18e9c-c52e-4da4-828f-dd45f583e179 tempest-VolumesActionsTest-2019259401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-8699dd54-95f6-4ef3-971f-879106948a1d {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:40 devstack sudo[106205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-8699dd54-95f6-4ef3-971f-879106948a1d Jun 17 05:53:40 devstack sudo[106205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:40 devstack sudo[106203]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:40 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f8202e83-0a8c-404a-a29d-7e7b56564017 tempest-VolumeDependencyTests-386071043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-26276f85-a9f6-40c2-acf9-94b7010eed5b.654ac342-0fd4-44b1-9701-e71719eabcc8" returned: 0 in 0.691s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:40 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f8202e83-0a8c-404a-a29d-7e7b56564017 tempest-VolumeDependencyTests-386071043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-26276f85-a9f6-40c2-acf9-94b7010eed5b.654ac342-0fd4-44b1-9701-e71719eabcc8 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:40 devstack sudo[106210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-26276f85-a9f6-40c2-acf9-94b7010eed5b.654ac342-0fd4-44b1-9701-e71719eabcc8 Jun 17 05:53:40 devstack sudo[106210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:40 devstack sudo[106205]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:40 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-eec18e9c-c52e-4da4-828f-dd45f583e179 tempest-VolumesActionsTest-2019259401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-8699dd54-95f6-4ef3-971f-879106948a1d" returned: 0 in 0.725s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:40 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-eec18e9c-c52e-4da4-828f-dd45f583e179 tempest-VolumesActionsTest-2019259401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-8699dd54-95f6-4ef3-971f-879106948a1d {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:40 devstack sudo[106215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-8699dd54-95f6-4ef3-971f-879106948a1d Jun 17 05:53:40 devstack sudo[106215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:40 devstack sudo[106210]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:40 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f8202e83-0a8c-404a-a29d-7e7b56564017 tempest-VolumeDependencyTests-386071043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-26276f85-a9f6-40c2-acf9-94b7010eed5b.654ac342-0fd4-44b1-9701-e71719eabcc8" returned: 0 in 0.584s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:40 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-f8202e83-0a8c-404a-a29d-7e7b56564017 tempest-VolumeDependencyTests-386071043 None] Lock "cinder-quobyte-654ac342-0fd4-44b1-9701-e71719eabcc8" released by "_delete_snapshot" :: held 2.770s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:53:40 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-f8202e83-0a8c-404a-a29d-7e7b56564017 tempest-VolumeDependencyTests-386071043 None] Lock "cinder-quobyte-26276f85-a9f6-40c2-acf9-94b7010eed5b" released by "delete_snapshot" :: held 2.793s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:53:40 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-f8202e83-0a8c-404a-a29d-7e7b56564017 tempest-VolumeDependencyTests-386071043 None] Created reservations ['dc258406-d6ee-4b3b-b076-6c56d7467f2b', 'b40b4dcb-80a5-4494-bee1-a4463054da73', 'a3124867-4823-4f0f-bbd4-1cb376a7a856', '48067e49-a743-4904-8b40-d50e1ec30f84'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:53:41 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-f8202e83-0a8c-404a-a29d-7e7b56564017 tempest-VolumeDependencyTests-386071043 None] Delete snapshot completed successfully. Jun 17 05:53:41 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-f8202e83-0a8c-404a-a29d-7e7b56564017 tempest-VolumeDependencyTests-386071043 None] Lock "cinder-654ac342-0fd4-44b1-9701-e71719eabcc8-delete_snapshot" released by "delete_snapshot" :: held 2.936s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:53:41 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-e97a3889-36a8-42e0-8608-5e282b431db8 tempest-VolumeDependencyTests-386071043 None] Acquiring lock "cinder-26276f85-a9f6-40c2-acf9-94b7010eed5b-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:53:41 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-e97a3889-36a8-42e0-8608-5e282b431db8 tempest-VolumeDependencyTests-386071043 None] Lock "cinder-26276f85-a9f6-40c2-acf9-94b7010eed5b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:53:41 devstack sudo[106215]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:41 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-eec18e9c-c52e-4da4-828f-dd45f583e179 tempest-VolumesActionsTest-2019259401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-8699dd54-95f6-4ef3-971f-879106948a1d" returned: 0 in 0.609s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:41 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-eec18e9c-c52e-4da4-828f-dd45f583e179 tempest-VolumesActionsTest-2019259401 None] Lock "cinder-quobyte-8699dd54-95f6-4ef3-971f-879106948a1d" released by "delete_volume" :: held 1.380s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:53:41 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-e97a3889-36a8-42e0-8608-5e282b431db8 tempest-VolumeDependencyTests-386071043 None] Acquiring lock "cinder-quobyte-26276f85-a9f6-40c2-acf9-94b7010eed5b" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:53:41 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-e97a3889-36a8-42e0-8608-5e282b431db8 tempest-VolumeDependencyTests-386071043 None] Lock "cinder-quobyte-26276f85-a9f6-40c2-acf9-94b7010eed5b" acquired by "delete_volume" :: waited 0.019s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:53:41 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[15903afe-2f1b-4d61-bad4-4aa75010abee]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:53:41 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e97a3889-36a8-42e0-8608-5e282b431db8 tempest-VolumeDependencyTests-386071043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-26276f85-a9f6-40c2-acf9-94b7010eed5b {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:41 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-eec18e9c-c52e-4da4-828f-dd45f583e179 tempest-VolumesActionsTest-2019259401 None] Created reservations ['fe0ddc12-5db5-49ed-8846-a7820e5639d5', '1bd26b04-a4ce-44d9-bf5e-6e9c92fcc4c8', 'a07ed4f1-65ca-415a-901d-52d90266fad6', 'cc9039a6-b682-46fa-8317-9636b0901556'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:53:41 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-eec18e9c-c52e-4da4-828f-dd45f583e179 tempest-VolumesActionsTest-2019259401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:53:41 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-eec18e9c-c52e-4da4-828f-dd45f583e179 tempest-VolumesActionsTest-2019259401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:53:41 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-eec18e9c-c52e-4da4-828f-dd45f583e179 tempest-VolumesActionsTest-2019259401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:53:41 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-eec18e9c-c52e-4da4-828f-dd45f583e179 tempest-VolumesActionsTest-2019259401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:53:41 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-eec18e9c-c52e-4da4-828f-dd45f583e179 tempest-VolumesActionsTest-2019259401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:53:41 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-eec18e9c-c52e-4da4-828f-dd45f583e179 tempest-VolumesActionsTest-2019259401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:41 devstack sudo[106219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-26276f85-a9f6-40c2-acf9-94b7010eed5b Jun 17 05:53:41 devstack sudo[106219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:41 devstack sudo[106220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:53:41 devstack sudo[106220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:42 devstack sudo[106220]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-eec18e9c-c52e-4da4-828f-dd45f583e179 tempest-VolumesActionsTest-2019259401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.623s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:42 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-eec18e9c-c52e-4da4-828f-dd45f583e179 tempest-VolumesActionsTest-2019259401 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:53:42 devstack sudo[106219]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e97a3889-36a8-42e0-8608-5e282b431db8 tempest-VolumeDependencyTests-386071043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-26276f85-a9f6-40c2-acf9-94b7010eed5b" returned: 0 in 0.720s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e97a3889-36a8-42e0-8608-5e282b431db8 tempest-VolumeDependencyTests-386071043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-26276f85-a9f6-40c2-acf9-94b7010eed5b {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:42 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-eec18e9c-c52e-4da4-828f-dd45f583e179 tempest-VolumesActionsTest-2019259401 None] Deleted volume successfully. Jun 17 05:53:42 devstack sudo[106227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-26276f85-a9f6-40c2-acf9-94b7010eed5b Jun 17 05:53:42 devstack sudo[106227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:42 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-eec18e9c-c52e-4da4-828f-dd45f583e179 tempest-VolumesActionsTest-2019259401 None] Lock "cinder-8699dd54-95f6-4ef3-971f-879106948a1d-delete_volume" released by "delete_volume" :: held 2.283s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:53:42 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-66c22096-6135-46c6-8719-71fe7ca9f2a0 tempest-VolumesActionsTest-1107896766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:53:42 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-66c22096-6135-46c6-8719-71fe7ca9f2a0 tempest-VolumesActionsTest-1107896766 None] Flow 'volume_create_manager' (0f535ae1-3a19-4ea7-acbd-1cadd748ae24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:53:42 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-66c22096-6135-46c6-8719-71fe7ca9f2a0 tempest-VolumesActionsTest-1107896766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed28bc35-0203-4b64-95ed-7d381531c810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:53:42 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-66c22096-6135-46c6-8719-71fe7ca9f2a0 tempest-VolumesActionsTest-1107896766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed28bc35-0203-4b64-95ed-7d381531c810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:53:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1025538822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52047890-930a-47ff-b804-efdd538bde39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09654981722e4d16a9c750aa12b9b7b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:53:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:53:42Z,use_quota=True,user_id='5c9f4322025c417da6d2f736ae055e8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:53:42 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-66c22096-6135-46c6-8719-71fe7ca9f2a0 tempest-VolumesActionsTest-1107896766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ab72f2b-1ee4-4c78-b79f-d33072bb95d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:53:42 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-66c22096-6135-46c6-8719-71fe7ca9f2a0 tempest-VolumesActionsTest-1107896766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ab72f2b-1ee4-4c78-b79f-d33072bb95d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:53:42 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-66c22096-6135-46c6-8719-71fe7ca9f2a0 tempest-VolumesActionsTest-1107896766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e260d014-c243-4cdd-8242-9766d95831aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:53:42 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-66c22096-6135-46c6-8719-71fe7ca9f2a0 tempest-VolumesActionsTest-1107896766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e260d014-c243-4cdd-8242-9766d95831aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52047890-930a-47ff-b804-efdd538bde39', 'volume_name': 'volume-52047890-930a-47ff-b804-efdd538bde39', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:53:42 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-66c22096-6135-46c6-8719-71fe7ca9f2a0 tempest-VolumesActionsTest-1107896766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cc409aa-5560-4e78-8806-fac4c006546a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:53:42 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-66c22096-6135-46c6-8719-71fe7ca9f2a0 tempest-VolumesActionsTest-1107896766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cc409aa-5560-4e78-8806-fac4c006546a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:53:42 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-66c22096-6135-46c6-8719-71fe7ca9f2a0 tempest-VolumesActionsTest-1107896766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c08bf73-54f7-4912-8d6e-931bcc4cb3bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:53:42 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-66c22096-6135-46c6-8719-71fe7ca9f2a0 tempest-VolumesActionsTest-1107896766 None] Volume 52047890-930a-47ff-b804-efdd538bde39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52047890-930a-47ff-b804-efdd538bde39', 'volume_size': 1} Jun 17 05:53:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-66c22096-6135-46c6-8719-71fe7ca9f2a0 tempest-VolumesActionsTest-1107896766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:53:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-66c22096-6135-46c6-8719-71fe7ca9f2a0 tempest-VolumesActionsTest-1107896766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:53:42 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-66c22096-6135-46c6-8719-71fe7ca9f2a0 tempest-VolumesActionsTest-1107896766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:53:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1025538822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52047890-930a-47ff-b804-efdd538bde39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09654981722e4d16a9c750aa12b9b7b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:53:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:53:42Z,use_quota=True,user_id='5c9f4322025c417da6d2f736ae055e8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:53:42 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-66c22096-6135-46c6-8719-71fe7ca9f2a0 tempest-VolumesActionsTest-1107896766 None] Creating volume 52047890-930a-47ff-b804-efdd538bde39 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:53:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-66c22096-6135-46c6-8719-71fe7ca9f2a0 tempest-VolumesActionsTest-1107896766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:53:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-66c22096-6135-46c6-8719-71fe7ca9f2a0 tempest-VolumesActionsTest-1107896766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:53:42 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-66c22096-6135-46c6-8719-71fe7ca9f2a0 tempest-VolumesActionsTest-1107896766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:53:42 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-66c22096-6135-46c6-8719-71fe7ca9f2a0 tempest-VolumesActionsTest-1107896766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:53:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-66c22096-6135-46c6-8719-71fe7ca9f2a0 tempest-VolumesActionsTest-1107896766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:53:42 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-66c22096-6135-46c6-8719-71fe7ca9f2a0 tempest-VolumesActionsTest-1107896766 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:53:42 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-66c22096-6135-46c6-8719-71fe7ca9f2a0 tempest-VolumesActionsTest-1107896766 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:53:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-66c22096-6135-46c6-8719-71fe7ca9f2a0 tempest-VolumesActionsTest-1107896766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-52047890-930a-47ff-b804-efdd538bde39 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:42 devstack sudo[106230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-52047890-930a-47ff-b804-efdd538bde39 1073741824 Jun 17 05:53:42 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:42 devstack sudo[106227]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e97a3889-36a8-42e0-8608-5e282b431db8 tempest-VolumeDependencyTests-386071043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-26276f85-a9f6-40c2-acf9-94b7010eed5b" returned: 0 in 0.606s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:42 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-e97a3889-36a8-42e0-8608-5e282b431db8 tempest-VolumeDependencyTests-386071043 None] Lock "cinder-quobyte-26276f85-a9f6-40c2-acf9-94b7010eed5b" released by "delete_volume" :: held 1.387s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:53:42 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-e97a3889-36a8-42e0-8608-5e282b431db8 tempest-VolumeDependencyTests-386071043 None] Created reservations ['aa4923b5-fe25-4476-82c4-fa74154fdae4', '8a764037-ebbc-47a5-8287-048e68b1ea25', 'b396640d-697c-4312-bd10-be6f75c70a52', '45a299db-7d42-4276-b5e4-1950ebc19ce3'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:53:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e97a3889-36a8-42e0-8608-5e282b431db8 tempest-VolumeDependencyTests-386071043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:53:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e97a3889-36a8-42e0-8608-5e282b431db8 tempest-VolumeDependencyTests-386071043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:53:42 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-e97a3889-36a8-42e0-8608-5e282b431db8 tempest-VolumeDependencyTests-386071043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:53:42 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-e97a3889-36a8-42e0-8608-5e282b431db8 tempest-VolumeDependencyTests-386071043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:53:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e97a3889-36a8-42e0-8608-5e282b431db8 tempest-VolumeDependencyTests-386071043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:53:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e97a3889-36a8-42e0-8608-5e282b431db8 tempest-VolumeDependencyTests-386071043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:42 devstack sudo[106232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:53:42 devstack sudo[106232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:43 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:43 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-66c22096-6135-46c6-8719-71fe7ca9f2a0 tempest-VolumesActionsTest-1107896766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-52047890-930a-47ff-b804-efdd538bde39 1073741824" returned: 0 in 0.779s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:43 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-66c22096-6135-46c6-8719-71fe7ca9f2a0 tempest-VolumesActionsTest-1107896766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-52047890-930a-47ff-b804-efdd538bde39 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:43 devstack sudo[106238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-52047890-930a-47ff-b804-efdd538bde39 Jun 17 05:53:43 devstack sudo[106238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:43 devstack sudo[106232]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:43 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e97a3889-36a8-42e0-8608-5e282b431db8 tempest-VolumeDependencyTests-386071043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.624s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:43 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-e97a3889-36a8-42e0-8608-5e282b431db8 tempest-VolumeDependencyTests-386071043 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:53:43 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-e97a3889-36a8-42e0-8608-5e282b431db8 tempest-VolumeDependencyTests-386071043 None] Deleted volume successfully. Jun 17 05:53:43 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-e97a3889-36a8-42e0-8608-5e282b431db8 tempest-VolumeDependencyTests-386071043 None] Lock "cinder-26276f85-a9f6-40c2-acf9-94b7010eed5b-delete_volume" released by "delete_volume" :: held 2.224s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:53:43 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-d7f3b6e1-ce16-4730-ad60-3e36bb12d62e tempest-VolumeDependencyTests-386071043 None] Acquiring lock "cinder-b5bf839d-4cf9-41fa-811f-28d44e8ef188-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:53:43 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-d7f3b6e1-ce16-4730-ad60-3e36bb12d62e tempest-VolumeDependencyTests-386071043 None] Lock "cinder-b5bf839d-4cf9-41fa-811f-28d44e8ef188-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:53:43 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-d7f3b6e1-ce16-4730-ad60-3e36bb12d62e tempest-VolumeDependencyTests-386071043 None] Acquiring lock "cinder-quobyte-b5bf839d-4cf9-41fa-811f-28d44e8ef188" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:53:43 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-d7f3b6e1-ce16-4730-ad60-3e36bb12d62e tempest-VolumeDependencyTests-386071043 None] Lock "cinder-quobyte-b5bf839d-4cf9-41fa-811f-28d44e8ef188" acquired by "delete_volume" :: waited 0.018s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:53:43 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[a01333ed-c53b-4233-b95e-2e0d56e157c3]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:53:43 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-d7f3b6e1-ce16-4730-ad60-3e36bb12d62e tempest-VolumeDependencyTests-386071043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b5bf839d-4cf9-41fa-811f-28d44e8ef188 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:43 devstack sudo[106240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b5bf839d-4cf9-41fa-811f-28d44e8ef188 Jun 17 05:53:43 devstack sudo[106240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:44 devstack sudo[106238]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:44 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-66c22096-6135-46c6-8719-71fe7ca9f2a0 tempest-VolumesActionsTest-1107896766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-52047890-930a-47ff-b804-efdd538bde39" returned: 0 in 0.652s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:44 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-66c22096-6135-46c6-8719-71fe7ca9f2a0 tempest-VolumesActionsTest-1107896766 None] <== create_volume: return (1471ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:53:44 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-66c22096-6135-46c6-8719-71fe7ca9f2a0 tempest-VolumesActionsTest-1107896766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.475s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:53:44 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-66c22096-6135-46c6-8719-71fe7ca9f2a0 tempest-VolumesActionsTest-1107896766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c08bf73-54f7-4912-8d6e-931bcc4cb3bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52047890-930a-47ff-b804-efdd538bde39', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:53:44 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-66c22096-6135-46c6-8719-71fe7ca9f2a0 tempest-VolumesActionsTest-1107896766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fa49241-16b4-40f8-bed2-aead1218acc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:53:44 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-66c22096-6135-46c6-8719-71fe7ca9f2a0 tempest-VolumesActionsTest-1107896766 None] Volume volume-52047890-930a-47ff-b804-efdd538bde39 (52047890-930a-47ff-b804-efdd538bde39): created successfully Jun 17 05:53:44 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-66c22096-6135-46c6-8719-71fe7ca9f2a0 tempest-VolumesActionsTest-1107896766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fa49241-16b4-40f8-bed2-aead1218acc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:53:44 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-66c22096-6135-46c6-8719-71fe7ca9f2a0 tempest-VolumesActionsTest-1107896766 None] Flow 'volume_create_manager' (0f535ae1-3a19-4ea7-acbd-1cadd748ae24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:53:44 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-66c22096-6135-46c6-8719-71fe7ca9f2a0 tempest-VolumesActionsTest-1107896766 None] Created volume successfully. Jun 17 05:53:44 devstack sudo[106240]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:44 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-d7f3b6e1-ce16-4730-ad60-3e36bb12d62e tempest-VolumeDependencyTests-386071043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b5bf839d-4cf9-41fa-811f-28d44e8ef188" returned: 0 in 0.726s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:44 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-d7f3b6e1-ce16-4730-ad60-3e36bb12d62e tempest-VolumeDependencyTests-386071043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b5bf839d-4cf9-41fa-811f-28d44e8ef188 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:44 devstack sudo[106246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b5bf839d-4cf9-41fa-811f-28d44e8ef188 Jun 17 05:53:44 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:44 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-5c493b62-6705-44ba-8df2-333bdc3292a9 tempest-VolumesActionsTest-2019259401 None] Acquiring lock "cinder-52047890-930a-47ff-b804-efdd538bde39-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:53:44 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-5c493b62-6705-44ba-8df2-333bdc3292a9 tempest-VolumesActionsTest-2019259401 None] Lock "cinder-52047890-930a-47ff-b804-efdd538bde39-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:53:44 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-5c493b62-6705-44ba-8df2-333bdc3292a9 tempest-VolumesActionsTest-2019259401 None] Acquiring lock "cinder-quobyte-52047890-930a-47ff-b804-efdd538bde39" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:53:44 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-5c493b62-6705-44ba-8df2-333bdc3292a9 tempest-VolumesActionsTest-2019259401 None] Lock "cinder-quobyte-52047890-930a-47ff-b804-efdd538bde39" acquired by "delete_volume" :: waited 0.017s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:53:44 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac8e9086-7e81-4c8e-b7e0-477e0f0a5fef]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:53:44 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-5c493b62-6705-44ba-8df2-333bdc3292a9 tempest-VolumesActionsTest-2019259401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-52047890-930a-47ff-b804-efdd538bde39 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:44 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:44 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-d7f3b6e1-ce16-4730-ad60-3e36bb12d62e tempest-VolumeDependencyTests-386071043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b5bf839d-4cf9-41fa-811f-28d44e8ef188" returned: 0 in 0.613s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:45 devstack sudo[106249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-52047890-930a-47ff-b804-efdd538bde39 Jun 17 05:53:45 devstack sudo[106249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:45 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-d7f3b6e1-ce16-4730-ad60-3e36bb12d62e tempest-VolumeDependencyTests-386071043 None] Lock "cinder-quobyte-b5bf839d-4cf9-41fa-811f-28d44e8ef188" released by "delete_volume" :: held 1.394s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:53:45 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-d7f3b6e1-ce16-4730-ad60-3e36bb12d62e tempest-VolumeDependencyTests-386071043 None] Created reservations ['4b796e9a-cb1d-4a8b-9a2b-f353c12afa6c', 'f2984aab-f6e1-42b6-a20c-943b67b8e212', 'b41b14fc-f945-40c1-a906-af46e4a2e6c4', '6651e8ac-d5c1-4497-ab9f-370d079f050b'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:53:45 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-d7f3b6e1-ce16-4730-ad60-3e36bb12d62e tempest-VolumeDependencyTests-386071043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:53:45 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-d7f3b6e1-ce16-4730-ad60-3e36bb12d62e tempest-VolumeDependencyTests-386071043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:53:45 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-d7f3b6e1-ce16-4730-ad60-3e36bb12d62e tempest-VolumeDependencyTests-386071043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:53:45 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-d7f3b6e1-ce16-4730-ad60-3e36bb12d62e tempest-VolumeDependencyTests-386071043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:53:45 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-d7f3b6e1-ce16-4730-ad60-3e36bb12d62e tempest-VolumeDependencyTests-386071043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:53:45 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-d7f3b6e1-ce16-4730-ad60-3e36bb12d62e tempest-VolumeDependencyTests-386071043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:45 devstack sudo[106251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:53:45 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:45 devstack sudo[106249]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:45 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-5c493b62-6705-44ba-8df2-333bdc3292a9 tempest-VolumesActionsTest-2019259401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-52047890-930a-47ff-b804-efdd538bde39" returned: 0 in 0.705s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:45 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-5c493b62-6705-44ba-8df2-333bdc3292a9 tempest-VolumesActionsTest-2019259401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-52047890-930a-47ff-b804-efdd538bde39 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:45 devstack sudo[106257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-52047890-930a-47ff-b804-efdd538bde39 Jun 17 05:53:45 devstack sudo[106257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:45 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:45 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-d7f3b6e1-ce16-4730-ad60-3e36bb12d62e tempest-VolumeDependencyTests-386071043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.631s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:45 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-d7f3b6e1-ce16-4730-ad60-3e36bb12d62e tempest-VolumeDependencyTests-386071043 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:53:45 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-d7f3b6e1-ce16-4730-ad60-3e36bb12d62e tempest-VolumeDependencyTests-386071043 None] Deleted volume successfully. Jun 17 05:53:45 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-d7f3b6e1-ce16-4730-ad60-3e36bb12d62e tempest-VolumeDependencyTests-386071043 None] Lock "cinder-b5bf839d-4cf9-41fa-811f-28d44e8ef188-delete_volume" released by "delete_volume" :: held 2.230s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:53:46 devstack sudo[106257]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-5c493b62-6705-44ba-8df2-333bdc3292a9 tempest-VolumesActionsTest-2019259401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-52047890-930a-47ff-b804-efdd538bde39" returned: 0 in 0.590s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:46 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-5c493b62-6705-44ba-8df2-333bdc3292a9 tempest-VolumesActionsTest-2019259401 None] Lock "cinder-quobyte-52047890-930a-47ff-b804-efdd538bde39" released by "delete_volume" :: held 1.336s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:53:46 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-5c493b62-6705-44ba-8df2-333bdc3292a9 tempest-VolumesActionsTest-2019259401 None] Created reservations ['6ce9b068-6184-4a47-baf0-17c160219c9c', '2d34e1a4-01a4-4af5-99fa-5471ccbf80f3', '8768f693-13bd-44bc-929d-f73307895b88', '83df60e8-a6cf-4223-b4d0-628a3e4b4aa8'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:53:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-5c493b62-6705-44ba-8df2-333bdc3292a9 tempest-VolumesActionsTest-2019259401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:53:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-5c493b62-6705-44ba-8df2-333bdc3292a9 tempest-VolumesActionsTest-2019259401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:53:46 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-5c493b62-6705-44ba-8df2-333bdc3292a9 tempest-VolumesActionsTest-2019259401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:53:46 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-5c493b62-6705-44ba-8df2-333bdc3292a9 tempest-VolumesActionsTest-2019259401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:53:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-5c493b62-6705-44ba-8df2-333bdc3292a9 tempest-VolumesActionsTest-2019259401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:53:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-5c493b62-6705-44ba-8df2-333bdc3292a9 tempest-VolumesActionsTest-2019259401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:46 devstack sudo[106261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:53:46 devstack sudo[106261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:46 devstack sudo[106261]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-5c493b62-6705-44ba-8df2-333bdc3292a9 tempest-VolumesActionsTest-2019259401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.672s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:46 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-5c493b62-6705-44ba-8df2-333bdc3292a9 tempest-VolumesActionsTest-2019259401 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:53:46 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-5c493b62-6705-44ba-8df2-333bdc3292a9 tempest-VolumesActionsTest-2019259401 None] Deleted volume successfully. Jun 17 05:53:47 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-5c493b62-6705-44ba-8df2-333bdc3292a9 tempest-VolumesActionsTest-2019259401 None] Lock "cinder-52047890-930a-47ff-b804-efdd538bde39-delete_volume" released by "delete_volume" :: held 2.195s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:53:47 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a56e957-5d7a-46d7-8cbf-7dcd0be9c8bf tempest-VolumesActionsTest-1107896766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:53:47 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8a56e957-5d7a-46d7-8cbf-7dcd0be9c8bf tempest-VolumesActionsTest-1107896766 None] Flow 'volume_create_manager' (8223b450-5fdb-4644-bb3c-0c87c930e1dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:53:47 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8a56e957-5d7a-46d7-8cbf-7dcd0be9c8bf tempest-VolumesActionsTest-1107896766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adcf5857-735a-4719-ab09-a98e77a72845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:53:47 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8a56e957-5d7a-46d7-8cbf-7dcd0be9c8bf tempest-VolumesActionsTest-1107896766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adcf5857-735a-4719-ab09-a98e77a72845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:53:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1583062440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16c9b008-5bdc-427e-8a89-c35a7ef0ea81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09654981722e4d16a9c750aa12b9b7b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:53:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:53:47Z,use_quota=True,user_id='5c9f4322025c417da6d2f736ae055e8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:53:47 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8a56e957-5d7a-46d7-8cbf-7dcd0be9c8bf tempest-VolumesActionsTest-1107896766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (783ec95c-f3cb-4fb8-857a-b570c219ca38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:53:47 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8a56e957-5d7a-46d7-8cbf-7dcd0be9c8bf tempest-VolumesActionsTest-1107896766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (783ec95c-f3cb-4fb8-857a-b570c219ca38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:53:47 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8a56e957-5d7a-46d7-8cbf-7dcd0be9c8bf tempest-VolumesActionsTest-1107896766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8126a805-ead0-4121-972c-76683d3ae136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:53:47 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8a56e957-5d7a-46d7-8cbf-7dcd0be9c8bf tempest-VolumesActionsTest-1107896766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8126a805-ead0-4121-972c-76683d3ae136) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16c9b008-5bdc-427e-8a89-c35a7ef0ea81', 'volume_name': 'volume-16c9b008-5bdc-427e-8a89-c35a7ef0ea81', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:53:47 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8a56e957-5d7a-46d7-8cbf-7dcd0be9c8bf tempest-VolumesActionsTest-1107896766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fb8aff8-67c7-41da-a143-e7145fff2b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:53:47 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8a56e957-5d7a-46d7-8cbf-7dcd0be9c8bf tempest-VolumesActionsTest-1107896766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fb8aff8-67c7-41da-a143-e7145fff2b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:53:47 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8a56e957-5d7a-46d7-8cbf-7dcd0be9c8bf tempest-VolumesActionsTest-1107896766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4466be8f-4725-409a-ab58-145b319933f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:53:47 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-8a56e957-5d7a-46d7-8cbf-7dcd0be9c8bf tempest-VolumesActionsTest-1107896766 None] Volume 16c9b008-5bdc-427e-8a89-c35a7ef0ea81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16c9b008-5bdc-427e-8a89-c35a7ef0ea81', 'volume_size': 1} Jun 17 05:53:47 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-8a56e957-5d7a-46d7-8cbf-7dcd0be9c8bf tempest-VolumesActionsTest-1107896766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:53:47 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-8a56e957-5d7a-46d7-8cbf-7dcd0be9c8bf tempest-VolumesActionsTest-1107896766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:53:47 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-8a56e957-5d7a-46d7-8cbf-7dcd0be9c8bf tempest-VolumesActionsTest-1107896766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:53:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1583062440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16c9b008-5bdc-427e-8a89-c35a7ef0ea81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09654981722e4d16a9c750aa12b9b7b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:53:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:53:47Z,use_quota=True,user_id='5c9f4322025c417da6d2f736ae055e8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:53:47 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-8a56e957-5d7a-46d7-8cbf-7dcd0be9c8bf tempest-VolumesActionsTest-1107896766 None] Creating volume 16c9b008-5bdc-427e-8a89-c35a7ef0ea81 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:53:47 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-8a56e957-5d7a-46d7-8cbf-7dcd0be9c8bf tempest-VolumesActionsTest-1107896766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:53:47 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-8a56e957-5d7a-46d7-8cbf-7dcd0be9c8bf tempest-VolumesActionsTest-1107896766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:53:47 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-8a56e957-5d7a-46d7-8cbf-7dcd0be9c8bf tempest-VolumesActionsTest-1107896766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:53:47 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-8a56e957-5d7a-46d7-8cbf-7dcd0be9c8bf tempest-VolumesActionsTest-1107896766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:53:47 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-8a56e957-5d7a-46d7-8cbf-7dcd0be9c8bf tempest-VolumesActionsTest-1107896766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:53:47 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-8a56e957-5d7a-46d7-8cbf-7dcd0be9c8bf tempest-VolumesActionsTest-1107896766 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:53:47 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-8a56e957-5d7a-46d7-8cbf-7dcd0be9c8bf tempest-VolumesActionsTest-1107896766 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:53:47 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8a56e957-5d7a-46d7-8cbf-7dcd0be9c8bf tempest-VolumesActionsTest-1107896766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-16c9b008-5bdc-427e-8a89-c35a7ef0ea81 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:47 devstack sudo[106265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-16c9b008-5bdc-427e-8a89-c35a7ef0ea81 1073741824 Jun 17 05:53:47 devstack sudo[106265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:48 devstack sudo[106265]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:48 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8a56e957-5d7a-46d7-8cbf-7dcd0be9c8bf tempest-VolumesActionsTest-1107896766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-16c9b008-5bdc-427e-8a89-c35a7ef0ea81 1073741824" returned: 0 in 0.815s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:48 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8a56e957-5d7a-46d7-8cbf-7dcd0be9c8bf tempest-VolumesActionsTest-1107896766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-16c9b008-5bdc-427e-8a89-c35a7ef0ea81 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:48 devstack sudo[106271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-16c9b008-5bdc-427e-8a89-c35a7ef0ea81 Jun 17 05:53:48 devstack sudo[106271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:49 devstack sudo[106271]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:49 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8a56e957-5d7a-46d7-8cbf-7dcd0be9c8bf tempest-VolumesActionsTest-1107896766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-16c9b008-5bdc-427e-8a89-c35a7ef0ea81" returned: 0 in 0.662s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:49 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-8a56e957-5d7a-46d7-8cbf-7dcd0be9c8bf tempest-VolumesActionsTest-1107896766 None] <== create_volume: return (1520ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:53:49 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-8a56e957-5d7a-46d7-8cbf-7dcd0be9c8bf tempest-VolumesActionsTest-1107896766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.522s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:53:49 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8a56e957-5d7a-46d7-8cbf-7dcd0be9c8bf tempest-VolumesActionsTest-1107896766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4466be8f-4725-409a-ab58-145b319933f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16c9b008-5bdc-427e-8a89-c35a7ef0ea81', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:53:49 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8a56e957-5d7a-46d7-8cbf-7dcd0be9c8bf tempest-VolumesActionsTest-1107896766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3892704-5b5a-48fe-8f13-e4219d254f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:53:49 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-8a56e957-5d7a-46d7-8cbf-7dcd0be9c8bf tempest-VolumesActionsTest-1107896766 None] Volume volume-16c9b008-5bdc-427e-8a89-c35a7ef0ea81 (16c9b008-5bdc-427e-8a89-c35a7ef0ea81): created successfully Jun 17 05:53:49 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8a56e957-5d7a-46d7-8cbf-7dcd0be9c8bf tempest-VolumesActionsTest-1107896766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3892704-5b5a-48fe-8f13-e4219d254f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:53:49 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8a56e957-5d7a-46d7-8cbf-7dcd0be9c8bf tempest-VolumesActionsTest-1107896766 None] Flow 'volume_create_manager' (8223b450-5fdb-4644-bb3c-0c87c930e1dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:53:49 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-8a56e957-5d7a-46d7-8cbf-7dcd0be9c8bf tempest-VolumesActionsTest-1107896766 None] Created volume successfully. Jun 17 05:53:50 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-34e44655-2ba1-47a2-83e7-2cdfb43c46d7 tempest-VolumesActionsTest-1107896766 None] Acquiring lock "cinder-16c9b008-5bdc-427e-8a89-c35a7ef0ea81-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:53:50 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-34e44655-2ba1-47a2-83e7-2cdfb43c46d7 tempest-VolumesActionsTest-1107896766 None] Lock "cinder-16c9b008-5bdc-427e-8a89-c35a7ef0ea81-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:53:50 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-34e44655-2ba1-47a2-83e7-2cdfb43c46d7 tempest-VolumesActionsTest-1107896766 None] Acquiring lock "cinder-quobyte-16c9b008-5bdc-427e-8a89-c35a7ef0ea81" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:53:50 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-34e44655-2ba1-47a2-83e7-2cdfb43c46d7 tempest-VolumesActionsTest-1107896766 None] Lock "cinder-quobyte-16c9b008-5bdc-427e-8a89-c35a7ef0ea81" acquired by "delete_volume" :: waited 0.017s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:53:50 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[e862abd7-fdc7-4fa6-adcd-48d0deca7918]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:53:50 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-34e44655-2ba1-47a2-83e7-2cdfb43c46d7 tempest-VolumesActionsTest-1107896766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-16c9b008-5bdc-427e-8a89-c35a7ef0ea81 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:50 devstack sudo[106275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-16c9b008-5bdc-427e-8a89-c35a7ef0ea81 Jun 17 05:53:50 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:51 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:51 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-34e44655-2ba1-47a2-83e7-2cdfb43c46d7 tempest-VolumesActionsTest-1107896766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-16c9b008-5bdc-427e-8a89-c35a7ef0ea81" returned: 0 in 0.758s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:51 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-34e44655-2ba1-47a2-83e7-2cdfb43c46d7 tempest-VolumesActionsTest-1107896766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-16c9b008-5bdc-427e-8a89-c35a7ef0ea81 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:51 devstack sudo[106280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-16c9b008-5bdc-427e-8a89-c35a7ef0ea81 Jun 17 05:53:51 devstack sudo[106280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:51 devstack sudo[106280]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:51 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-34e44655-2ba1-47a2-83e7-2cdfb43c46d7 tempest-VolumesActionsTest-1107896766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-16c9b008-5bdc-427e-8a89-c35a7ef0ea81" returned: 0 in 0.636s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:51 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-34e44655-2ba1-47a2-83e7-2cdfb43c46d7 tempest-VolumesActionsTest-1107896766 None] Lock "cinder-quobyte-16c9b008-5bdc-427e-8a89-c35a7ef0ea81" released by "delete_volume" :: held 1.443s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:53:51 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-34e44655-2ba1-47a2-83e7-2cdfb43c46d7 tempest-VolumesActionsTest-1107896766 None] Created reservations ['22ae307f-a00f-40ea-a0f9-92e1d19fda1b', 'ff501ea4-d2d8-4b1f-8ce5-913f29a492a6', '26268cd5-9c32-4a1e-978e-8b98c01f9cb5', 'e1e7dfd9-a079-4798-bafa-26356479a431'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:53:51 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-34e44655-2ba1-47a2-83e7-2cdfb43c46d7 tempest-VolumesActionsTest-1107896766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:53:51 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-34e44655-2ba1-47a2-83e7-2cdfb43c46d7 tempest-VolumesActionsTest-1107896766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:53:51 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-34e44655-2ba1-47a2-83e7-2cdfb43c46d7 tempest-VolumesActionsTest-1107896766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:53:51 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-34e44655-2ba1-47a2-83e7-2cdfb43c46d7 tempest-VolumesActionsTest-1107896766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:53:51 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-34e44655-2ba1-47a2-83e7-2cdfb43c46d7 tempest-VolumesActionsTest-1107896766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:53:51 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-34e44655-2ba1-47a2-83e7-2cdfb43c46d7 tempest-VolumesActionsTest-1107896766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:53:51 devstack sudo[106284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:53:51 devstack sudo[106284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:53:52 devstack sudo[106284]: pam_unix(sudo:session): session closed for user root Jun 17 05:53:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-34e44655-2ba1-47a2-83e7-2cdfb43c46d7 tempest-VolumesActionsTest-1107896766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.727s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:53:52 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-34e44655-2ba1-47a2-83e7-2cdfb43c46d7 tempest-VolumesActionsTest-1107896766 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:53:52 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-34e44655-2ba1-47a2-83e7-2cdfb43c46d7 tempest-VolumesActionsTest-1107896766 None] Deleted volume successfully. Jun 17 05:53:52 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-34e44655-2ba1-47a2-83e7-2cdfb43c46d7 tempest-VolumesActionsTest-1107896766 None] Lock "cinder-16c9b008-5bdc-427e-8a89-c35a7ef0ea81-delete_volume" released by "delete_volume" :: held 2.412s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:54:01 devstack cinder-volume[92083]: DEBUG dbcounter [-] [92083] Writing DB stats cinder:SELECT=108,cinder:UPDATE=153,cinder:DELETE=11,cinder:INSERT=40 {{(pid=92083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:54:02 devstack cinder-volume[92083]: DEBUG dbcounter [-] [92083] Writing DB stats cinder:SELECT=101,cinder:UPDATE=148,cinder:INSERT=31,cinder:DELETE=16 {{(pid=92083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:54:06 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-47e03f99-972e-4ba9-ab00-1d3234ab59f8 tempest-SnapshotDependencyTests-1947412681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:54:06 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-47e03f99-972e-4ba9-ab00-1d3234ab59f8 tempest-SnapshotDependencyTests-1947412681 None] Flow 'volume_create_manager' (5bf00e3e-9e6e-4b3e-8c52-0008ec6cecfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:54:06 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-47e03f99-972e-4ba9-ab00-1d3234ab59f8 tempest-SnapshotDependencyTests-1947412681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31574b6d-fe94-4b4c-9120-74db6e044cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:54:06 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-47e03f99-972e-4ba9-ab00-1d3234ab59f8 tempest-SnapshotDependencyTests-1947412681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31574b6d-fe94-4b4c-9120-74db6e044cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:54:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1464327813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb05deff-28b0-4794-8c82-2f288858b5a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8498599654344dd8b95c0503add565ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:54:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:54:07Z,use_quota=True,user_id='8ae23ffe983040ce89016f275e335f11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:54:06 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-47e03f99-972e-4ba9-ab00-1d3234ab59f8 tempest-SnapshotDependencyTests-1947412681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33c7c3eb-a603-4309-a7cf-4f658be224e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:54:06 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-47e03f99-972e-4ba9-ab00-1d3234ab59f8 tempest-SnapshotDependencyTests-1947412681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33c7c3eb-a603-4309-a7cf-4f658be224e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:54:06 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-47e03f99-972e-4ba9-ab00-1d3234ab59f8 tempest-SnapshotDependencyTests-1947412681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf3cd5db-fa21-4e23-8889-d5d6a716e62f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:54:06 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-47e03f99-972e-4ba9-ab00-1d3234ab59f8 tempest-SnapshotDependencyTests-1947412681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf3cd5db-fa21-4e23-8889-d5d6a716e62f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb05deff-28b0-4794-8c82-2f288858b5a7', 'volume_name': 'volume-bb05deff-28b0-4794-8c82-2f288858b5a7', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:54:06 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-47e03f99-972e-4ba9-ab00-1d3234ab59f8 tempest-SnapshotDependencyTests-1947412681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (199e47dc-0daa-462f-a20c-158a0bd80285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:54:06 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-47e03f99-972e-4ba9-ab00-1d3234ab59f8 tempest-SnapshotDependencyTests-1947412681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (199e47dc-0daa-462f-a20c-158a0bd80285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:54:06 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-47e03f99-972e-4ba9-ab00-1d3234ab59f8 tempest-SnapshotDependencyTests-1947412681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bc91e60-6157-4b6b-a8ac-a6b03a9f51ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:54:06 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-47e03f99-972e-4ba9-ab00-1d3234ab59f8 tempest-SnapshotDependencyTests-1947412681 None] Volume bb05deff-28b0-4794-8c82-2f288858b5a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb05deff-28b0-4794-8c82-2f288858b5a7', 'volume_size': 1} Jun 17 05:54:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-47e03f99-972e-4ba9-ab00-1d3234ab59f8 tempest-SnapshotDependencyTests-1947412681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:54:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-47e03f99-972e-4ba9-ab00-1d3234ab59f8 tempest-SnapshotDependencyTests-1947412681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:54:06 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-47e03f99-972e-4ba9-ab00-1d3234ab59f8 tempest-SnapshotDependencyTests-1947412681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:54:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1464327813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb05deff-28b0-4794-8c82-2f288858b5a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8498599654344dd8b95c0503add565ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:54:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:54:07Z,use_quota=True,user_id='8ae23ffe983040ce89016f275e335f11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:54:06 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-47e03f99-972e-4ba9-ab00-1d3234ab59f8 tempest-SnapshotDependencyTests-1947412681 None] Creating volume bb05deff-28b0-4794-8c82-2f288858b5a7 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:54:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-47e03f99-972e-4ba9-ab00-1d3234ab59f8 tempest-SnapshotDependencyTests-1947412681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:54:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-47e03f99-972e-4ba9-ab00-1d3234ab59f8 tempest-SnapshotDependencyTests-1947412681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:54:06 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-47e03f99-972e-4ba9-ab00-1d3234ab59f8 tempest-SnapshotDependencyTests-1947412681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:54:06 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-47e03f99-972e-4ba9-ab00-1d3234ab59f8 tempest-SnapshotDependencyTests-1947412681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:54:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-47e03f99-972e-4ba9-ab00-1d3234ab59f8 tempest-SnapshotDependencyTests-1947412681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:54:06 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-47e03f99-972e-4ba9-ab00-1d3234ab59f8 tempest-SnapshotDependencyTests-1947412681 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:54:06 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-47e03f99-972e-4ba9-ab00-1d3234ab59f8 tempest-SnapshotDependencyTests-1947412681 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:54:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-47e03f99-972e-4ba9-ab00-1d3234ab59f8 tempest-SnapshotDependencyTests-1947412681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bb05deff-28b0-4794-8c82-2f288858b5a7 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:54:06 devstack sudo[106295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bb05deff-28b0-4794-8c82-2f288858b5a7 1073741824 Jun 17 05:54:06 devstack sudo[106295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:54:07 devstack sudo[106295]: pam_unix(sudo:session): session closed for user root Jun 17 05:54:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-47e03f99-972e-4ba9-ab00-1d3234ab59f8 tempest-SnapshotDependencyTests-1947412681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bb05deff-28b0-4794-8c82-2f288858b5a7 1073741824" returned: 0 in 0.795s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:54:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-47e03f99-972e-4ba9-ab00-1d3234ab59f8 tempest-SnapshotDependencyTests-1947412681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bb05deff-28b0-4794-8c82-2f288858b5a7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:54:07 devstack sudo[106301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bb05deff-28b0-4794-8c82-2f288858b5a7 Jun 17 05:54:07 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:54:07 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-1835b5d8-c4be-42b3-a515-503b5471372e tempest-VolumesDeleteCascade-22219732 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:54:07 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1835b5d8-c4be-42b3-a515-503b5471372e tempest-VolumesDeleteCascade-22219732 None] Flow 'volume_create_manager' (d6284d2f-d021-4062-a638-330717d31dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:54:07 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1835b5d8-c4be-42b3-a515-503b5471372e tempest-VolumesDeleteCascade-22219732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (175945b8-7e5f-4614-92b1-c6487de5fb74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:54:07 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1835b5d8-c4be-42b3-a515-503b5471372e tempest-VolumesDeleteCascade-22219732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (175945b8-7e5f-4614-92b1-c6487de5fb74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:54:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1453651452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dad2c3983474049a6c1498cf6d7be87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:54:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:54:08Z,use_quota=True,user_id='5e078b618d6a42d187b6909db187bb36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:54:07 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1835b5d8-c4be-42b3-a515-503b5471372e tempest-VolumesDeleteCascade-22219732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a31eaf7-99f2-47d3-b9b6-aa94de7b9238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:54:07 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1835b5d8-c4be-42b3-a515-503b5471372e tempest-VolumesDeleteCascade-22219732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a31eaf7-99f2-47d3-b9b6-aa94de7b9238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:54:07 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1835b5d8-c4be-42b3-a515-503b5471372e tempest-VolumesDeleteCascade-22219732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a51126f6-7e3b-4bd2-9d77-e92154035227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:54:07 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1835b5d8-c4be-42b3-a515-503b5471372e tempest-VolumesDeleteCascade-22219732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a51126f6-7e3b-4bd2-9d77-e92154035227) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b', 'volume_name': 'volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:54:07 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1835b5d8-c4be-42b3-a515-503b5471372e tempest-VolumesDeleteCascade-22219732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8de28142-cb02-4a5b-bb5b-4d607729ea37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:54:07 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1835b5d8-c4be-42b3-a515-503b5471372e tempest-VolumesDeleteCascade-22219732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8de28142-cb02-4a5b-bb5b-4d607729ea37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:54:07 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1835b5d8-c4be-42b3-a515-503b5471372e tempest-VolumesDeleteCascade-22219732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b422ad93-b341-4351-8a64-027c05d8ba0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:54:07 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-1835b5d8-c4be-42b3-a515-503b5471372e tempest-VolumesDeleteCascade-22219732 None] Volume d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b', 'volume_size': 1} Jun 17 05:54:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-1835b5d8-c4be-42b3-a515-503b5471372e tempest-VolumesDeleteCascade-22219732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:54:08 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root Jun 17 05:54:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-47e03f99-972e-4ba9-ab00-1d3234ab59f8 tempest-SnapshotDependencyTests-1947412681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bb05deff-28b0-4794-8c82-2f288858b5a7" returned: 0 in 0.593s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:54:08 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-47e03f99-972e-4ba9-ab00-1d3234ab59f8 tempest-SnapshotDependencyTests-1947412681 None] <== create_volume: return (1434ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:54:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-47e03f99-972e-4ba9-ab00-1d3234ab59f8 tempest-SnapshotDependencyTests-1947412681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.438s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:54:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-1835b5d8-c4be-42b3-a515-503b5471372e tempest-VolumesDeleteCascade-22219732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.438s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:54:08 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-1835b5d8-c4be-42b3-a515-503b5471372e tempest-VolumesDeleteCascade-22219732 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:54:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1453651452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dad2c3983474049a6c1498cf6d7be87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:54:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:54:08Z,use_quota=True,user_id='5e078b618d6a42d187b6909db187bb36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:54:08 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-1835b5d8-c4be-42b3-a515-503b5471372e tempest-VolumesDeleteCascade-22219732 None] Creating volume d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:54:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-1835b5d8-c4be-42b3-a515-503b5471372e tempest-VolumesDeleteCascade-22219732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:54:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-1835b5d8-c4be-42b3-a515-503b5471372e tempest-VolumesDeleteCascade-22219732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:54:08 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-1835b5d8-c4be-42b3-a515-503b5471372e tempest-VolumesDeleteCascade-22219732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:54:08 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-1835b5d8-c4be-42b3-a515-503b5471372e tempest-VolumesDeleteCascade-22219732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:54:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-1835b5d8-c4be-42b3-a515-503b5471372e tempest-VolumesDeleteCascade-22219732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:54:08 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-1835b5d8-c4be-42b3-a515-503b5471372e tempest-VolumesDeleteCascade-22219732 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:54:08 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-1835b5d8-c4be-42b3-a515-503b5471372e tempest-VolumesDeleteCascade-22219732 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:54:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1835b5d8-c4be-42b3-a515-503b5471372e tempest-VolumesDeleteCascade-22219732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:54:08 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-47e03f99-972e-4ba9-ab00-1d3234ab59f8 tempest-SnapshotDependencyTests-1947412681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bc91e60-6157-4b6b-a8ac-a6b03a9f51ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb05deff-28b0-4794-8c82-2f288858b5a7', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:54:08 devstack sudo[106305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b 1073741824 Jun 17 05:54:08 devstack sudo[106305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:54:08 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-47e03f99-972e-4ba9-ab00-1d3234ab59f8 tempest-SnapshotDependencyTests-1947412681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52221630-4911-402a-9cb3-a22f143fc8d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:54:08 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-47e03f99-972e-4ba9-ab00-1d3234ab59f8 tempest-SnapshotDependencyTests-1947412681 None] Volume volume-bb05deff-28b0-4794-8c82-2f288858b5a7 (bb05deff-28b0-4794-8c82-2f288858b5a7): created successfully Jun 17 05:54:08 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-47e03f99-972e-4ba9-ab00-1d3234ab59f8 tempest-SnapshotDependencyTests-1947412681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52221630-4911-402a-9cb3-a22f143fc8d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:54:08 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-47e03f99-972e-4ba9-ab00-1d3234ab59f8 tempest-SnapshotDependencyTests-1947412681 None] Flow 'volume_create_manager' (5bf00e3e-9e6e-4b3e-8c52-0008ec6cecfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:54:08 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-47e03f99-972e-4ba9-ab00-1d3234ab59f8 tempest-SnapshotDependencyTests-1947412681 None] Created volume successfully. Jun 17 05:54:09 devstack sudo[106305]: pam_unix(sudo:session): session closed for user root Jun 17 05:54:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1835b5d8-c4be-42b3-a515-503b5471372e tempest-VolumesDeleteCascade-22219732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b 1073741824" returned: 0 in 0.761s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:54:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1835b5d8-c4be-42b3-a515-503b5471372e tempest-VolumesDeleteCascade-22219732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:54:09 devstack sudo[106312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b Jun 17 05:54:09 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:54:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-273633b9-2ebe-4017-8752-0cb391c8f916 tempest-SnapshotDependencyTests-1947412681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:54:09 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root Jun 17 05:54:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1835b5d8-c4be-42b3-a515-503b5471372e tempest-VolumesDeleteCascade-22219732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b" returned: 0 in 0.577s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:54:09 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-1835b5d8-c4be-42b3-a515-503b5471372e tempest-VolumesDeleteCascade-22219732 None] <== create_volume: return (1391ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:54:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-1835b5d8-c4be-42b3-a515-503b5471372e tempest-VolumesDeleteCascade-22219732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.393s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:54:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-273633b9-2ebe-4017-8752-0cb391c8f916 tempest-SnapshotDependencyTests-1947412681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.545s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:54:09 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-273633b9-2ebe-4017-8752-0cb391c8f916 tempest-SnapshotDependencyTests-1947412681 None] Creating offline snapshot 7fdb44ac-e92f-4593-a8d9-49a2c0e82144 of volume bb05deff-28b0-4794-8c82-2f288858b5a7 {{(pid=92083) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 17 05:54:09 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1835b5d8-c4be-42b3-a515-503b5471372e tempest-VolumesDeleteCascade-22219732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b422ad93-b341-4351-8a64-027c05d8ba0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:54:09 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1835b5d8-c4be-42b3-a515-503b5471372e tempest-VolumesDeleteCascade-22219732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41df27c0-5471-46fb-94a0-8be00699ed8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:54:09 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[9945362b-1a48-4e13-a2b1-7a231f7a0f0b]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:54:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-273633b9-2ebe-4017-8752-0cb391c8f916 tempest-SnapshotDependencyTests-1947412681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bb05deff-28b0-4794-8c82-2f288858b5a7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:54:09 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-1835b5d8-c4be-42b3-a515-503b5471372e tempest-VolumesDeleteCascade-22219732 None] Volume volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b (d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b): created successfully Jun 17 05:54:09 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1835b5d8-c4be-42b3-a515-503b5471372e tempest-VolumesDeleteCascade-22219732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41df27c0-5471-46fb-94a0-8be00699ed8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:54:09 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1835b5d8-c4be-42b3-a515-503b5471372e tempest-VolumesDeleteCascade-22219732 None] Flow 'volume_create_manager' (d6284d2f-d021-4062-a638-330717d31dca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:54:09 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-1835b5d8-c4be-42b3-a515-503b5471372e tempest-VolumesDeleteCascade-22219732 None] Created volume successfully. Jun 17 05:54:09 devstack sudo[106315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bb05deff-28b0-4794-8c82-2f288858b5a7 Jun 17 05:54:09 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:54:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-80ee11f2-102c-48a0-89e4-56901b49b5a4 tempest-VolumesDeleteCascade-22219732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:54:10 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root Jun 17 05:54:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-273633b9-2ebe-4017-8752-0cb391c8f916 tempest-SnapshotDependencyTests-1947412681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bb05deff-28b0-4794-8c82-2f288858b5a7" returned: 0 in 0.717s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:54:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-273633b9-2ebe-4017-8752-0cb391c8f916 tempest-SnapshotDependencyTests-1947412681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bb05deff-28b0-4794-8c82-2f288858b5a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bb05deff-28b0-4794-8c82-2f288858b5a7.7fdb44ac-e92f-4593-a8d9-49a2c0e82144 1G {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:54:10 devstack sudo[106320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bb05deff-28b0-4794-8c82-2f288858b5a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bb05deff-28b0-4794-8c82-2f288858b5a7.7fdb44ac-e92f-4593-a8d9-49a2c0e82144 1G Jun 17 05:54:10 devstack sudo[106320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:54:11 devstack sudo[106320]: pam_unix(sudo:session): session closed for user root Jun 17 05:54:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-273633b9-2ebe-4017-8752-0cb391c8f916 tempest-SnapshotDependencyTests-1947412681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bb05deff-28b0-4794-8c82-2f288858b5a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bb05deff-28b0-4794-8c82-2f288858b5a7.7fdb44ac-e92f-4593-a8d9-49a2c0e82144 1G" returned: 0 in 0.706s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:54:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-273633b9-2ebe-4017-8752-0cb391c8f916 tempest-SnapshotDependencyTests-1947412681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb05deff-28b0-4794-8c82-2f288858b5a7 -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bb05deff-28b0-4794-8c82-2f288858b5a7.7fdb44ac-e92f-4593-a8d9-49a2c0e82144 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:54:11 devstack sudo[106325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb05deff-28b0-4794-8c82-2f288858b5a7 -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bb05deff-28b0-4794-8c82-2f288858b5a7.7fdb44ac-e92f-4593-a8d9-49a2c0e82144 Jun 17 05:54:11 devstack sudo[106325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:54:11 devstack sudo[106325]: pam_unix(sudo:session): session closed for user root Jun 17 05:54:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-273633b9-2ebe-4017-8752-0cb391c8f916 tempest-SnapshotDependencyTests-1947412681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb05deff-28b0-4794-8c82-2f288858b5a7 -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bb05deff-28b0-4794-8c82-2f288858b5a7.7fdb44ac-e92f-4593-a8d9-49a2c0e82144" returned: 0 in 0.620s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:54:11 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [None req-273633b9-2ebe-4017-8752-0cb391c8f916 tempest-SnapshotDependencyTests-1947412681 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bb05deff-28b0-4794-8c82-2f288858b5a7.7fdb44ac-e92f-4593-a8d9-49a2c0e82144 is being set with open permissions: ugo+rw Jun 17 05:54:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-273633b9-2ebe-4017-8752-0cb391c8f916 tempest-SnapshotDependencyTests-1947412681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bb05deff-28b0-4794-8c82-2f288858b5a7.7fdb44ac-e92f-4593-a8d9-49a2c0e82144 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:54:11 devstack sudo[106330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bb05deff-28b0-4794-8c82-2f288858b5a7.7fdb44ac-e92f-4593-a8d9-49a2c0e82144 Jun 17 05:54:11 devstack sudo[106330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:54:12 devstack sudo[106330]: pam_unix(sudo:session): session closed for user root Jun 17 05:54:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-273633b9-2ebe-4017-8752-0cb391c8f916 tempest-SnapshotDependencyTests-1947412681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bb05deff-28b0-4794-8c82-2f288858b5a7.7fdb44ac-e92f-4593-a8d9-49a2c0e82144" returned: 0 in 0.601s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:54:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-273633b9-2ebe-4017-8752-0cb391c8f916 tempest-SnapshotDependencyTests-1947412681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bb05deff-28b0-4794-8c82-2f288858b5a7.info {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:54:12 devstack sudo[106333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bb05deff-28b0-4794-8c82-2f288858b5a7.info Jun 17 05:54:12 devstack sudo[106333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:54:13 devstack sudo[106333]: pam_unix(sudo:session): session closed for user root Jun 17 05:54:13 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-273633b9-2ebe-4017-8752-0cb391c8f916 tempest-SnapshotDependencyTests-1947412681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bb05deff-28b0-4794-8c82-2f288858b5a7.info" returned: 0 in 0.600s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:54:13 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [None req-273633b9-2ebe-4017-8752-0cb391c8f916 tempest-SnapshotDependencyTests-1947412681 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bb05deff-28b0-4794-8c82-2f288858b5a7.info is being set with open permissions: ugo+rw Jun 17 05:54:13 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-273633b9-2ebe-4017-8752-0cb391c8f916 tempest-SnapshotDependencyTests-1947412681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bb05deff-28b0-4794-8c82-2f288858b5a7.info {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:54:13 devstack sudo[106336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bb05deff-28b0-4794-8c82-2f288858b5a7.info Jun 17 05:54:13 devstack sudo[106336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:54:13 devstack sudo[106336]: pam_unix(sudo:session): session closed for user root Jun 17 05:54:13 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-273633b9-2ebe-4017-8752-0cb391c8f916 tempest-SnapshotDependencyTests-1947412681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bb05deff-28b0-4794-8c82-2f288858b5a7.info" returned: 0 in 0.568s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:54:13 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-273633b9-2ebe-4017-8752-0cb391c8f916 tempest-SnapshotDependencyTests-1947412681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.920s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:54:13 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-80ee11f2-102c-48a0-89e4-56901b49b5a4 tempest-VolumesDeleteCascade-22219732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.565s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:54:13 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-80ee11f2-102c-48a0-89e4-56901b49b5a4 tempest-VolumesDeleteCascade-22219732 None] Creating offline snapshot 025827d6-6a7b-4431-a8c4-d7850d2b7898 of volume d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b {{(pid=92083) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 17 05:54:13 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-273633b9-2ebe-4017-8752-0cb391c8f916 tempest-SnapshotDependencyTests-1947412681 None] Create snapshot completed successfully Jun 17 05:54:13 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[1796dc9f-6372-48de-8860-c3a955a4cefc]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:54:13 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-80ee11f2-102c-48a0-89e4-56901b49b5a4 tempest-VolumesDeleteCascade-22219732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:54:13 devstack sudo[106339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b Jun 17 05:54:13 devstack sudo[106339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:54:14 devstack sudo[106339]: pam_unix(sudo:session): session closed for user root Jun 17 05:54:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-80ee11f2-102c-48a0-89e4-56901b49b5a4 tempest-VolumesDeleteCascade-22219732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b" returned: 0 in 0.706s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:54:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-80ee11f2-102c-48a0-89e4-56901b49b5a4 tempest-VolumesDeleteCascade-22219732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b.025827d6-6a7b-4431-a8c4-d7850d2b7898 1G {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:54:14 devstack sudo[106344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b.025827d6-6a7b-4431-a8c4-d7850d2b7898 1G Jun 17 05:54:14 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:54:14 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-b152f112-3bbe-4920-af55-67c3274e2a24 tempest-SnapshotDependencyTests-1947412681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:54:14 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b152f112-3bbe-4920-af55-67c3274e2a24 tempest-SnapshotDependencyTests-1947412681 None] Flow 'volume_create_manager' (2ec3920a-767e-4deb-925b-9975838216a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:54:14 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b152f112-3bbe-4920-af55-67c3274e2a24 tempest-SnapshotDependencyTests-1947412681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92b18477-8eaa-4679-9eb6-64b42465bd38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:54:14 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b152f112-3bbe-4920-af55-67c3274e2a24 tempest-SnapshotDependencyTests-1947412681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92b18477-8eaa-4679-9eb6-64b42465bd38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:54:15Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ae02f6c-230f-454d-b14b-e3227437724d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8498599654344dd8b95c0503add565ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:54:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7fdb44ac-e92f-4593-a8d9-49a2c0e82144,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:54:15Z,use_quota=True,user_id='8ae23ffe983040ce89016f275e335f11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:54:14 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b152f112-3bbe-4920-af55-67c3274e2a24 tempest-SnapshotDependencyTests-1947412681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d54cdfb-0528-445b-9af3-e2734844c4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:54:14 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b152f112-3bbe-4920-af55-67c3274e2a24 tempest-SnapshotDependencyTests-1947412681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d54cdfb-0528-445b-9af3-e2734844c4f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:54:14 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b152f112-3bbe-4920-af55-67c3274e2a24 tempest-SnapshotDependencyTests-1947412681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24b9a8d3-ba22-4d97-b0ee-c36237a6bce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:54:14 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b152f112-3bbe-4920-af55-67c3274e2a24 tempest-SnapshotDependencyTests-1947412681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24b9a8d3-ba22-4d97-b0ee-c36237a6bce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9ae02f6c-230f-454d-b14b-e3227437724d', 'volume_name': 'volume-9ae02f6c-230f-454d-b14b-e3227437724d', 'volume_size': 1, 'snapshot_id': '7fdb44ac-e92f-4593-a8d9-49a2c0e82144'}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:54:14 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b152f112-3bbe-4920-af55-67c3274e2a24 tempest-SnapshotDependencyTests-1947412681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d9fc043-a9e5-44da-bf44-b4a25b0e389d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:54:14 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b152f112-3bbe-4920-af55-67c3274e2a24 tempest-SnapshotDependencyTests-1947412681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d9fc043-a9e5-44da-bf44-b4a25b0e389d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:54:14 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b152f112-3bbe-4920-af55-67c3274e2a24 tempest-SnapshotDependencyTests-1947412681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a72ea40b-baa5-45cd-b0cd-11cf865bdcdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:54:14 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-b152f112-3bbe-4920-af55-67c3274e2a24 tempest-SnapshotDependencyTests-1947412681 None] Volume 9ae02f6c-230f-454d-b14b-e3227437724d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9ae02f6c-230f-454d-b14b-e3227437724d', 'volume_size': 1, 'snapshot_id': '7fdb44ac-e92f-4593-a8d9-49a2c0e82144'} Jun 17 05:54:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-b152f112-3bbe-4920-af55-67c3274e2a24 tempest-SnapshotDependencyTests-1947412681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:54:15 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root Jun 17 05:54:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-80ee11f2-102c-48a0-89e4-56901b49b5a4 tempest-VolumesDeleteCascade-22219732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b.025827d6-6a7b-4431-a8c4-d7850d2b7898 1G" returned: 0 in 0.737s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:54:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-80ee11f2-102c-48a0-89e4-56901b49b5a4 tempest-VolumesDeleteCascade-22219732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b.025827d6-6a7b-4431-a8c4-d7850d2b7898 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:54:15 devstack sudo[106349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b.025827d6-6a7b-4431-a8c4-d7850d2b7898 Jun 17 05:54:15 devstack sudo[106349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:54:15 devstack sudo[106349]: pam_unix(sudo:session): session closed for user root Jun 17 05:54:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-80ee11f2-102c-48a0-89e4-56901b49b5a4 tempest-VolumesDeleteCascade-22219732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b.025827d6-6a7b-4431-a8c4-d7850d2b7898" returned: 0 in 0.628s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:54:15 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [None req-80ee11f2-102c-48a0-89e4-56901b49b5a4 tempest-VolumesDeleteCascade-22219732 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b.025827d6-6a7b-4431-a8c4-d7850d2b7898 is being set with open permissions: ugo+rw Jun 17 05:54:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-80ee11f2-102c-48a0-89e4-56901b49b5a4 tempest-VolumesDeleteCascade-22219732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b.025827d6-6a7b-4431-a8c4-d7850d2b7898 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:54:15 devstack sudo[106354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b.025827d6-6a7b-4431-a8c4-d7850d2b7898 Jun 17 05:54:15 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:54:16 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root Jun 17 05:54:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-80ee11f2-102c-48a0-89e4-56901b49b5a4 tempest-VolumesDeleteCascade-22219732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b.025827d6-6a7b-4431-a8c4-d7850d2b7898" returned: 0 in 0.572s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:54:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-80ee11f2-102c-48a0-89e4-56901b49b5a4 tempest-VolumesDeleteCascade-22219732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b.info {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:54:16 devstack sudo[106363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b.info Jun 17 05:54:16 devstack sudo[106363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:54:16 devstack sudo[106363]: pam_unix(sudo:session): session closed for user root Jun 17 05:54:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-80ee11f2-102c-48a0-89e4-56901b49b5a4 tempest-VolumesDeleteCascade-22219732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b.info" returned: 0 in 0.594s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:54:16 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [None req-80ee11f2-102c-48a0-89e4-56901b49b5a4 tempest-VolumesDeleteCascade-22219732 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b.info is being set with open permissions: ugo+rw Jun 17 05:54:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-80ee11f2-102c-48a0-89e4-56901b49b5a4 tempest-VolumesDeleteCascade-22219732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b.info {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:54:17 devstack sudo[106366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b.info Jun 17 05:54:17 devstack sudo[106366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:54:17 devstack sudo[106366]: pam_unix(sudo:session): session closed for user root Jun 17 05:54:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-80ee11f2-102c-48a0-89e4-56901b49b5a4 tempest-VolumesDeleteCascade-22219732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b.info" returned: 0 in 0.587s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:54:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-80ee11f2-102c-48a0-89e4-56901b49b5a4 tempest-VolumesDeleteCascade-22219732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.914s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:54:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-b152f112-3bbe-4920-af55-67c3274e2a24 tempest-SnapshotDependencyTests-1947412681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.639s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:54:17 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-b152f112-3bbe-4920-af55-67c3274e2a24 tempest-SnapshotDependencyTests-1947412681 None] Acquiring lock "cinder-quobyte-7fdb44ac-e92f-4593-a8d9-49a2c0e82144-9ae02f6c-230f-454d-b14b-e3227437724d" by "_create_volume_from_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:54:17 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-b152f112-3bbe-4920-af55-67c3274e2a24 tempest-SnapshotDependencyTests-1947412681 None] Lock "cinder-quobyte-7fdb44ac-e92f-4593-a8d9-49a2c0e82144-9ae02f6c-230f-454d-b14b-e3227437724d" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:54:17 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-b152f112-3bbe-4920-af55-67c3274e2a24 tempest-SnapshotDependencyTests-1947412681 None] Creating volume 9ae02f6c-230f-454d-b14b-e3227437724d from snapshot 7fdb44ac-e92f-4593-a8d9-49a2c0e82144 {{(pid=92083) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 17 05:54:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-b152f112-3bbe-4920-af55-67c3274e2a24 tempest-SnapshotDependencyTests-1947412681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:54:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-b152f112-3bbe-4920-af55-67c3274e2a24 tempest-SnapshotDependencyTests-1947412681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:54:17 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-b152f112-3bbe-4920-af55-67c3274e2a24 tempest-SnapshotDependencyTests-1947412681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:54:17 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-b152f112-3bbe-4920-af55-67c3274e2a24 tempest-SnapshotDependencyTests-1947412681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:54:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-b152f112-3bbe-4920-af55-67c3274e2a24 tempest-SnapshotDependencyTests-1947412681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:54:17 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-b152f112-3bbe-4920-af55-67c3274e2a24 tempest-SnapshotDependencyTests-1947412681 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:54:17 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-b152f112-3bbe-4920-af55-67c3274e2a24 tempest-SnapshotDependencyTests-1947412681 None] Acquiring lock "cinder-quobyte-9ae02f6c-230f-454d-b14b-e3227437724d" by "_copy_volume_from_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:54:17 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-b152f112-3bbe-4920-af55-67c3274e2a24 tempest-SnapshotDependencyTests-1947412681 None] Lock "cinder-quobyte-9ae02f6c-230f-454d-b14b-e3227437724d" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:54:17 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-b152f112-3bbe-4920-af55-67c3274e2a24 tempest-SnapshotDependencyTests-1947412681 None] snapshot: 7fdb44ac-e92f-4593-a8d9-49a2c0e82144, volume: 9ae02f6c-230f-454d-b14b-e3227437724d, {{(pid=92083) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 17 05:54:17 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-80ee11f2-102c-48a0-89e4-56901b49b5a4 tempest-VolumesDeleteCascade-22219732 None] Create snapshot completed successfully Jun 17 05:54:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-b152f112-3bbe-4920-af55-67c3274e2a24 tempest-SnapshotDependencyTests-1947412681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:54:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-b152f112-3bbe-4920-af55-67c3274e2a24 tempest-SnapshotDependencyTests-1947412681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:54:17 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-b152f112-3bbe-4920-af55-67c3274e2a24 tempest-SnapshotDependencyTests-1947412681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:54:17 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-b152f112-3bbe-4920-af55-67c3274e2a24 tempest-SnapshotDependencyTests-1947412681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:54:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-b152f112-3bbe-4920-af55-67c3274e2a24 tempest-SnapshotDependencyTests-1947412681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:54:17 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[890b41a3-1a48-4f52-ab65-82cd013af7d8]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:54:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b152f112-3bbe-4920-af55-67c3274e2a24 tempest-SnapshotDependencyTests-1947412681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bb05deff-28b0-4794-8c82-2f288858b5a7.7fdb44ac-e92f-4593-a8d9-49a2c0e82144 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:54:17 devstack sudo[106369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bb05deff-28b0-4794-8c82-2f288858b5a7.7fdb44ac-e92f-4593-a8d9-49a2c0e82144 Jun 17 05:54:17 devstack sudo[106369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:54:18 devstack sudo[106369]: pam_unix(sudo:session): session closed for user root Jun 17 05:54:18 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b152f112-3bbe-4920-af55-67c3274e2a24 tempest-SnapshotDependencyTests-1947412681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bb05deff-28b0-4794-8c82-2f288858b5a7.7fdb44ac-e92f-4593-a8d9-49a2c0e82144" returned: 0 in 0.702s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:54:18 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-b152f112-3bbe-4920-af55-67c3274e2a24 tempest-SnapshotDependencyTests-1947412681 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb05deff-28b0-4794-8c82-2f288858b5a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92083) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 05:54:18 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-b152f112-3bbe-4920-af55-67c3274e2a24 tempest-SnapshotDependencyTests-1947412681 None] will copy from snapshot at /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bb05deff-28b0-4794-8c82-2f288858b5a7 {{(pid=92083) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 17 05:54:18 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-b152f112-3bbe-4920-af55-67c3274e2a24 tempest-SnapshotDependencyTests-1947412681 None] Creating direct copy from snapshot {{(pid=92083) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 17 05:54:18 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[9908e4b4-0dca-480d-99f3-27f12d8e6148]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:54:18 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b152f112-3bbe-4920-af55-67c3274e2a24 tempest-SnapshotDependencyTests-1947412681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bb05deff-28b0-4794-8c82-2f288858b5a7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:54:18 devstack sudo[106374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bb05deff-28b0-4794-8c82-2f288858b5a7 Jun 17 05:54:18 devstack sudo[106374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:54:18 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-3236b13c-6513-4809-86c4-b51e4845c0fe tempest-VolumesDeleteCascade-22219732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:54:19 devstack sudo[106374]: pam_unix(sudo:session): session closed for user root Jun 17 05:54:19 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b152f112-3bbe-4920-af55-67c3274e2a24 tempest-SnapshotDependencyTests-1947412681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bb05deff-28b0-4794-8c82-2f288858b5a7" returned: 0 in 0.708s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:54:19 devstack cinder-volume[92083]: DEBUG cinder.utils [None req-b152f112-3bbe-4920-af55-67c3274e2a24 tempest-SnapshotDependencyTests-1947412681 None] Path /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9ae02f6c-230f-454d-b14b-e3227437724d not found in is_blk_device check {{(pid=92083) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 17 05:54:19 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b152f112-3bbe-4920-af55-67c3274e2a24 tempest-SnapshotDependencyTests-1947412681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bb05deff-28b0-4794-8c82-2f288858b5a7 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9ae02f6c-230f-454d-b14b-e3227437724d {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:54:19 devstack sudo[106379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bb05deff-28b0-4794-8c82-2f288858b5a7 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9ae02f6c-230f-454d-b14b-e3227437724d Jun 17 05:54:19 devstack sudo[106379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:54:23 devstack sudo[106379]: pam_unix(sudo:session): session closed for user root Jun 17 05:54:23 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b152f112-3bbe-4920-af55-67c3274e2a24 tempest-SnapshotDependencyTests-1947412681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bb05deff-28b0-4794-8c82-2f288858b5a7 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9ae02f6c-230f-454d-b14b-e3227437724d" returned: 0 in 4.484s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:54:23 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f6dac8-e0d7-4332-aa8c-b47893ba853b]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:54:23 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b152f112-3bbe-4920-af55-67c3274e2a24 tempest-SnapshotDependencyTests-1947412681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bb05deff-28b0-4794-8c82-2f288858b5a7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:54:23 devstack sudo[106393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bb05deff-28b0-4794-8c82-2f288858b5a7 Jun 17 05:54:23 devstack sudo[106393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:54:24 devstack sudo[106393]: pam_unix(sudo:session): session closed for user root Jun 17 05:54:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b152f112-3bbe-4920-af55-67c3274e2a24 tempest-SnapshotDependencyTests-1947412681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bb05deff-28b0-4794-8c82-2f288858b5a7" returned: 0 in 0.894s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:54:24 devstack cinder-volume[92083]: DEBUG cinder.image.image_utils [None req-b152f112-3bbe-4920-af55-67c3274e2a24 tempest-SnapshotDependencyTests-1947412681 None] Image conversion details: src /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bb05deff-28b0-4794-8c82-2f288858b5a7, size 1024.00 MB, duration 4.49 sec, destination /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9ae02f6c-230f-454d-b14b-e3227437724d {{(pid=92083) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 17 05:54:24 devstack cinder-volume[92083]: INFO cinder.image.image_utils [None req-b152f112-3bbe-4920-af55-67c3274e2a24 tempest-SnapshotDependencyTests-1947412681 None] Converted 1024.00 MB image at 228.29 MB/s Jun 17 05:54:24 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [None req-b152f112-3bbe-4920-af55-67c3274e2a24 tempest-SnapshotDependencyTests-1947412681 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9ae02f6c-230f-454d-b14b-e3227437724d is being set with open permissions: ugo+rw Jun 17 05:54:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b152f112-3bbe-4920-af55-67c3274e2a24 tempest-SnapshotDependencyTests-1947412681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9ae02f6c-230f-454d-b14b-e3227437724d {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:54:24 devstack sudo[106398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9ae02f6c-230f-454d-b14b-e3227437724d Jun 17 05:54:24 devstack sudo[106398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:54:25 devstack sudo[106398]: pam_unix(sudo:session): session closed for user root Jun 17 05:54:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b152f112-3bbe-4920-af55-67c3274e2a24 tempest-SnapshotDependencyTests-1947412681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9ae02f6c-230f-454d-b14b-e3227437724d" returned: 0 in 0.578s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:54:25 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-b152f112-3bbe-4920-af55-67c3274e2a24 tempest-SnapshotDependencyTests-1947412681 None] Lock "cinder-quobyte-9ae02f6c-230f-454d-b14b-e3227437724d" released by "_copy_volume_from_snapshot" :: held 7.458s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:54:25 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-b152f112-3bbe-4920-af55-67c3274e2a24 tempest-SnapshotDependencyTests-1947412681 None] Lock "cinder-quobyte-7fdb44ac-e92f-4593-a8d9-49a2c0e82144-9ae02f6c-230f-454d-b14b-e3227437724d" released by "_create_volume_from_snapshot" :: held 7.486s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:54:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-b152f112-3bbe-4920-af55-67c3274e2a24 tempest-SnapshotDependencyTests-1947412681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.507s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:54:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-3236b13c-6513-4809-86c4-b51e4845c0fe tempest-VolumesDeleteCascade-22219732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.534s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:54:25 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-3236b13c-6513-4809-86c4-b51e4845c0fe tempest-VolumesDeleteCascade-22219732 None] Creating offline snapshot bc38c355-37d9-4837-91b1-a50f03796a2f of volume d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b {{(pid=92083) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 17 05:54:25 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b152f112-3bbe-4920-af55-67c3274e2a24 tempest-SnapshotDependencyTests-1947412681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a72ea40b-baa5-45cd-b0cd-11cf865bdcdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ae02f6c-230f-454d-b14b-e3227437724d', 'volume_size': 1, 'snapshot_id': '7fdb44ac-e92f-4593-a8d9-49a2c0e82144'}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:54:25 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b152f112-3bbe-4920-af55-67c3274e2a24 tempest-SnapshotDependencyTests-1947412681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (759156b3-d5b3-4ad5-b0f1-2c5673d195e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:54:25 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e09828-88e8-4fda-b275-02b3cbd72eb7]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:54:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-3236b13c-6513-4809-86c4-b51e4845c0fe tempest-VolumesDeleteCascade-22219732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b.025827d6-6a7b-4431-a8c4-d7850d2b7898 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:54:25 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-b152f112-3bbe-4920-af55-67c3274e2a24 tempest-SnapshotDependencyTests-1947412681 None] Volume volume-9ae02f6c-230f-454d-b14b-e3227437724d (9ae02f6c-230f-454d-b14b-e3227437724d): created successfully Jun 17 05:54:25 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b152f112-3bbe-4920-af55-67c3274e2a24 tempest-SnapshotDependencyTests-1947412681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (759156b3-d5b3-4ad5-b0f1-2c5673d195e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:54:25 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b152f112-3bbe-4920-af55-67c3274e2a24 tempest-SnapshotDependencyTests-1947412681 None] Flow 'volume_create_manager' (2ec3920a-767e-4deb-925b-9975838216a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:54:25 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-b152f112-3bbe-4920-af55-67c3274e2a24 tempest-SnapshotDependencyTests-1947412681 None] Created volume successfully. Jun 17 05:54:25 devstack sudo[106401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b.025827d6-6a7b-4431-a8c4-d7850d2b7898 Jun 17 05:54:25 devstack sudo[106401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:54:25 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-00ffc6ac-2474-4806-a104-8547f3461fba tempest-SnapshotDependencyTests-1947412681 None] Acquiring lock "cinder-7fdb44ac-e92f-4593-a8d9-49a2c0e82144-delete_snapshot" by "delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:54:25 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-00ffc6ac-2474-4806-a104-8547f3461fba tempest-SnapshotDependencyTests-1947412681 None] Lock "cinder-7fdb44ac-e92f-4593-a8d9-49a2c0e82144-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:54:25 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-00ffc6ac-2474-4806-a104-8547f3461fba tempest-SnapshotDependencyTests-1947412681 None] Acquiring lock "cinder-quobyte-bb05deff-28b0-4794-8c82-2f288858b5a7" by "delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:54:25 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-00ffc6ac-2474-4806-a104-8547f3461fba tempest-SnapshotDependencyTests-1947412681 None] Lock "cinder-quobyte-bb05deff-28b0-4794-8c82-2f288858b5a7" acquired by "delete_snapshot" :: waited 0.017s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:54:25 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-00ffc6ac-2474-4806-a104-8547f3461fba tempest-SnapshotDependencyTests-1947412681 None] Acquiring lock "cinder-quobyte-7fdb44ac-e92f-4593-a8d9-49a2c0e82144" by "_delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:54:25 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-00ffc6ac-2474-4806-a104-8547f3461fba tempest-SnapshotDependencyTests-1947412681 None] Lock "cinder-quobyte-7fdb44ac-e92f-4593-a8d9-49a2c0e82144" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:54:25 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-00ffc6ac-2474-4806-a104-8547f3461fba tempest-SnapshotDependencyTests-1947412681 None] Deleting offline snapshot 7fdb44ac-e92f-4593-a8d9-49a2c0e82144 of volume bb05deff-28b0-4794-8c82-2f288858b5a7 {{(pid=92083) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 17 05:54:25 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-00ffc6ac-2474-4806-a104-8547f3461fba tempest-SnapshotDependencyTests-1947412681 None] snapshot_file for this snap is: volume-bb05deff-28b0-4794-8c82-2f288858b5a7.7fdb44ac-e92f-4593-a8d9-49a2c0e82144 {{(pid=92083) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 17 05:54:25 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[13dfc90a-9bdd-42dc-abcd-a9b70eff09b0]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:54:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-00ffc6ac-2474-4806-a104-8547f3461fba tempest-SnapshotDependencyTests-1947412681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bb05deff-28b0-4794-8c82-2f288858b5a7.7fdb44ac-e92f-4593-a8d9-49a2c0e82144 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:54:25 devstack sudo[106401]: pam_unix(sudo:session): session closed for user root Jun 17 05:54:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-3236b13c-6513-4809-86c4-b51e4845c0fe tempest-VolumesDeleteCascade-22219732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b.025827d6-6a7b-4431-a8c4-d7850d2b7898" returned: 0 in 0.731s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:54:25 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-3236b13c-6513-4809-86c4-b51e4845c0fe tempest-VolumesDeleteCascade-22219732 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92083) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 05:54:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-3236b13c-6513-4809-86c4-b51e4845c0fe tempest-VolumesDeleteCascade-22219732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b.025827d6-6a7b-4431-a8c4-d7850d2b7898,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b.bc38c355-37d9-4837-91b1-a50f03796a2f 1G {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:54:25 devstack sudo[106407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b.025827d6-6a7b-4431-a8c4-d7850d2b7898,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b.bc38c355-37d9-4837-91b1-a50f03796a2f 1G Jun 17 05:54:25 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:54:25 devstack sudo[106406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bb05deff-28b0-4794-8c82-2f288858b5a7.7fdb44ac-e92f-4593-a8d9-49a2c0e82144 Jun 17 05:54:25 devstack sudo[106406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:54:26 devstack sudo[106406]: pam_unix(sudo:session): session closed for user root Jun 17 05:54:26 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-00ffc6ac-2474-4806-a104-8547f3461fba tempest-SnapshotDependencyTests-1947412681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bb05deff-28b0-4794-8c82-2f288858b5a7.7fdb44ac-e92f-4593-a8d9-49a2c0e82144" returned: 0 in 0.721s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:54:26 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-00ffc6ac-2474-4806-a104-8547f3461fba tempest-SnapshotDependencyTests-1947412681 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb05deff-28b0-4794-8c82-2f288858b5a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92083) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 05:54:26 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6bfecf8-f8e9-4800-8571-5f731f3b6f68]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:54:26 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-00ffc6ac-2474-4806-a104-8547f3461fba tempest-SnapshotDependencyTests-1947412681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bb05deff-28b0-4794-8c82-2f288858b5a7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:54:26 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root Jun 17 05:54:26 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-3236b13c-6513-4809-86c4-b51e4845c0fe tempest-VolumesDeleteCascade-22219732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b.025827d6-6a7b-4431-a8c4-d7850d2b7898,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b.bc38c355-37d9-4837-91b1-a50f03796a2f 1G" returned: 0 in 0.754s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:54:26 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-3236b13c-6513-4809-86c4-b51e4845c0fe tempest-VolumesDeleteCascade-22219732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b.025827d6-6a7b-4431-a8c4-d7850d2b7898 -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b.bc38c355-37d9-4837-91b1-a50f03796a2f {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:54:26 devstack sudo[106417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bb05deff-28b0-4794-8c82-2f288858b5a7 Jun 17 05:54:26 devstack sudo[106417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:54:26 devstack sudo[106418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b.025827d6-6a7b-4431-a8c4-d7850d2b7898 -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b.bc38c355-37d9-4837-91b1-a50f03796a2f Jun 17 05:54:26 devstack sudo[106418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:54:27 devstack sudo[106417]: pam_unix(sudo:session): session closed for user root Jun 17 05:54:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-00ffc6ac-2474-4806-a104-8547f3461fba tempest-SnapshotDependencyTests-1947412681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bb05deff-28b0-4794-8c82-2f288858b5a7" returned: 0 in 0.708s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:54:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-00ffc6ac-2474-4806-a104-8547f3461fba tempest-SnapshotDependencyTests-1947412681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bb05deff-28b0-4794-8c82-2f288858b5a7.7fdb44ac-e92f-4593-a8d9-49a2c0e82144 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:54:27 devstack sudo[106418]: pam_unix(sudo:session): session closed for user root Jun 17 05:54:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-3236b13c-6513-4809-86c4-b51e4845c0fe tempest-VolumesDeleteCascade-22219732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b.025827d6-6a7b-4431-a8c4-d7850d2b7898 -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b.bc38c355-37d9-4837-91b1-a50f03796a2f" returned: 0 in 0.638s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:54:27 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [None req-3236b13c-6513-4809-86c4-b51e4845c0fe tempest-VolumesDeleteCascade-22219732 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b.bc38c355-37d9-4837-91b1-a50f03796a2f is being set with open permissions: ugo+rw Jun 17 05:54:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-3236b13c-6513-4809-86c4-b51e4845c0fe tempest-VolumesDeleteCascade-22219732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b.bc38c355-37d9-4837-91b1-a50f03796a2f {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:54:27 devstack sudo[106427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bb05deff-28b0-4794-8c82-2f288858b5a7.7fdb44ac-e92f-4593-a8d9-49a2c0e82144 Jun 17 05:54:27 devstack sudo[106427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:54:27 devstack sudo[106428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b.bc38c355-37d9-4837-91b1-a50f03796a2f Jun 17 05:54:27 devstack sudo[106428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:54:27 devstack cinder-volume[92083]: DEBUG oslo_service.periodic_task [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92083) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 05:54:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:54:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:54:27 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:54:27 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:54:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:54:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:54:27 devstack sudo[106431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:54:27 devstack sudo[106431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:54:27 devstack sudo[106428]: pam_unix(sudo:session): session closed for user root Jun 17 05:54:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-3236b13c-6513-4809-86c4-b51e4845c0fe tempest-VolumesDeleteCascade-22219732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b.bc38c355-37d9-4837-91b1-a50f03796a2f" returned: 0 in 0.598s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:54:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-3236b13c-6513-4809-86c4-b51e4845c0fe tempest-VolumesDeleteCascade-22219732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.850s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:54:27 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-3236b13c-6513-4809-86c4-b51e4845c0fe tempest-VolumesDeleteCascade-22219732 None] Create snapshot completed successfully Jun 17 05:54:27 devstack sudo[106427]: pam_unix(sudo:session): session closed for user root Jun 17 05:54:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-00ffc6ac-2474-4806-a104-8547f3461fba tempest-SnapshotDependencyTests-1947412681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bb05deff-28b0-4794-8c82-2f288858b5a7.7fdb44ac-e92f-4593-a8d9-49a2c0e82144" returned: 0 in 0.706s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:54:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-00ffc6ac-2474-4806-a104-8547f3461fba tempest-SnapshotDependencyTests-1947412681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bb05deff-28b0-4794-8c82-2f288858b5a7.7fdb44ac-e92f-4593-a8d9-49a2c0e82144 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:54:28 devstack sudo[106437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bb05deff-28b0-4794-8c82-2f288858b5a7.7fdb44ac-e92f-4593-a8d9-49a2c0e82144 Jun 17 05:54:28 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:54:28 devstack sudo[106431]: pam_unix(sudo:session): session closed for user root Jun 17 05:54:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.639s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:54:28 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:54:28 devstack cinder-volume[92083]: DEBUG oslo_service.periodic_task [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running periodic task VolumeManager._thread_info {{(pid=92083) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 05:54:28 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] thread count: 28 {{(pid=92083) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 17 05:54:28 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] thread info: [<_MainThread(MainThread, started 133483869905024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92083) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 17 05:54:28 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root Jun 17 05:54:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-00ffc6ac-2474-4806-a104-8547f3461fba tempest-SnapshotDependencyTests-1947412681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bb05deff-28b0-4794-8c82-2f288858b5a7.7fdb44ac-e92f-4593-a8d9-49a2c0e82144" returned: 0 in 0.604s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:54:28 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-00ffc6ac-2474-4806-a104-8547f3461fba tempest-SnapshotDependencyTests-1947412681 None] Lock "cinder-quobyte-7fdb44ac-e92f-4593-a8d9-49a2c0e82144" released by "_delete_snapshot" :: held 2.833s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:54:28 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-00ffc6ac-2474-4806-a104-8547f3461fba tempest-SnapshotDependencyTests-1947412681 None] Lock "cinder-quobyte-bb05deff-28b0-4794-8c82-2f288858b5a7" released by "delete_snapshot" :: held 2.857s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:54:28 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-00ffc6ac-2474-4806-a104-8547f3461fba tempest-SnapshotDependencyTests-1947412681 None] Created reservations ['5330f450-a7f2-4201-aa37-26fe65bac312', '56efa863-d2d4-4886-9cda-c69d21aec328', 'a45d3306-3bd7-47a4-9b1d-1aefd72727c5', '5e3e919d-caa0-4b45-8a41-05cb83128e7d'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:54:28 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-00ffc6ac-2474-4806-a104-8547f3461fba tempest-SnapshotDependencyTests-1947412681 None] Delete snapshot completed successfully. Jun 17 05:54:28 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-00ffc6ac-2474-4806-a104-8547f3461fba tempest-SnapshotDependencyTests-1947412681 None] Lock "cinder-7fdb44ac-e92f-4593-a8d9-49a2c0e82144-delete_snapshot" released by "delete_snapshot" :: held 2.983s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:54:28 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-fdf9020e-aea1-4938-ac47-f8f4b6d11e21 tempest-SnapshotDependencyTests-1947412681 None] Acquiring lock "cinder-bb05deff-28b0-4794-8c82-2f288858b5a7-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:54:28 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-fdf9020e-aea1-4938-ac47-f8f4b6d11e21 tempest-SnapshotDependencyTests-1947412681 None] Lock "cinder-bb05deff-28b0-4794-8c82-2f288858b5a7-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:54:29 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-fdf9020e-aea1-4938-ac47-f8f4b6d11e21 tempest-SnapshotDependencyTests-1947412681 None] Acquiring lock "cinder-quobyte-bb05deff-28b0-4794-8c82-2f288858b5a7" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:54:29 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-fdf9020e-aea1-4938-ac47-f8f4b6d11e21 tempest-SnapshotDependencyTests-1947412681 None] Lock "cinder-quobyte-bb05deff-28b0-4794-8c82-2f288858b5a7" acquired by "delete_volume" :: waited 0.017s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:54:29 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cbf36fa-e307-4b9a-96a0-2786b3c0e0c3]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:54:29 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-fdf9020e-aea1-4938-ac47-f8f4b6d11e21 tempest-SnapshotDependencyTests-1947412681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bb05deff-28b0-4794-8c82-2f288858b5a7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:54:29 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] Acquiring lock "cinder-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:54:29 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] Lock "cinder-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:54:29 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] Performing cascade delete. {{(pid=92083) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jun 17 05:54:29 devstack sudo[106442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bb05deff-28b0-4794-8c82-2f288858b5a7 Jun 17 05:54:29 devstack sudo[106442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:54:29 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] Acquiring lock "cinder-025827d6-6a7b-4431-a8c4-d7850d2b7898-delete_snapshot" by "delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:54:29 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] Lock "cinder-025827d6-6a7b-4431-a8c4-d7850d2b7898-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:54:29 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] Acquiring lock "cinder-quobyte-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b" by "delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:54:29 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] Lock "cinder-quobyte-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b" acquired by "delete_snapshot" :: waited 0.015s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:54:29 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] Acquiring lock "cinder-quobyte-025827d6-6a7b-4431-a8c4-d7850d2b7898" by "_delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:54:29 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] Lock "cinder-quobyte-025827d6-6a7b-4431-a8c4-d7850d2b7898" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:54:29 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] Deleting offline snapshot 025827d6-6a7b-4431-a8c4-d7850d2b7898 of volume d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b {{(pid=92083) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 17 05:54:29 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] snapshot_file for this snap is: volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b.025827d6-6a7b-4431-a8c4-d7850d2b7898 {{(pid=92083) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 17 05:54:29 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea0966b-bec6-4fdd-b537-b6e853e6aa10]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:54:29 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b.025827d6-6a7b-4431-a8c4-d7850d2b7898 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:54:29 devstack sudo[106445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b.025827d6-6a7b-4431-a8c4-d7850d2b7898 Jun 17 05:54:29 devstack sudo[106445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:54:29 devstack sudo[106442]: pam_unix(sudo:session): session closed for user root Jun 17 05:54:29 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-fdf9020e-aea1-4938-ac47-f8f4b6d11e21 tempest-SnapshotDependencyTests-1947412681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bb05deff-28b0-4794-8c82-2f288858b5a7" returned: 0 in 0.729s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:54:29 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-fdf9020e-aea1-4938-ac47-f8f4b6d11e21 tempest-SnapshotDependencyTests-1947412681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bb05deff-28b0-4794-8c82-2f288858b5a7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:54:29 devstack sudo[106450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bb05deff-28b0-4794-8c82-2f288858b5a7 Jun 17 05:54:29 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:54:29 devstack sudo[106445]: pam_unix(sudo:session): session closed for user root Jun 17 05:54:29 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b.025827d6-6a7b-4431-a8c4-d7850d2b7898" returned: 0 in 0.707s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:54:29 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92083) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 05:54:29 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc7c3176-3a9a-42da-abf1-ec294a7c1d75]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:54:29 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:54:30 devstack sudo[106455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b Jun 17 05:54:30 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:54:30 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root Jun 17 05:54:30 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-fdf9020e-aea1-4938-ac47-f8f4b6d11e21 tempest-SnapshotDependencyTests-1947412681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-bb05deff-28b0-4794-8c82-2f288858b5a7" returned: 0 in 0.616s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:54:30 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-fdf9020e-aea1-4938-ac47-f8f4b6d11e21 tempest-SnapshotDependencyTests-1947412681 None] Lock "cinder-quobyte-bb05deff-28b0-4794-8c82-2f288858b5a7" released by "delete_volume" :: held 1.411s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:54:30 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-fdf9020e-aea1-4938-ac47-f8f4b6d11e21 tempest-SnapshotDependencyTests-1947412681 None] Created reservations ['216ea138-795d-4b87-ba0d-792249aa81e7', '09ef9bd5-97a8-432f-b133-0e94c05d10f8', '08b390fb-2122-4029-beb5-02f52e0828d9', 'bc3b0d50-f93d-4c5e-a526-5a6b8dea5cbe'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:54:30 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-fdf9020e-aea1-4938-ac47-f8f4b6d11e21 tempest-SnapshotDependencyTests-1947412681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:54:30 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-fdf9020e-aea1-4938-ac47-f8f4b6d11e21 tempest-SnapshotDependencyTests-1947412681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:54:30 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-fdf9020e-aea1-4938-ac47-f8f4b6d11e21 tempest-SnapshotDependencyTests-1947412681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:54:30 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-fdf9020e-aea1-4938-ac47-f8f4b6d11e21 tempest-SnapshotDependencyTests-1947412681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:54:30 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-fdf9020e-aea1-4938-ac47-f8f4b6d11e21 tempest-SnapshotDependencyTests-1947412681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:54:30 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-fdf9020e-aea1-4938-ac47-f8f4b6d11e21 tempest-SnapshotDependencyTests-1947412681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:54:30 devstack sudo[106458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:54:30 devstack sudo[106458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:54:30 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root Jun 17 05:54:30 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b" returned: 0 in 0.732s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:54:30 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb01c68-aa0d-4dbb-a68e-932c70f366c5]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:54:30 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b.bc38c355-37d9-4837-91b1-a50f03796a2f {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:54:30 devstack sudo[106463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b.bc38c355-37d9-4837-91b1-a50f03796a2f Jun 17 05:54:30 devstack sudo[106463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:54:31 devstack sudo[106458]: pam_unix(sudo:session): session closed for user root Jun 17 05:54:31 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-fdf9020e-aea1-4938-ac47-f8f4b6d11e21 tempest-SnapshotDependencyTests-1947412681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.588s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:54:31 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-fdf9020e-aea1-4938-ac47-f8f4b6d11e21 tempest-SnapshotDependencyTests-1947412681 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:54:31 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-fdf9020e-aea1-4938-ac47-f8f4b6d11e21 tempest-SnapshotDependencyTests-1947412681 None] Deleted volume successfully. Jun 17 05:54:31 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-fdf9020e-aea1-4938-ac47-f8f4b6d11e21 tempest-SnapshotDependencyTests-1947412681 None] Lock "cinder-bb05deff-28b0-4794-8c82-2f288858b5a7-delete_volume" released by "delete_volume" :: held 2.201s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:54:31 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-818e8438-17ff-4122-8c77-8432121755c7 tempest-SnapshotDependencyTests-1947412681 None] Acquiring lock "cinder-9ae02f6c-230f-454d-b14b-e3227437724d-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:54:31 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-818e8438-17ff-4122-8c77-8432121755c7 tempest-SnapshotDependencyTests-1947412681 None] Lock "cinder-9ae02f6c-230f-454d-b14b-e3227437724d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:54:31 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-818e8438-17ff-4122-8c77-8432121755c7 tempest-SnapshotDependencyTests-1947412681 None] Acquiring lock "cinder-quobyte-9ae02f6c-230f-454d-b14b-e3227437724d" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:54:31 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-818e8438-17ff-4122-8c77-8432121755c7 tempest-SnapshotDependencyTests-1947412681 None] Lock "cinder-quobyte-9ae02f6c-230f-454d-b14b-e3227437724d" acquired by "delete_volume" :: waited 0.018s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:54:31 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[621f09e8-9898-41bf-95a5-1227a41d613a]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:54:31 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-818e8438-17ff-4122-8c77-8432121755c7 tempest-SnapshotDependencyTests-1947412681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9ae02f6c-230f-454d-b14b-e3227437724d {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:54:31 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9ae02f6c-230f-454d-b14b-e3227437724d Jun 17 05:54:31 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:54:31 devstack sudo[106463]: pam_unix(sudo:session): session closed for user root Jun 17 05:54:31 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b.bc38c355-37d9-4837-91b1-a50f03796a2f" returned: 0 in 0.762s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:54:31 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92083) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 05:54:31 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[343f6076-3c00-41fb-8fc0-4914b81158eb]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:54:31 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b.025827d6-6a7b-4431-a8c4-d7850d2b7898 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:54:31 devstack sudo[106507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b.025827d6-6a7b-4431-a8c4-d7850d2b7898 Jun 17 05:54:31 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:54:31 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Jun 17 05:54:31 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-818e8438-17ff-4122-8c77-8432121755c7 tempest-SnapshotDependencyTests-1947412681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9ae02f6c-230f-454d-b14b-e3227437724d" returned: 0 in 0.718s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:54:31 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-818e8438-17ff-4122-8c77-8432121755c7 tempest-SnapshotDependencyTests-1947412681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9ae02f6c-230f-454d-b14b-e3227437724d {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:54:32 devstack sudo[106514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9ae02f6c-230f-454d-b14b-e3227437724d Jun 17 05:54:32 devstack sudo[106514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:54:32 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root Jun 17 05:54:32 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b.025827d6-6a7b-4431-a8c4-d7850d2b7898" returned: 0 in 0.713s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:54:32 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92083) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 05:54:32 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[386abf2f-378f-43c4-8adf-5b57bab2703c]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:54:32 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:54:32 devstack sudo[106519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b Jun 17 05:54:32 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:54:32 devstack sudo[106514]: pam_unix(sudo:session): session closed for user root Jun 17 05:54:32 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-818e8438-17ff-4122-8c77-8432121755c7 tempest-SnapshotDependencyTests-1947412681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9ae02f6c-230f-454d-b14b-e3227437724d" returned: 0 in 0.597s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:54:32 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-818e8438-17ff-4122-8c77-8432121755c7 tempest-SnapshotDependencyTests-1947412681 None] Lock "cinder-quobyte-9ae02f6c-230f-454d-b14b-e3227437724d" released by "delete_volume" :: held 1.358s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:54:32 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-818e8438-17ff-4122-8c77-8432121755c7 tempest-SnapshotDependencyTests-1947412681 None] Created reservations ['8cf7b625-5faa-40da-a2ff-ed34479646d5', 'ed44d757-1fc0-41ec-b80e-62b5d96e8068', 'a54fa48e-9698-4af2-a644-8e8be181eb36', 'b655b4d5-2045-4c1d-b45d-48860d9d5a4f'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:54:32 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-818e8438-17ff-4122-8c77-8432121755c7 tempest-SnapshotDependencyTests-1947412681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:54:32 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-818e8438-17ff-4122-8c77-8432121755c7 tempest-SnapshotDependencyTests-1947412681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:54:32 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-818e8438-17ff-4122-8c77-8432121755c7 tempest-SnapshotDependencyTests-1947412681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:54:32 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-818e8438-17ff-4122-8c77-8432121755c7 tempest-SnapshotDependencyTests-1947412681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:54:32 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-818e8438-17ff-4122-8c77-8432121755c7 tempest-SnapshotDependencyTests-1947412681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:54:32 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-818e8438-17ff-4122-8c77-8432121755c7 tempest-SnapshotDependencyTests-1947412681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:54:32 devstack sudo[106522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:54:32 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:54:32 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root Jun 17 05:54:32 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b" returned: 0 in 0.711s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:54:32 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b.025827d6-6a7b-4431-a8c4-d7850d2b7898 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:54:33 devstack sudo[106527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b.025827d6-6a7b-4431-a8c4-d7850d2b7898 Jun 17 05:54:33 devstack sudo[106527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:54:33 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root Jun 17 05:54:33 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-818e8438-17ff-4122-8c77-8432121755c7 tempest-SnapshotDependencyTests-1947412681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.610s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:54:33 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-818e8438-17ff-4122-8c77-8432121755c7 tempest-SnapshotDependencyTests-1947412681 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:54:33 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-818e8438-17ff-4122-8c77-8432121755c7 tempest-SnapshotDependencyTests-1947412681 None] Deleted volume successfully. Jun 17 05:54:33 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-818e8438-17ff-4122-8c77-8432121755c7 tempest-SnapshotDependencyTests-1947412681 None] Lock "cinder-9ae02f6c-230f-454d-b14b-e3227437724d-delete_volume" released by "delete_volume" :: held 2.168s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:54:33 devstack sudo[106527]: pam_unix(sudo:session): session closed for user root Jun 17 05:54:33 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b.025827d6-6a7b-4431-a8c4-d7850d2b7898" returned: 0 in 0.661s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:54:33 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b.025827d6-6a7b-4431-a8c4-d7850d2b7898 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:54:33 devstack sudo[106534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b.025827d6-6a7b-4431-a8c4-d7850d2b7898 Jun 17 05:54:33 devstack sudo[106534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:54:34 devstack sudo[106534]: pam_unix(sudo:session): session closed for user root Jun 17 05:54:34 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b.025827d6-6a7b-4431-a8c4-d7850d2b7898" returned: 0 in 0.617s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:54:34 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b.bc38c355-37d9-4837-91b1-a50f03796a2f -F qcow2 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:54:34 devstack sudo[106537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b.bc38c355-37d9-4837-91b1-a50f03796a2f -F qcow2 Jun 17 05:54:34 devstack sudo[106537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:54:34 devstack sudo[106537]: pam_unix(sudo:session): session closed for user root Jun 17 05:54:34 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b.bc38c355-37d9-4837-91b1-a50f03796a2f -F qcow2" returned: 0 in 0.662s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:54:34 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] Lock "cinder-quobyte-025827d6-6a7b-4431-a8c4-d7850d2b7898" released by "_delete_snapshot" :: held 5.741s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:54:34 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] Lock "cinder-quobyte-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b" released by "delete_snapshot" :: held 5.760s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:54:35 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] Created reservations ['26a42ea7-fbe6-424a-9d48-d8f450f26d6b', 'e8bde34d-43ef-487f-ba1b-d3341e646cce', 'b6c72381-8264-441e-9b64-c68e83310020', '2c15257b-53b0-4822-a5fc-312f2dfb4f9e'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:54:35 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] Delete snapshot completed successfully. Jun 17 05:54:35 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] Lock "cinder-025827d6-6a7b-4431-a8c4-d7850d2b7898-delete_snapshot" released by "delete_snapshot" :: held 5.901s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:54:35 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] Acquiring lock "cinder-bc38c355-37d9-4837-91b1-a50f03796a2f-delete_snapshot" by "delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:54:35 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] Lock "cinder-bc38c355-37d9-4837-91b1-a50f03796a2f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:54:35 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] Acquiring lock "cinder-quobyte-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b" by "delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:54:35 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] Lock "cinder-quobyte-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b" acquired by "delete_snapshot" :: waited 0.016s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:54:35 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] Acquiring lock "cinder-quobyte-bc38c355-37d9-4837-91b1-a50f03796a2f" by "_delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:54:35 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] Lock "cinder-quobyte-bc38c355-37d9-4837-91b1-a50f03796a2f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:54:35 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] Deleting offline snapshot bc38c355-37d9-4837-91b1-a50f03796a2f of volume d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b {{(pid=92083) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 17 05:54:35 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] snapshot_file for this snap is: volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b.bc38c355-37d9-4837-91b1-a50f03796a2f {{(pid=92083) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 17 05:54:35 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f576ff-676f-435f-9aad-0c200256adc1]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:54:35 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b.bc38c355-37d9-4837-91b1-a50f03796a2f {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:54:35 devstack sudo[106543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b.bc38c355-37d9-4837-91b1-a50f03796a2f Jun 17 05:54:35 devstack sudo[106543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:54:35 devstack sudo[106543]: pam_unix(sudo:session): session closed for user root Jun 17 05:54:35 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b.bc38c355-37d9-4837-91b1-a50f03796a2f" returned: 0 in 0.749s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:54:35 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92083) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 05:54:35 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f0e2a5-f21c-480d-8e0d-38415d3a2fb8]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:54:35 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:54:36 devstack sudo[106548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b Jun 17 05:54:36 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:54:36 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root Jun 17 05:54:36 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b" returned: 0 in 0.750s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:54:36 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b.bc38c355-37d9-4837-91b1-a50f03796a2f {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:54:36 devstack sudo[106554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b.bc38c355-37d9-4837-91b1-a50f03796a2f Jun 17 05:54:36 devstack sudo[106554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:54:37 devstack sudo[106554]: pam_unix(sudo:session): session closed for user root Jun 17 05:54:37 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b.bc38c355-37d9-4837-91b1-a50f03796a2f" returned: 0 in 0.701s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:54:37 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b.bc38c355-37d9-4837-91b1-a50f03796a2f {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:54:37 devstack sudo[106559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b.bc38c355-37d9-4837-91b1-a50f03796a2f Jun 17 05:54:37 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:54:38 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root Jun 17 05:54:38 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b.bc38c355-37d9-4837-91b1-a50f03796a2f" returned: 0 in 0.652s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:54:38 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] Lock "cinder-quobyte-bc38c355-37d9-4837-91b1-a50f03796a2f" released by "_delete_snapshot" :: held 2.956s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:54:38 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] Lock "cinder-quobyte-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b" released by "delete_snapshot" :: held 2.979s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:54:38 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] Created reservations ['627e9434-f819-4f84-b417-88e608744cd6', '41c4ed96-3d70-4ad3-940a-714e79c833ad', 'afb265d3-1c7d-4ad5-9ff7-4fa8aefd06f7', 'a04f2521-09e7-4ed0-8532-9c0802739e26'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:54:38 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] Delete snapshot completed successfully. Jun 17 05:54:38 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] Lock "cinder-bc38c355-37d9-4837-91b1-a50f03796a2f-delete_snapshot" released by "delete_snapshot" :: held 3.159s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:54:38 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] Snapshots deleted, issuing volume delete {{(pid=92083) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jun 17 05:54:38 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] Acquiring lock "cinder-quobyte-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:54:38 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] Lock "cinder-quobyte-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b" acquired by "delete_volume" :: waited 0.013s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:54:38 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[143a3509-f543-45ab-b5a0-db3e91ed28de]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:54:38 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:54:38 devstack sudo[106563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b Jun 17 05:54:38 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:54:39 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root Jun 17 05:54:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b" returned: 0 in 0.700s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:54:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:54:39 devstack sudo[106568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b Jun 17 05:54:39 devstack sudo[106568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:54:39 devstack sudo[106568]: pam_unix(sudo:session): session closed for user root Jun 17 05:54:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b" returned: 0 in 0.601s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:54:39 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] Lock "cinder-quobyte-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b" released by "delete_volume" :: held 1.369s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:54:39 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] Created reservations ['88d274e1-99ca-44c8-8cae-94e38246bf30', 'f6e511da-d269-4c61-8a73-d024f25754db', '3fb2bf41-7e9c-4715-91a2-678d212d3701', '1bdf51fa-6d51-4e54-8a65-01aa78602468'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:54:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:54:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:54:39 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:54:39 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:54:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:54:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:54:39 devstack sudo[106572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:54:39 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:54:40 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad43265f-4d4e-49b1-9e62-71c760c33efe tempest-VolumesDeleteCascade-22219732 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:54:40 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ad43265f-4d4e-49b1-9e62-71c760c33efe tempest-VolumesDeleteCascade-22219732 None] Flow 'volume_create_manager' (edb46ac2-c93c-460c-a12f-2a0f852ee556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:54:40 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ad43265f-4d4e-49b1-9e62-71c760c33efe tempest-VolumesDeleteCascade-22219732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64199ace-d225-4d13-9c59-8bc76cef837d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:54:40 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root Jun 17 05:54:40 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.748s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:54:40 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:54:40 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] Deleted volume successfully. Jun 17 05:54:40 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ad43265f-4d4e-49b1-9e62-71c760c33efe tempest-VolumesDeleteCascade-22219732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64199ace-d225-4d13-9c59-8bc76cef837d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:54:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2005658445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b62be142-96e1-4f7d-bfab-79d5afa22c71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dad2c3983474049a6c1498cf6d7be87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:54:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:54:40Z,use_quota=True,user_id='5e078b618d6a42d187b6909db187bb36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:54:40 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ad43265f-4d4e-49b1-9e62-71c760c33efe tempest-VolumesDeleteCascade-22219732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8599831-6c6f-4ad0-8e51-14ee8a707184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:54:40 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ad43265f-4d4e-49b1-9e62-71c760c33efe tempest-VolumesDeleteCascade-22219732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8599831-6c6f-4ad0-8e51-14ee8a707184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:54:40 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ad43265f-4d4e-49b1-9e62-71c760c33efe tempest-VolumesDeleteCascade-22219732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af70b44d-d3c7-41c0-bec6-3e5c795e00da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:54:40 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ad43265f-4d4e-49b1-9e62-71c760c33efe tempest-VolumesDeleteCascade-22219732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af70b44d-d3c7-41c0-bec6-3e5c795e00da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b62be142-96e1-4f7d-bfab-79d5afa22c71', 'volume_name': 'volume-b62be142-96e1-4f7d-bfab-79d5afa22c71', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:54:40 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ad43265f-4d4e-49b1-9e62-71c760c33efe tempest-VolumesDeleteCascade-22219732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64af9218-b6ef-472a-8bde-bc6404f47034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:54:40 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ad43265f-4d4e-49b1-9e62-71c760c33efe tempest-VolumesDeleteCascade-22219732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64af9218-b6ef-472a-8bde-bc6404f47034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:54:40 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ad43265f-4d4e-49b1-9e62-71c760c33efe tempest-VolumesDeleteCascade-22219732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (568a4277-3fe1-4f05-9d35-5bd250869c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:54:40 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-ad43265f-4d4e-49b1-9e62-71c760c33efe tempest-VolumesDeleteCascade-22219732 None] Volume b62be142-96e1-4f7d-bfab-79d5afa22c71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b62be142-96e1-4f7d-bfab-79d5afa22c71', 'volume_size': 1} Jun 17 05:54:40 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ad43265f-4d4e-49b1-9e62-71c760c33efe tempest-VolumesDeleteCascade-22219732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:54:40 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ad43265f-4d4e-49b1-9e62-71c760c33efe tempest-VolumesDeleteCascade-22219732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:54:40 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ad43265f-4d4e-49b1-9e62-71c760c33efe tempest-VolumesDeleteCascade-22219732 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:54:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2005658445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b62be142-96e1-4f7d-bfab-79d5afa22c71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dad2c3983474049a6c1498cf6d7be87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:54:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:54:40Z,use_quota=True,user_id='5e078b618d6a42d187b6909db187bb36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:54:40 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-ad43265f-4d4e-49b1-9e62-71c760c33efe tempest-VolumesDeleteCascade-22219732 None] Creating volume b62be142-96e1-4f7d-bfab-79d5afa22c71 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:54:40 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ad43265f-4d4e-49b1-9e62-71c760c33efe tempest-VolumesDeleteCascade-22219732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:54:40 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ad43265f-4d4e-49b1-9e62-71c760c33efe tempest-VolumesDeleteCascade-22219732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:54:40 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ad43265f-4d4e-49b1-9e62-71c760c33efe tempest-VolumesDeleteCascade-22219732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:54:40 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ad43265f-4d4e-49b1-9e62-71c760c33efe tempest-VolumesDeleteCascade-22219732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:54:40 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ad43265f-4d4e-49b1-9e62-71c760c33efe tempest-VolumesDeleteCascade-22219732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:54:40 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ad43265f-4d4e-49b1-9e62-71c760c33efe tempest-VolumesDeleteCascade-22219732 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:54:40 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-ad43265f-4d4e-49b1-9e62-71c760c33efe tempest-VolumesDeleteCascade-22219732 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:54:40 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ad43265f-4d4e-49b1-9e62-71c760c33efe tempest-VolumesDeleteCascade-22219732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b62be142-96e1-4f7d-bfab-79d5afa22c71 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:54:40 devstack sudo[106575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b62be142-96e1-4f7d-bfab-79d5afa22c71 1073741824 Jun 17 05:54:40 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:54:40 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-1d257e21-f11d-42a6-bb0b-e5b6b5e36311 tempest-VolumesDeleteCascade-22219732 None] Lock "cinder-d2c23fb7-41c4-40a3-a8cc-1ad3f9fc582b-delete_volume" released by "delete_volume" :: held 11.529s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:54:41 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root Jun 17 05:54:41 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ad43265f-4d4e-49b1-9e62-71c760c33efe tempest-VolumesDeleteCascade-22219732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b62be142-96e1-4f7d-bfab-79d5afa22c71 1073741824" returned: 0 in 0.810s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:54:41 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ad43265f-4d4e-49b1-9e62-71c760c33efe tempest-VolumesDeleteCascade-22219732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b62be142-96e1-4f7d-bfab-79d5afa22c71 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:54:41 devstack sudo[106582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b62be142-96e1-4f7d-bfab-79d5afa22c71 Jun 17 05:54:41 devstack sudo[106582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:54:42 devstack sudo[106582]: pam_unix(sudo:session): session closed for user root Jun 17 05:54:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ad43265f-4d4e-49b1-9e62-71c760c33efe tempest-VolumesDeleteCascade-22219732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b62be142-96e1-4f7d-bfab-79d5afa22c71" returned: 0 in 0.640s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:54:42 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ad43265f-4d4e-49b1-9e62-71c760c33efe tempest-VolumesDeleteCascade-22219732 None] <== create_volume: return (1496ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:54:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ad43265f-4d4e-49b1-9e62-71c760c33efe tempest-VolumesDeleteCascade-22219732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.499s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:54:42 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ad43265f-4d4e-49b1-9e62-71c760c33efe tempest-VolumesDeleteCascade-22219732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (568a4277-3fe1-4f05-9d35-5bd250869c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b62be142-96e1-4f7d-bfab-79d5afa22c71', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:54:42 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ad43265f-4d4e-49b1-9e62-71c760c33efe tempest-VolumesDeleteCascade-22219732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c4b4391-9137-4226-a464-4dcb75d868e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:54:42 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-ad43265f-4d4e-49b1-9e62-71c760c33efe tempest-VolumesDeleteCascade-22219732 None] Volume volume-b62be142-96e1-4f7d-bfab-79d5afa22c71 (b62be142-96e1-4f7d-bfab-79d5afa22c71): created successfully Jun 17 05:54:42 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ad43265f-4d4e-49b1-9e62-71c760c33efe tempest-VolumesDeleteCascade-22219732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c4b4391-9137-4226-a464-4dcb75d868e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:54:42 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ad43265f-4d4e-49b1-9e62-71c760c33efe tempest-VolumesDeleteCascade-22219732 None] Flow 'volume_create_manager' (edb46ac2-c93c-460c-a12f-2a0f852ee556) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:54:42 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-ad43265f-4d4e-49b1-9e62-71c760c33efe tempest-VolumesDeleteCascade-22219732 None] Created volume successfully. Jun 17 05:54:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-c74750a7-8c6a-45be-93d9-fb60de3eb6a2 tempest-VolumesDeleteCascade-22219732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:54:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-c74750a7-8c6a-45be-93d9-fb60de3eb6a2 tempest-VolumesDeleteCascade-22219732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:54:42 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-c74750a7-8c6a-45be-93d9-fb60de3eb6a2 tempest-VolumesDeleteCascade-22219732 None] Creating offline snapshot fdd9cbfb-9bbf-4761-a4c2-6d10ced4874c of volume b62be142-96e1-4f7d-bfab-79d5afa22c71 {{(pid=92083) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 17 05:54:42 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[4030b6de-f180-40fc-8a53-6e89bac268a0]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:54:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c74750a7-8c6a-45be-93d9-fb60de3eb6a2 tempest-VolumesDeleteCascade-22219732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b62be142-96e1-4f7d-bfab-79d5afa22c71 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:54:42 devstack sudo[106585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b62be142-96e1-4f7d-bfab-79d5afa22c71 Jun 17 05:54:42 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:54:43 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root Jun 17 05:54:43 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c74750a7-8c6a-45be-93d9-fb60de3eb6a2 tempest-VolumesDeleteCascade-22219732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b62be142-96e1-4f7d-bfab-79d5afa22c71" returned: 0 in 0.719s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:54:43 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c74750a7-8c6a-45be-93d9-fb60de3eb6a2 tempest-VolumesDeleteCascade-22219732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b62be142-96e1-4f7d-bfab-79d5afa22c71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b62be142-96e1-4f7d-bfab-79d5afa22c71.fdd9cbfb-9bbf-4761-a4c2-6d10ced4874c 1G {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:54:43 devstack sudo[106590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b62be142-96e1-4f7d-bfab-79d5afa22c71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b62be142-96e1-4f7d-bfab-79d5afa22c71.fdd9cbfb-9bbf-4761-a4c2-6d10ced4874c 1G Jun 17 05:54:43 devstack sudo[106590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:54:44 devstack sudo[106590]: pam_unix(sudo:session): session closed for user root Jun 17 05:54:44 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c74750a7-8c6a-45be-93d9-fb60de3eb6a2 tempest-VolumesDeleteCascade-22219732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b62be142-96e1-4f7d-bfab-79d5afa22c71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b62be142-96e1-4f7d-bfab-79d5afa22c71.fdd9cbfb-9bbf-4761-a4c2-6d10ced4874c 1G" returned: 0 in 0.723s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:54:44 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c74750a7-8c6a-45be-93d9-fb60de3eb6a2 tempest-VolumesDeleteCascade-22219732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b62be142-96e1-4f7d-bfab-79d5afa22c71 -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b62be142-96e1-4f7d-bfab-79d5afa22c71.fdd9cbfb-9bbf-4761-a4c2-6d10ced4874c {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:54:44 devstack sudo[106595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b62be142-96e1-4f7d-bfab-79d5afa22c71 -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b62be142-96e1-4f7d-bfab-79d5afa22c71.fdd9cbfb-9bbf-4761-a4c2-6d10ced4874c Jun 17 05:54:44 devstack sudo[106595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:54:44 devstack sudo[106595]: pam_unix(sudo:session): session closed for user root Jun 17 05:54:44 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c74750a7-8c6a-45be-93d9-fb60de3eb6a2 tempest-VolumesDeleteCascade-22219732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b62be142-96e1-4f7d-bfab-79d5afa22c71 -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b62be142-96e1-4f7d-bfab-79d5afa22c71.fdd9cbfb-9bbf-4761-a4c2-6d10ced4874c" returned: 0 in 0.611s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:54:44 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [None req-c74750a7-8c6a-45be-93d9-fb60de3eb6a2 tempest-VolumesDeleteCascade-22219732 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b62be142-96e1-4f7d-bfab-79d5afa22c71.fdd9cbfb-9bbf-4761-a4c2-6d10ced4874c is being set with open permissions: ugo+rw Jun 17 05:54:44 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c74750a7-8c6a-45be-93d9-fb60de3eb6a2 tempest-VolumesDeleteCascade-22219732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b62be142-96e1-4f7d-bfab-79d5afa22c71.fdd9cbfb-9bbf-4761-a4c2-6d10ced4874c {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:54:44 devstack sudo[106600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b62be142-96e1-4f7d-bfab-79d5afa22c71.fdd9cbfb-9bbf-4761-a4c2-6d10ced4874c Jun 17 05:54:44 devstack sudo[106600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:54:45 devstack sudo[106600]: pam_unix(sudo:session): session closed for user root Jun 17 05:54:45 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c74750a7-8c6a-45be-93d9-fb60de3eb6a2 tempest-VolumesDeleteCascade-22219732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b62be142-96e1-4f7d-bfab-79d5afa22c71.fdd9cbfb-9bbf-4761-a4c2-6d10ced4874c" returned: 0 in 0.573s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:54:45 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c74750a7-8c6a-45be-93d9-fb60de3eb6a2 tempest-VolumesDeleteCascade-22219732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b62be142-96e1-4f7d-bfab-79d5afa22c71.info {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:54:45 devstack sudo[106603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b62be142-96e1-4f7d-bfab-79d5afa22c71.info Jun 17 05:54:45 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:54:46 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root Jun 17 05:54:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c74750a7-8c6a-45be-93d9-fb60de3eb6a2 tempest-VolumesDeleteCascade-22219732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b62be142-96e1-4f7d-bfab-79d5afa22c71.info" returned: 0 in 0.579s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:54:46 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [None req-c74750a7-8c6a-45be-93d9-fb60de3eb6a2 tempest-VolumesDeleteCascade-22219732 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b62be142-96e1-4f7d-bfab-79d5afa22c71.info is being set with open permissions: ugo+rw Jun 17 05:54:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c74750a7-8c6a-45be-93d9-fb60de3eb6a2 tempest-VolumesDeleteCascade-22219732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b62be142-96e1-4f7d-bfab-79d5afa22c71.info {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:54:46 devstack sudo[106606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b62be142-96e1-4f7d-bfab-79d5afa22c71.info Jun 17 05:54:46 devstack sudo[106606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:54:46 devstack sudo[106606]: pam_unix(sudo:session): session closed for user root Jun 17 05:54:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c74750a7-8c6a-45be-93d9-fb60de3eb6a2 tempest-VolumesDeleteCascade-22219732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b62be142-96e1-4f7d-bfab-79d5afa22c71.info" returned: 0 in 0.599s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:54:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-c74750a7-8c6a-45be-93d9-fb60de3eb6a2 tempest-VolumesDeleteCascade-22219732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.904s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:54:46 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-c74750a7-8c6a-45be-93d9-fb60de3eb6a2 tempest-VolumesDeleteCascade-22219732 None] Create snapshot completed successfully Jun 17 05:54:47 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-64712a5e-9935-48a3-8c2f-42429503e23e tempest-VolumesDeleteCascade-22219732 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:54:47 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-64712a5e-9935-48a3-8c2f-42429503e23e tempest-VolumesDeleteCascade-22219732 None] Flow 'volume_create_manager' (80340391-29e3-418d-b4cc-f9eddc5714ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:54:47 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-64712a5e-9935-48a3-8c2f-42429503e23e tempest-VolumesDeleteCascade-22219732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a876f89-0eca-438c-b786-bb8e0821aa8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:54:47 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-64712a5e-9935-48a3-8c2f-42429503e23e tempest-VolumesDeleteCascade-22219732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a876f89-0eca-438c-b786-bb8e0821aa8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:54:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1947209152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b1170e9-f248-4df5-8e0b-124dc0293790,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dad2c3983474049a6c1498cf6d7be87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:54:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fdd9cbfb-9bbf-4761-a4c2-6d10ced4874c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:54:47Z,use_quota=True,user_id='5e078b618d6a42d187b6909db187bb36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:54:47 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-64712a5e-9935-48a3-8c2f-42429503e23e tempest-VolumesDeleteCascade-22219732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9822b287-bab5-49ec-b11a-62169aefcef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:54:47 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-64712a5e-9935-48a3-8c2f-42429503e23e tempest-VolumesDeleteCascade-22219732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9822b287-bab5-49ec-b11a-62169aefcef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:54:47 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-64712a5e-9935-48a3-8c2f-42429503e23e tempest-VolumesDeleteCascade-22219732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e28c75a9-0c25-4564-9eef-71d3981920f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:54:47 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-64712a5e-9935-48a3-8c2f-42429503e23e tempest-VolumesDeleteCascade-22219732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e28c75a9-0c25-4564-9eef-71d3981920f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4b1170e9-f248-4df5-8e0b-124dc0293790', 'volume_name': 'volume-4b1170e9-f248-4df5-8e0b-124dc0293790', 'volume_size': 1, 'snapshot_id': 'fdd9cbfb-9bbf-4761-a4c2-6d10ced4874c'}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:54:47 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-64712a5e-9935-48a3-8c2f-42429503e23e tempest-VolumesDeleteCascade-22219732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5b5422f-5782-4904-b431-e0b99551a581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:54:47 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-64712a5e-9935-48a3-8c2f-42429503e23e tempest-VolumesDeleteCascade-22219732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5b5422f-5782-4904-b431-e0b99551a581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:54:47 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-64712a5e-9935-48a3-8c2f-42429503e23e tempest-VolumesDeleteCascade-22219732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (095a2cdd-5e28-4051-a90c-103fc85c27d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:54:47 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-64712a5e-9935-48a3-8c2f-42429503e23e tempest-VolumesDeleteCascade-22219732 None] Volume 4b1170e9-f248-4df5-8e0b-124dc0293790: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4b1170e9-f248-4df5-8e0b-124dc0293790', 'volume_size': 1, 'snapshot_id': 'fdd9cbfb-9bbf-4761-a4c2-6d10ced4874c'} Jun 17 05:54:47 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-64712a5e-9935-48a3-8c2f-42429503e23e tempest-VolumesDeleteCascade-22219732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:54:47 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-64712a5e-9935-48a3-8c2f-42429503e23e tempest-VolumesDeleteCascade-22219732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:54:47 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-64712a5e-9935-48a3-8c2f-42429503e23e tempest-VolumesDeleteCascade-22219732 None] Acquiring lock "cinder-quobyte-fdd9cbfb-9bbf-4761-a4c2-6d10ced4874c-4b1170e9-f248-4df5-8e0b-124dc0293790" by "_create_volume_from_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:54:47 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-64712a5e-9935-48a3-8c2f-42429503e23e tempest-VolumesDeleteCascade-22219732 None] Lock "cinder-quobyte-fdd9cbfb-9bbf-4761-a4c2-6d10ced4874c-4b1170e9-f248-4df5-8e0b-124dc0293790" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:54:47 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-64712a5e-9935-48a3-8c2f-42429503e23e tempest-VolumesDeleteCascade-22219732 None] Creating volume 4b1170e9-f248-4df5-8e0b-124dc0293790 from snapshot fdd9cbfb-9bbf-4761-a4c2-6d10ced4874c {{(pid=92083) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 17 05:54:47 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-64712a5e-9935-48a3-8c2f-42429503e23e tempest-VolumesDeleteCascade-22219732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:54:47 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-64712a5e-9935-48a3-8c2f-42429503e23e tempest-VolumesDeleteCascade-22219732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:54:47 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-64712a5e-9935-48a3-8c2f-42429503e23e tempest-VolumesDeleteCascade-22219732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:54:47 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-64712a5e-9935-48a3-8c2f-42429503e23e tempest-VolumesDeleteCascade-22219732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:54:47 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-64712a5e-9935-48a3-8c2f-42429503e23e tempest-VolumesDeleteCascade-22219732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:54:47 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-64712a5e-9935-48a3-8c2f-42429503e23e tempest-VolumesDeleteCascade-22219732 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:54:47 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-64712a5e-9935-48a3-8c2f-42429503e23e tempest-VolumesDeleteCascade-22219732 None] Acquiring lock "cinder-quobyte-4b1170e9-f248-4df5-8e0b-124dc0293790" by "_copy_volume_from_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:54:47 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-64712a5e-9935-48a3-8c2f-42429503e23e tempest-VolumesDeleteCascade-22219732 None] Lock "cinder-quobyte-4b1170e9-f248-4df5-8e0b-124dc0293790" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:54:47 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-64712a5e-9935-48a3-8c2f-42429503e23e tempest-VolumesDeleteCascade-22219732 None] snapshot: fdd9cbfb-9bbf-4761-a4c2-6d10ced4874c, volume: 4b1170e9-f248-4df5-8e0b-124dc0293790, {{(pid=92083) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 17 05:54:47 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-64712a5e-9935-48a3-8c2f-42429503e23e tempest-VolumesDeleteCascade-22219732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:54:47 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-64712a5e-9935-48a3-8c2f-42429503e23e tempest-VolumesDeleteCascade-22219732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:54:47 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-64712a5e-9935-48a3-8c2f-42429503e23e tempest-VolumesDeleteCascade-22219732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:54:47 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-64712a5e-9935-48a3-8c2f-42429503e23e tempest-VolumesDeleteCascade-22219732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:54:47 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-64712a5e-9935-48a3-8c2f-42429503e23e tempest-VolumesDeleteCascade-22219732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:54:47 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d475f9-21fd-4bb0-9bea-6417ea7e32ce]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:54:47 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-64712a5e-9935-48a3-8c2f-42429503e23e tempest-VolumesDeleteCascade-22219732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b62be142-96e1-4f7d-bfab-79d5afa22c71.fdd9cbfb-9bbf-4761-a4c2-6d10ced4874c {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:54:47 devstack sudo[106609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b62be142-96e1-4f7d-bfab-79d5afa22c71.fdd9cbfb-9bbf-4761-a4c2-6d10ced4874c Jun 17 05:54:47 devstack sudo[106609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:54:48 devstack sudo[106609]: pam_unix(sudo:session): session closed for user root Jun 17 05:54:48 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-64712a5e-9935-48a3-8c2f-42429503e23e tempest-VolumesDeleteCascade-22219732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b62be142-96e1-4f7d-bfab-79d5afa22c71.fdd9cbfb-9bbf-4761-a4c2-6d10ced4874c" returned: 0 in 0.693s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:54:48 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-64712a5e-9935-48a3-8c2f-42429503e23e tempest-VolumesDeleteCascade-22219732 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b62be142-96e1-4f7d-bfab-79d5afa22c71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92083) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 05:54:48 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-64712a5e-9935-48a3-8c2f-42429503e23e tempest-VolumesDeleteCascade-22219732 None] will copy from snapshot at /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b62be142-96e1-4f7d-bfab-79d5afa22c71 {{(pid=92083) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 17 05:54:48 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-64712a5e-9935-48a3-8c2f-42429503e23e tempest-VolumesDeleteCascade-22219732 None] Creating direct copy from snapshot {{(pid=92083) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 17 05:54:48 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34f2d36-1f50-4d1a-a3a3-0c316cd53a81]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:54:48 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-64712a5e-9935-48a3-8c2f-42429503e23e tempest-VolumesDeleteCascade-22219732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b62be142-96e1-4f7d-bfab-79d5afa22c71 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:54:48 devstack sudo[106614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b62be142-96e1-4f7d-bfab-79d5afa22c71 Jun 17 05:54:48 devstack sudo[106614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:54:48 devstack sudo[106614]: pam_unix(sudo:session): session closed for user root Jun 17 05:54:48 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-64712a5e-9935-48a3-8c2f-42429503e23e tempest-VolumesDeleteCascade-22219732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b62be142-96e1-4f7d-bfab-79d5afa22c71" returned: 0 in 0.690s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:54:48 devstack cinder-volume[92083]: DEBUG cinder.utils [None req-64712a5e-9935-48a3-8c2f-42429503e23e tempest-VolumesDeleteCascade-22219732 None] Path /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4b1170e9-f248-4df5-8e0b-124dc0293790 not found in is_blk_device check {{(pid=92083) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 17 05:54:48 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-64712a5e-9935-48a3-8c2f-42429503e23e tempest-VolumesDeleteCascade-22219732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b62be142-96e1-4f7d-bfab-79d5afa22c71 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4b1170e9-f248-4df5-8e0b-124dc0293790 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:54:48 devstack sudo[106619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b62be142-96e1-4f7d-bfab-79d5afa22c71 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4b1170e9-f248-4df5-8e0b-124dc0293790 Jun 17 05:54:48 devstack sudo[106619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:54:53 devstack sudo[106619]: pam_unix(sudo:session): session closed for user root Jun 17 05:54:53 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-64712a5e-9935-48a3-8c2f-42429503e23e tempest-VolumesDeleteCascade-22219732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b62be142-96e1-4f7d-bfab-79d5afa22c71 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4b1170e9-f248-4df5-8e0b-124dc0293790" returned: 0 in 4.406s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:54:53 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[962a2723-b3b9-4db1-842a-a417d5d6791e]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:54:53 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-64712a5e-9935-48a3-8c2f-42429503e23e tempest-VolumesDeleteCascade-22219732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b62be142-96e1-4f7d-bfab-79d5afa22c71 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:54:53 devstack sudo[106634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b62be142-96e1-4f7d-bfab-79d5afa22c71 Jun 17 05:54:53 devstack sudo[106634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:54:54 devstack sudo[106634]: pam_unix(sudo:session): session closed for user root Jun 17 05:54:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-64712a5e-9935-48a3-8c2f-42429503e23e tempest-VolumesDeleteCascade-22219732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b62be142-96e1-4f7d-bfab-79d5afa22c71" returned: 0 in 0.856s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:54:54 devstack cinder-volume[92083]: DEBUG cinder.image.image_utils [None req-64712a5e-9935-48a3-8c2f-42429503e23e tempest-VolumesDeleteCascade-22219732 None] Image conversion details: src /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b62be142-96e1-4f7d-bfab-79d5afa22c71, size 1024.00 MB, duration 4.41 sec, destination /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4b1170e9-f248-4df5-8e0b-124dc0293790 {{(pid=92083) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 17 05:54:54 devstack cinder-volume[92083]: INFO cinder.image.image_utils [None req-64712a5e-9935-48a3-8c2f-42429503e23e tempest-VolumesDeleteCascade-22219732 None] Converted 1024.00 MB image at 232.31 MB/s Jun 17 05:54:54 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [None req-64712a5e-9935-48a3-8c2f-42429503e23e tempest-VolumesDeleteCascade-22219732 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4b1170e9-f248-4df5-8e0b-124dc0293790 is being set with open permissions: ugo+rw Jun 17 05:54:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-64712a5e-9935-48a3-8c2f-42429503e23e tempest-VolumesDeleteCascade-22219732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4b1170e9-f248-4df5-8e0b-124dc0293790 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:54:54 devstack sudo[106639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4b1170e9-f248-4df5-8e0b-124dc0293790 Jun 17 05:54:54 devstack sudo[106639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:54:54 devstack sudo[106639]: pam_unix(sudo:session): session closed for user root Jun 17 05:54:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-64712a5e-9935-48a3-8c2f-42429503e23e tempest-VolumesDeleteCascade-22219732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4b1170e9-f248-4df5-8e0b-124dc0293790" returned: 0 in 0.565s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:54:54 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-64712a5e-9935-48a3-8c2f-42429503e23e tempest-VolumesDeleteCascade-22219732 None] Lock "cinder-quobyte-4b1170e9-f248-4df5-8e0b-124dc0293790" released by "_copy_volume_from_snapshot" :: held 7.300s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:54:54 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-64712a5e-9935-48a3-8c2f-42429503e23e tempest-VolumesDeleteCascade-22219732 None] Lock "cinder-quobyte-fdd9cbfb-9bbf-4761-a4c2-6d10ced4874c-4b1170e9-f248-4df5-8e0b-124dc0293790" released by "_create_volume_from_snapshot" :: held 7.326s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:54:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-64712a5e-9935-48a3-8c2f-42429503e23e tempest-VolumesDeleteCascade-22219732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.342s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:54:54 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-64712a5e-9935-48a3-8c2f-42429503e23e tempest-VolumesDeleteCascade-22219732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (095a2cdd-5e28-4051-a90c-103fc85c27d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b1170e9-f248-4df5-8e0b-124dc0293790', 'volume_size': 1, 'snapshot_id': 'fdd9cbfb-9bbf-4761-a4c2-6d10ced4874c'}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:54:54 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-64712a5e-9935-48a3-8c2f-42429503e23e tempest-VolumesDeleteCascade-22219732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0de50922-154c-4c4c-a126-ef1d9f5f811b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:54:54 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-64712a5e-9935-48a3-8c2f-42429503e23e tempest-VolumesDeleteCascade-22219732 None] Volume volume-4b1170e9-f248-4df5-8e0b-124dc0293790 (4b1170e9-f248-4df5-8e0b-124dc0293790): created successfully Jun 17 05:54:54 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-64712a5e-9935-48a3-8c2f-42429503e23e tempest-VolumesDeleteCascade-22219732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0de50922-154c-4c4c-a126-ef1d9f5f811b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:54:54 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-64712a5e-9935-48a3-8c2f-42429503e23e tempest-VolumesDeleteCascade-22219732 None] Flow 'volume_create_manager' (80340391-29e3-418d-b4cc-f9eddc5714ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:54:54 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-64712a5e-9935-48a3-8c2f-42429503e23e tempest-VolumesDeleteCascade-22219732 None] Created volume successfully. Jun 17 05:54:55 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-bed2b543-8b32-4ecd-a7ad-9580de060b7c tempest-VolumesDeleteCascade-22219732 None] Acquiring lock "cinder-b62be142-96e1-4f7d-bfab-79d5afa22c71-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:54:55 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-bed2b543-8b32-4ecd-a7ad-9580de060b7c tempest-VolumesDeleteCascade-22219732 None] Lock "cinder-b62be142-96e1-4f7d-bfab-79d5afa22c71-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:54:55 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-bed2b543-8b32-4ecd-a7ad-9580de060b7c tempest-VolumesDeleteCascade-22219732 None] Performing cascade delete. {{(pid=92083) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jun 17 05:54:55 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-bed2b543-8b32-4ecd-a7ad-9580de060b7c tempest-VolumesDeleteCascade-22219732 None] Acquiring lock "cinder-fdd9cbfb-9bbf-4761-a4c2-6d10ced4874c-delete_snapshot" by "delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:54:55 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-bed2b543-8b32-4ecd-a7ad-9580de060b7c tempest-VolumesDeleteCascade-22219732 None] Lock "cinder-fdd9cbfb-9bbf-4761-a4c2-6d10ced4874c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:54:55 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-bed2b543-8b32-4ecd-a7ad-9580de060b7c tempest-VolumesDeleteCascade-22219732 None] Acquiring lock "cinder-quobyte-b62be142-96e1-4f7d-bfab-79d5afa22c71" by "delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:54:55 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-bed2b543-8b32-4ecd-a7ad-9580de060b7c tempest-VolumesDeleteCascade-22219732 None] Lock "cinder-quobyte-b62be142-96e1-4f7d-bfab-79d5afa22c71" acquired by "delete_snapshot" :: waited 0.012s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:54:55 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-bed2b543-8b32-4ecd-a7ad-9580de060b7c tempest-VolumesDeleteCascade-22219732 None] Acquiring lock "cinder-quobyte-fdd9cbfb-9bbf-4761-a4c2-6d10ced4874c" by "_delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:54:55 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-bed2b543-8b32-4ecd-a7ad-9580de060b7c tempest-VolumesDeleteCascade-22219732 None] Lock "cinder-quobyte-fdd9cbfb-9bbf-4761-a4c2-6d10ced4874c" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:54:55 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-bed2b543-8b32-4ecd-a7ad-9580de060b7c tempest-VolumesDeleteCascade-22219732 None] Deleting offline snapshot fdd9cbfb-9bbf-4761-a4c2-6d10ced4874c of volume b62be142-96e1-4f7d-bfab-79d5afa22c71 {{(pid=92083) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 17 05:54:55 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-bed2b543-8b32-4ecd-a7ad-9580de060b7c tempest-VolumesDeleteCascade-22219732 None] snapshot_file for this snap is: volume-b62be142-96e1-4f7d-bfab-79d5afa22c71.fdd9cbfb-9bbf-4761-a4c2-6d10ced4874c {{(pid=92083) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 17 05:54:55 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa1780d8-9a1b-4a0c-acd5-72e6ce5ef963]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:54:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-bed2b543-8b32-4ecd-a7ad-9580de060b7c tempest-VolumesDeleteCascade-22219732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b62be142-96e1-4f7d-bfab-79d5afa22c71.fdd9cbfb-9bbf-4761-a4c2-6d10ced4874c {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:54:55 devstack sudo[106642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b62be142-96e1-4f7d-bfab-79d5afa22c71.fdd9cbfb-9bbf-4761-a4c2-6d10ced4874c Jun 17 05:54:55 devstack sudo[106642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:54:55 devstack sudo[106642]: pam_unix(sudo:session): session closed for user root Jun 17 05:54:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-bed2b543-8b32-4ecd-a7ad-9580de060b7c tempest-VolumesDeleteCascade-22219732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b62be142-96e1-4f7d-bfab-79d5afa22c71.fdd9cbfb-9bbf-4761-a4c2-6d10ced4874c" returned: 0 in 0.700s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:54:55 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-bed2b543-8b32-4ecd-a7ad-9580de060b7c tempest-VolumesDeleteCascade-22219732 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b62be142-96e1-4f7d-bfab-79d5afa22c71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92083) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 05:54:55 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[169b9c24-7077-4853-8ab3-49b38fe5e9c5]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:54:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-bed2b543-8b32-4ecd-a7ad-9580de060b7c tempest-VolumesDeleteCascade-22219732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b62be142-96e1-4f7d-bfab-79d5afa22c71 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:54:56 devstack sudo[106647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b62be142-96e1-4f7d-bfab-79d5afa22c71 Jun 17 05:54:56 devstack sudo[106647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:54:56 devstack sudo[106647]: pam_unix(sudo:session): session closed for user root Jun 17 05:54:56 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-bed2b543-8b32-4ecd-a7ad-9580de060b7c tempest-VolumesDeleteCascade-22219732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b62be142-96e1-4f7d-bfab-79d5afa22c71" returned: 0 in 0.676s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:54:56 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-bed2b543-8b32-4ecd-a7ad-9580de060b7c tempest-VolumesDeleteCascade-22219732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b62be142-96e1-4f7d-bfab-79d5afa22c71.fdd9cbfb-9bbf-4761-a4c2-6d10ced4874c {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:54:56 devstack sudo[106652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b62be142-96e1-4f7d-bfab-79d5afa22c71.fdd9cbfb-9bbf-4761-a4c2-6d10ced4874c Jun 17 05:54:56 devstack sudo[106652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:54:57 devstack sudo[106652]: pam_unix(sudo:session): session closed for user root Jun 17 05:54:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-bed2b543-8b32-4ecd-a7ad-9580de060b7c tempest-VolumesDeleteCascade-22219732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b62be142-96e1-4f7d-bfab-79d5afa22c71.fdd9cbfb-9bbf-4761-a4c2-6d10ced4874c" returned: 0 in 0.691s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:54:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-bed2b543-8b32-4ecd-a7ad-9580de060b7c tempest-VolumesDeleteCascade-22219732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b62be142-96e1-4f7d-bfab-79d5afa22c71.fdd9cbfb-9bbf-4761-a4c2-6d10ced4874c {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:54:57 devstack sudo[106659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b62be142-96e1-4f7d-bfab-79d5afa22c71.fdd9cbfb-9bbf-4761-a4c2-6d10ced4874c Jun 17 05:54:57 devstack sudo[106659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:54:57 devstack sudo[106659]: pam_unix(sudo:session): session closed for user root Jun 17 05:54:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-bed2b543-8b32-4ecd-a7ad-9580de060b7c tempest-VolumesDeleteCascade-22219732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b62be142-96e1-4f7d-bfab-79d5afa22c71.fdd9cbfb-9bbf-4761-a4c2-6d10ced4874c" returned: 0 in 0.596s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:54:57 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-bed2b543-8b32-4ecd-a7ad-9580de060b7c tempest-VolumesDeleteCascade-22219732 None] Lock "cinder-quobyte-fdd9cbfb-9bbf-4761-a4c2-6d10ced4874c" released by "_delete_snapshot" :: held 2.753s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:54:57 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-bed2b543-8b32-4ecd-a7ad-9580de060b7c tempest-VolumesDeleteCascade-22219732 None] Lock "cinder-quobyte-b62be142-96e1-4f7d-bfab-79d5afa22c71" released by "delete_snapshot" :: held 2.774s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:54:57 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-bed2b543-8b32-4ecd-a7ad-9580de060b7c tempest-VolumesDeleteCascade-22219732 None] Created reservations ['fc07b542-d384-4a96-bf08-2ae783c698eb', '5eb481b5-1fb1-43f6-828f-5da8f056a76f', '60765083-8c9f-466d-9e41-895816b6f852', '85353a47-d898-4e0f-abf8-53be24074943'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:54:58 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-bed2b543-8b32-4ecd-a7ad-9580de060b7c tempest-VolumesDeleteCascade-22219732 None] Delete snapshot completed successfully. Jun 17 05:54:58 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-bed2b543-8b32-4ecd-a7ad-9580de060b7c tempest-VolumesDeleteCascade-22219732 None] Lock "cinder-fdd9cbfb-9bbf-4761-a4c2-6d10ced4874c-delete_snapshot" released by "delete_snapshot" :: held 2.903s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:54:58 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-bed2b543-8b32-4ecd-a7ad-9580de060b7c tempest-VolumesDeleteCascade-22219732 None] Snapshots deleted, issuing volume delete {{(pid=92083) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jun 17 05:54:58 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-bed2b543-8b32-4ecd-a7ad-9580de060b7c tempest-VolumesDeleteCascade-22219732 None] Acquiring lock "cinder-quobyte-b62be142-96e1-4f7d-bfab-79d5afa22c71" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:54:58 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-bed2b543-8b32-4ecd-a7ad-9580de060b7c tempest-VolumesDeleteCascade-22219732 None] Lock "cinder-quobyte-b62be142-96e1-4f7d-bfab-79d5afa22c71" acquired by "delete_volume" :: waited 0.013s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:54:58 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f612d8-5c47-42db-8012-f34f57361e23]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:54:58 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-bed2b543-8b32-4ecd-a7ad-9580de060b7c tempest-VolumesDeleteCascade-22219732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b62be142-96e1-4f7d-bfab-79d5afa22c71 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:54:58 devstack sudo[106663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b62be142-96e1-4f7d-bfab-79d5afa22c71 Jun 17 05:54:58 devstack sudo[106663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:54:58 devstack sudo[106663]: pam_unix(sudo:session): session closed for user root Jun 17 05:54:58 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-bed2b543-8b32-4ecd-a7ad-9580de060b7c tempest-VolumesDeleteCascade-22219732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b62be142-96e1-4f7d-bfab-79d5afa22c71" returned: 0 in 0.697s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:54:58 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-bed2b543-8b32-4ecd-a7ad-9580de060b7c tempest-VolumesDeleteCascade-22219732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b62be142-96e1-4f7d-bfab-79d5afa22c71 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:54:58 devstack sudo[106668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b62be142-96e1-4f7d-bfab-79d5afa22c71 Jun 17 05:54:58 devstack sudo[106668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:54:59 devstack sudo[106668]: pam_unix(sudo:session): session closed for user root Jun 17 05:54:59 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-bed2b543-8b32-4ecd-a7ad-9580de060b7c tempest-VolumesDeleteCascade-22219732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b62be142-96e1-4f7d-bfab-79d5afa22c71" returned: 0 in 0.593s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:54:59 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-bed2b543-8b32-4ecd-a7ad-9580de060b7c tempest-VolumesDeleteCascade-22219732 None] Lock "cinder-quobyte-b62be142-96e1-4f7d-bfab-79d5afa22c71" released by "delete_volume" :: held 1.346s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:54:59 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-bed2b543-8b32-4ecd-a7ad-9580de060b7c tempest-VolumesDeleteCascade-22219732 None] Created reservations ['bca1e1ff-6d1d-46bb-9c78-54be37644aff', '6f2d2042-df39-4cdf-8622-e6473f7be8d5', 'f085bf33-d2da-446b-b8e0-413eb9c93df4', '0f5e34da-9190-44a2-9ef6-982cbdd04333'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:54:59 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-bed2b543-8b32-4ecd-a7ad-9580de060b7c tempest-VolumesDeleteCascade-22219732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:54:59 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-bed2b543-8b32-4ecd-a7ad-9580de060b7c tempest-VolumesDeleteCascade-22219732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:54:59 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-bed2b543-8b32-4ecd-a7ad-9580de060b7c tempest-VolumesDeleteCascade-22219732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:54:59 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-bed2b543-8b32-4ecd-a7ad-9580de060b7c tempest-VolumesDeleteCascade-22219732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:54:59 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-bed2b543-8b32-4ecd-a7ad-9580de060b7c tempest-VolumesDeleteCascade-22219732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:54:59 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-bed2b543-8b32-4ecd-a7ad-9580de060b7c tempest-VolumesDeleteCascade-22219732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:54:59 devstack sudo[106672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:54:59 devstack sudo[106672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:55:00 devstack sudo[106672]: pam_unix(sudo:session): session closed for user root Jun 17 05:55:00 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-bed2b543-8b32-4ecd-a7ad-9580de060b7c tempest-VolumesDeleteCascade-22219732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.577s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:55:00 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-bed2b543-8b32-4ecd-a7ad-9580de060b7c tempest-VolumesDeleteCascade-22219732 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:55:00 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-bed2b543-8b32-4ecd-a7ad-9580de060b7c tempest-VolumesDeleteCascade-22219732 None] Deleted volume successfully. Jun 17 05:55:00 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-bed2b543-8b32-4ecd-a7ad-9580de060b7c tempest-VolumesDeleteCascade-22219732 None] Lock "cinder-b62be142-96e1-4f7d-bfab-79d5afa22c71-delete_volume" released by "delete_volume" :: held 5.030s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:55:00 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-40302766-e785-4313-9a96-48a1da4f77b8 tempest-VolumesDeleteCascade-22219732 None] Acquiring lock "cinder-4b1170e9-f248-4df5-8e0b-124dc0293790-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:55:00 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-40302766-e785-4313-9a96-48a1da4f77b8 tempest-VolumesDeleteCascade-22219732 None] Lock "cinder-4b1170e9-f248-4df5-8e0b-124dc0293790-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:55:00 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-40302766-e785-4313-9a96-48a1da4f77b8 tempest-VolumesDeleteCascade-22219732 None] Acquiring lock "cinder-quobyte-4b1170e9-f248-4df5-8e0b-124dc0293790" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:55:00 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-40302766-e785-4313-9a96-48a1da4f77b8 tempest-VolumesDeleteCascade-22219732 None] Lock "cinder-quobyte-4b1170e9-f248-4df5-8e0b-124dc0293790" acquired by "delete_volume" :: waited 0.014s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:55:00 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3db84fa-c988-41a5-8306-a8b03f342255]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:55:00 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-40302766-e785-4313-9a96-48a1da4f77b8 tempest-VolumesDeleteCascade-22219732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4b1170e9-f248-4df5-8e0b-124dc0293790 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:55:00 devstack sudo[106675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4b1170e9-f248-4df5-8e0b-124dc0293790 Jun 17 05:55:00 devstack sudo[106675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:55:01 devstack sudo[106675]: pam_unix(sudo:session): session closed for user root Jun 17 05:55:01 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-40302766-e785-4313-9a96-48a1da4f77b8 tempest-VolumesDeleteCascade-22219732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4b1170e9-f248-4df5-8e0b-124dc0293790" returned: 0 in 0.690s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:55:01 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-40302766-e785-4313-9a96-48a1da4f77b8 tempest-VolumesDeleteCascade-22219732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4b1170e9-f248-4df5-8e0b-124dc0293790 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:55:01 devstack sudo[106683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4b1170e9-f248-4df5-8e0b-124dc0293790 Jun 17 05:55:01 devstack sudo[106683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:55:01 devstack sudo[106683]: pam_unix(sudo:session): session closed for user root Jun 17 05:55:01 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-40302766-e785-4313-9a96-48a1da4f77b8 tempest-VolumesDeleteCascade-22219732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4b1170e9-f248-4df5-8e0b-124dc0293790" returned: 0 in 0.571s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:55:01 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-40302766-e785-4313-9a96-48a1da4f77b8 tempest-VolumesDeleteCascade-22219732 None] Lock "cinder-quobyte-4b1170e9-f248-4df5-8e0b-124dc0293790" released by "delete_volume" :: held 1.299s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:55:01 devstack cinder-volume[92083]: DEBUG dbcounter [-] [92083] Writing DB stats cinder:UPDATE=73,cinder:INSERT=21,cinder:SELECT=70,cinder:DELETE=4 {{(pid=92083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:55:01 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-40302766-e785-4313-9a96-48a1da4f77b8 tempest-VolumesDeleteCascade-22219732 None] Created reservations ['11b37ac7-f0d1-4f5c-83f8-77a0af7d9ec9', '9d081b74-fb21-4d17-889a-5b41c64faa8b', '4b7db4f7-ba0d-4ba0-baf5-3a9eb12dcc16', 'eab96874-9858-46dc-9e4b-eae244f71567'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:55:01 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-40302766-e785-4313-9a96-48a1da4f77b8 tempest-VolumesDeleteCascade-22219732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:55:01 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-40302766-e785-4313-9a96-48a1da4f77b8 tempest-VolumesDeleteCascade-22219732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:55:01 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-40302766-e785-4313-9a96-48a1da4f77b8 tempest-VolumesDeleteCascade-22219732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:55:01 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-40302766-e785-4313-9a96-48a1da4f77b8 tempest-VolumesDeleteCascade-22219732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:55:01 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-40302766-e785-4313-9a96-48a1da4f77b8 tempest-VolumesDeleteCascade-22219732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:55:01 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-40302766-e785-4313-9a96-48a1da4f77b8 tempest-VolumesDeleteCascade-22219732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:55:02 devstack sudo[106686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:55:02 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:55:02 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root Jun 17 05:55:02 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-40302766-e785-4313-9a96-48a1da4f77b8 tempest-VolumesDeleteCascade-22219732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.575s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:55:02 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-40302766-e785-4313-9a96-48a1da4f77b8 tempest-VolumesDeleteCascade-22219732 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:55:02 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-40302766-e785-4313-9a96-48a1da4f77b8 tempest-VolumesDeleteCascade-22219732 None] Deleted volume successfully. Jun 17 05:55:02 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-40302766-e785-4313-9a96-48a1da4f77b8 tempest-VolumesDeleteCascade-22219732 None] Lock "cinder-4b1170e9-f248-4df5-8e0b-124dc0293790-delete_volume" released by "delete_volume" :: held 2.054s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:55:05 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c336d2c-9231-444f-b0bd-e8bf31828a18 tempest-VolumesGetTest-698723269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:55:05 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-5c336d2c-9231-444f-b0bd-e8bf31828a18 tempest-VolumesGetTest-698723269 None] Flow 'volume_create_manager' (3eaacb78-a144-49a4-b010-1b9cf196787f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:55:05 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-5c336d2c-9231-444f-b0bd-e8bf31828a18 tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35e0d1d7-100b-4652-a725-c07901a533e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:55:05 devstack cinder-volume[92083]: DEBUG dbcounter [-] [92083] Writing DB stats cinder:SELECT=71,cinder:UPDATE=82,cinder:DELETE=9,cinder:INSERT=21 {{(pid=92083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:55:05 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-5c336d2c-9231-444f-b0bd-e8bf31828a18 tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35e0d1d7-100b-4652-a725-c07901a533e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:55:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1471189395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e908487-da14-4d6f-8aea-0cee75a9dcdc,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c8eb62f49ff94572852bf85c00fa935b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:55:05Z,use_quota=True,user_id='e5372bb75933457aab3cfe0d72de0494',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:55:05 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-5c336d2c-9231-444f-b0bd-e8bf31828a18 tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54e8f11d-2af5-42f3-b39a-17c67c7c3444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:55:05 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-5c336d2c-9231-444f-b0bd-e8bf31828a18 tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54e8f11d-2af5-42f3-b39a-17c67c7c3444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:55:05 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-5c336d2c-9231-444f-b0bd-e8bf31828a18 tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30a1106b-7535-449a-ad57-afa6e3684474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:55:05 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-5c336d2c-9231-444f-b0bd-e8bf31828a18 tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30a1106b-7535-449a-ad57-afa6e3684474) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e908487-da14-4d6f-8aea-0cee75a9dcdc', 'volume_name': 'volume-7e908487-da14-4d6f-8aea-0cee75a9dcdc', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:55:05 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-5c336d2c-9231-444f-b0bd-e8bf31828a18 tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fdfe7e2-03f9-4756-a56b-ac2a0680cb27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:55:05 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-5c336d2c-9231-444f-b0bd-e8bf31828a18 tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fdfe7e2-03f9-4756-a56b-ac2a0680cb27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:55:05 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-5c336d2c-9231-444f-b0bd-e8bf31828a18 tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (853ec066-a5cf-4695-ae07-42f875033f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:55:05 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-5c336d2c-9231-444f-b0bd-e8bf31828a18 tempest-VolumesGetTest-698723269 None] Volume 7e908487-da14-4d6f-8aea-0cee75a9dcdc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e908487-da14-4d6f-8aea-0cee75a9dcdc', 'volume_size': 1} Jun 17 05:55:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-5c336d2c-9231-444f-b0bd-e8bf31828a18 tempest-VolumesGetTest-698723269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:55:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-5c336d2c-9231-444f-b0bd-e8bf31828a18 tempest-VolumesGetTest-698723269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:55:05 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-5c336d2c-9231-444f-b0bd-e8bf31828a18 tempest-VolumesGetTest-698723269 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:55:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1471189395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e908487-da14-4d6f-8aea-0cee75a9dcdc,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c8eb62f49ff94572852bf85c00fa935b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:55:05Z,use_quota=True,user_id='e5372bb75933457aab3cfe0d72de0494',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:55:05 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-5c336d2c-9231-444f-b0bd-e8bf31828a18 tempest-VolumesGetTest-698723269 None] Creating volume 7e908487-da14-4d6f-8aea-0cee75a9dcdc {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:55:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-5c336d2c-9231-444f-b0bd-e8bf31828a18 tempest-VolumesGetTest-698723269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:55:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-5c336d2c-9231-444f-b0bd-e8bf31828a18 tempest-VolumesGetTest-698723269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:55:05 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-5c336d2c-9231-444f-b0bd-e8bf31828a18 tempest-VolumesGetTest-698723269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:55:05 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-5c336d2c-9231-444f-b0bd-e8bf31828a18 tempest-VolumesGetTest-698723269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:55:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-5c336d2c-9231-444f-b0bd-e8bf31828a18 tempest-VolumesGetTest-698723269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:55:05 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-5c336d2c-9231-444f-b0bd-e8bf31828a18 tempest-VolumesGetTest-698723269 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:55:05 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-5c336d2c-9231-444f-b0bd-e8bf31828a18 tempest-VolumesGetTest-698723269 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:55:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-5c336d2c-9231-444f-b0bd-e8bf31828a18 tempest-VolumesGetTest-698723269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7e908487-da14-4d6f-8aea-0cee75a9dcdc 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:55:05 devstack sudo[106690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7e908487-da14-4d6f-8aea-0cee75a9dcdc 1073741824 Jun 17 05:55:05 devstack sudo[106690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:55:06 devstack sudo[106690]: pam_unix(sudo:session): session closed for user root Jun 17 05:55:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-5c336d2c-9231-444f-b0bd-e8bf31828a18 tempest-VolumesGetTest-698723269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7e908487-da14-4d6f-8aea-0cee75a9dcdc 1073741824" returned: 0 in 0.743s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:55:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-5c336d2c-9231-444f-b0bd-e8bf31828a18 tempest-VolumesGetTest-698723269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7e908487-da14-4d6f-8aea-0cee75a9dcdc {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:55:06 devstack sudo[106695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7e908487-da14-4d6f-8aea-0cee75a9dcdc Jun 17 05:55:06 devstack sudo[106695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:55:06 devstack sudo[106695]: pam_unix(sudo:session): session closed for user root Jun 17 05:55:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-5c336d2c-9231-444f-b0bd-e8bf31828a18 tempest-VolumesGetTest-698723269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7e908487-da14-4d6f-8aea-0cee75a9dcdc" returned: 0 in 0.601s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:55:06 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-5c336d2c-9231-444f-b0bd-e8bf31828a18 tempest-VolumesGetTest-698723269 None] <== create_volume: return (1383ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:55:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-5c336d2c-9231-444f-b0bd-e8bf31828a18 tempest-VolumesGetTest-698723269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.385s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:55:06 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-5c336d2c-9231-444f-b0bd-e8bf31828a18 tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (853ec066-a5cf-4695-ae07-42f875033f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e908487-da14-4d6f-8aea-0cee75a9dcdc', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:55:06 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-5c336d2c-9231-444f-b0bd-e8bf31828a18 tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76238da0-642f-4a36-9db6-e3ed2d5d795a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:55:06 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-5c336d2c-9231-444f-b0bd-e8bf31828a18 tempest-VolumesGetTest-698723269 None] Volume volume-7e908487-da14-4d6f-8aea-0cee75a9dcdc (7e908487-da14-4d6f-8aea-0cee75a9dcdc): created successfully Jun 17 05:55:06 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-5c336d2c-9231-444f-b0bd-e8bf31828a18 tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76238da0-642f-4a36-9db6-e3ed2d5d795a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:55:06 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-5c336d2c-9231-444f-b0bd-e8bf31828a18 tempest-VolumesGetTest-698723269 None] Flow 'volume_create_manager' (3eaacb78-a144-49a4-b010-1b9cf196787f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:55:06 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-5c336d2c-9231-444f-b0bd-e8bf31828a18 tempest-VolumesGetTest-698723269 None] Created volume successfully. Jun 17 05:55:08 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-693435ff-4eca-456c-ab0a-2217f6c2423b tempest-VolumesGetTest-698723269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:55:08 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-693435ff-4eca-456c-ab0a-2217f6c2423b tempest-VolumesGetTest-698723269 None] Flow 'volume_create_manager' (172be77b-7a35-4351-9123-5c54e27ac17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:55:08 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-693435ff-4eca-456c-ab0a-2217f6c2423b tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49b05624-08de-4d68-ba22-c1cb177b7aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:55:08 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-693435ff-4eca-456c-ab0a-2217f6c2423b tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49b05624-08de-4d68-ba22-c1cb177b7aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:55:08Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-757220015',display_name='tempest-VolumesGetTest-Volume-1638487189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7886d6ba-8264-4508-acb1-7c4a4148faa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8eb62f49ff94572852bf85c00fa935b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:55:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:55:08Z,use_quota=True,user_id='e5372bb75933457aab3cfe0d72de0494',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:55:08 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-693435ff-4eca-456c-ab0a-2217f6c2423b tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf42a802-5c78-4da6-a611-2b8669267bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:55:08 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-693435ff-4eca-456c-ab0a-2217f6c2423b tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf42a802-5c78-4da6-a611-2b8669267bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:55:08 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-693435ff-4eca-456c-ab0a-2217f6c2423b tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80454025-dbf9-4033-8a81-b687c21cbc76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:55:08 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-693435ff-4eca-456c-ab0a-2217f6c2423b tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80454025-dbf9-4033-8a81-b687c21cbc76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7886d6ba-8264-4508-acb1-7c4a4148faa2', 'volume_name': 'volume-7886d6ba-8264-4508-acb1-7c4a4148faa2', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:55:08 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-693435ff-4eca-456c-ab0a-2217f6c2423b tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64f318e0-5cad-48fa-a1cd-28091cd4dfde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:55:08 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-693435ff-4eca-456c-ab0a-2217f6c2423b tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64f318e0-5cad-48fa-a1cd-28091cd4dfde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:55:08 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-693435ff-4eca-456c-ab0a-2217f6c2423b tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (623690be-05e2-4a5e-837c-6cd4357e3b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:55:08 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-693435ff-4eca-456c-ab0a-2217f6c2423b tempest-VolumesGetTest-698723269 None] Volume 7886d6ba-8264-4508-acb1-7c4a4148faa2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7886d6ba-8264-4508-acb1-7c4a4148faa2', 'volume_size': 1} Jun 17 05:55:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-693435ff-4eca-456c-ab0a-2217f6c2423b tempest-VolumesGetTest-698723269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:55:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-693435ff-4eca-456c-ab0a-2217f6c2423b tempest-VolumesGetTest-698723269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:55:08 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-693435ff-4eca-456c-ab0a-2217f6c2423b tempest-VolumesGetTest-698723269 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:55:08Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-757220015',display_name='tempest-VolumesGetTest-Volume-1638487189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7886d6ba-8264-4508-acb1-7c4a4148faa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8eb62f49ff94572852bf85c00fa935b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:55:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:55:08Z,use_quota=True,user_id='e5372bb75933457aab3cfe0d72de0494',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:55:08 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-693435ff-4eca-456c-ab0a-2217f6c2423b tempest-VolumesGetTest-698723269 None] Creating volume 7886d6ba-8264-4508-acb1-7c4a4148faa2 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:55:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-693435ff-4eca-456c-ab0a-2217f6c2423b tempest-VolumesGetTest-698723269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:55:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-693435ff-4eca-456c-ab0a-2217f6c2423b tempest-VolumesGetTest-698723269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:55:08 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-693435ff-4eca-456c-ab0a-2217f6c2423b tempest-VolumesGetTest-698723269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:55:08 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-693435ff-4eca-456c-ab0a-2217f6c2423b tempest-VolumesGetTest-698723269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:55:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-693435ff-4eca-456c-ab0a-2217f6c2423b tempest-VolumesGetTest-698723269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:55:08 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-693435ff-4eca-456c-ab0a-2217f6c2423b tempest-VolumesGetTest-698723269 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:55:08 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-693435ff-4eca-456c-ab0a-2217f6c2423b tempest-VolumesGetTest-698723269 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:55:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-693435ff-4eca-456c-ab0a-2217f6c2423b tempest-VolumesGetTest-698723269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7886d6ba-8264-4508-acb1-7c4a4148faa2 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:55:08 devstack sudo[106698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7886d6ba-8264-4508-acb1-7c4a4148faa2 1073741824 Jun 17 05:55:08 devstack sudo[106698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:55:08 devstack sudo[106698]: pam_unix(sudo:session): session closed for user root Jun 17 05:55:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-693435ff-4eca-456c-ab0a-2217f6c2423b tempest-VolumesGetTest-698723269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7886d6ba-8264-4508-acb1-7c4a4148faa2 1073741824" returned: 0 in 0.756s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:55:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-693435ff-4eca-456c-ab0a-2217f6c2423b tempest-VolumesGetTest-698723269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7886d6ba-8264-4508-acb1-7c4a4148faa2 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:55:08 devstack sudo[106705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7886d6ba-8264-4508-acb1-7c4a4148faa2 Jun 17 05:55:08 devstack sudo[106705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:55:09 devstack sudo[106705]: pam_unix(sudo:session): session closed for user root Jun 17 05:55:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-693435ff-4eca-456c-ab0a-2217f6c2423b tempest-VolumesGetTest-698723269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7886d6ba-8264-4508-acb1-7c4a4148faa2" returned: 0 in 0.590s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:55:09 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-693435ff-4eca-456c-ab0a-2217f6c2423b tempest-VolumesGetTest-698723269 None] <== create_volume: return (1384ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:55:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-693435ff-4eca-456c-ab0a-2217f6c2423b tempest-VolumesGetTest-698723269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.386s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:55:09 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-693435ff-4eca-456c-ab0a-2217f6c2423b tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (623690be-05e2-4a5e-837c-6cd4357e3b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7886d6ba-8264-4508-acb1-7c4a4148faa2', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:55:09 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-693435ff-4eca-456c-ab0a-2217f6c2423b tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82218357-cb8f-4a25-a74d-eedf49e2c833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:55:09 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-693435ff-4eca-456c-ab0a-2217f6c2423b tempest-VolumesGetTest-698723269 None] Volume volume-7886d6ba-8264-4508-acb1-7c4a4148faa2 (7886d6ba-8264-4508-acb1-7c4a4148faa2): created successfully Jun 17 05:55:09 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-693435ff-4eca-456c-ab0a-2217f6c2423b tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82218357-cb8f-4a25-a74d-eedf49e2c833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:55:09 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-693435ff-4eca-456c-ab0a-2217f6c2423b tempest-VolumesGetTest-698723269 None] Flow 'volume_create_manager' (172be77b-7a35-4351-9123-5c54e27ac17b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:55:09 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-693435ff-4eca-456c-ab0a-2217f6c2423b tempest-VolumesGetTest-698723269 None] Created volume successfully. Jun 17 05:55:10 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-051b32a2-bf9a-4028-a71b-cf0b5ea2eb07 tempest-VolumesGetTest-698723269 None] Acquiring lock "cinder-7886d6ba-8264-4508-acb1-7c4a4148faa2-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:55:10 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-051b32a2-bf9a-4028-a71b-cf0b5ea2eb07 tempest-VolumesGetTest-698723269 None] Lock "cinder-7886d6ba-8264-4508-acb1-7c4a4148faa2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:55:10 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-051b32a2-bf9a-4028-a71b-cf0b5ea2eb07 tempest-VolumesGetTest-698723269 None] Acquiring lock "cinder-quobyte-7886d6ba-8264-4508-acb1-7c4a4148faa2" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:55:10 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-051b32a2-bf9a-4028-a71b-cf0b5ea2eb07 tempest-VolumesGetTest-698723269 None] Lock "cinder-quobyte-7886d6ba-8264-4508-acb1-7c4a4148faa2" acquired by "delete_volume" :: waited 0.014s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:55:10 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c11d49d-7253-4bd2-87a2-59fa61b0acee]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:55:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-051b32a2-bf9a-4028-a71b-cf0b5ea2eb07 tempest-VolumesGetTest-698723269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7886d6ba-8264-4508-acb1-7c4a4148faa2 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:55:10 devstack sudo[107038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7886d6ba-8264-4508-acb1-7c4a4148faa2 Jun 17 05:55:10 devstack sudo[107038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:55:11 devstack sudo[107038]: pam_unix(sudo:session): session closed for user root Jun 17 05:55:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-051b32a2-bf9a-4028-a71b-cf0b5ea2eb07 tempest-VolumesGetTest-698723269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7886d6ba-8264-4508-acb1-7c4a4148faa2" returned: 0 in 0.680s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:55:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-051b32a2-bf9a-4028-a71b-cf0b5ea2eb07 tempest-VolumesGetTest-698723269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7886d6ba-8264-4508-acb1-7c4a4148faa2 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:55:11 devstack sudo[107131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7886d6ba-8264-4508-acb1-7c4a4148faa2 Jun 17 05:55:11 devstack sudo[107131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:55:11 devstack sudo[107131]: pam_unix(sudo:session): session closed for user root Jun 17 05:55:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-051b32a2-bf9a-4028-a71b-cf0b5ea2eb07 tempest-VolumesGetTest-698723269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7886d6ba-8264-4508-acb1-7c4a4148faa2" returned: 0 in 0.572s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:55:11 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-051b32a2-bf9a-4028-a71b-cf0b5ea2eb07 tempest-VolumesGetTest-698723269 None] Lock "cinder-quobyte-7886d6ba-8264-4508-acb1-7c4a4148faa2" released by "delete_volume" :: held 1.291s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:55:11 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-051b32a2-bf9a-4028-a71b-cf0b5ea2eb07 tempest-VolumesGetTest-698723269 None] Created reservations ['888b74d7-ae13-414e-83de-98dec3bb8fb3', '0e38ff27-57a2-46de-baa0-ac28af1eef86', '9e734e40-891f-46c6-85c7-ab543e5a7707', 'b90ea4a1-e727-4d21-a1f4-162c6018e851'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:55:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-051b32a2-bf9a-4028-a71b-cf0b5ea2eb07 tempest-VolumesGetTest-698723269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:55:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-051b32a2-bf9a-4028-a71b-cf0b5ea2eb07 tempest-VolumesGetTest-698723269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:55:11 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-051b32a2-bf9a-4028-a71b-cf0b5ea2eb07 tempest-VolumesGetTest-698723269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:55:11 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-051b32a2-bf9a-4028-a71b-cf0b5ea2eb07 tempest-VolumesGetTest-698723269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:55:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-051b32a2-bf9a-4028-a71b-cf0b5ea2eb07 tempest-VolumesGetTest-698723269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:55:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-051b32a2-bf9a-4028-a71b-cf0b5ea2eb07 tempest-VolumesGetTest-698723269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:55:11 devstack sudo[107134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:55:11 devstack sudo[107134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:55:12 devstack sudo[107134]: pam_unix(sudo:session): session closed for user root Jun 17 05:55:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-051b32a2-bf9a-4028-a71b-cf0b5ea2eb07 tempest-VolumesGetTest-698723269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.577s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:55:12 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-051b32a2-bf9a-4028-a71b-cf0b5ea2eb07 tempest-VolumesGetTest-698723269 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:55:12 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-051b32a2-bf9a-4028-a71b-cf0b5ea2eb07 tempest-VolumesGetTest-698723269 None] Deleted volume successfully. Jun 17 05:55:12 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-051b32a2-bf9a-4028-a71b-cf0b5ea2eb07 tempest-VolumesGetTest-698723269 None] Lock "cinder-7886d6ba-8264-4508-acb1-7c4a4148faa2-delete_volume" released by "delete_volume" :: held 2.052s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:55:12 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-42b3aced-2c82-4d09-b8d6-95d344489147 tempest-VolumesGetTest-698723269 None] Acquiring lock "cinder-7e908487-da14-4d6f-8aea-0cee75a9dcdc-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:55:12 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-42b3aced-2c82-4d09-b8d6-95d344489147 tempest-VolumesGetTest-698723269 None] Lock "cinder-7e908487-da14-4d6f-8aea-0cee75a9dcdc-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:55:12 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-42b3aced-2c82-4d09-b8d6-95d344489147 tempest-VolumesGetTest-698723269 None] Acquiring lock "cinder-quobyte-7e908487-da14-4d6f-8aea-0cee75a9dcdc" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:55:12 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-42b3aced-2c82-4d09-b8d6-95d344489147 tempest-VolumesGetTest-698723269 None] Lock "cinder-quobyte-7e908487-da14-4d6f-8aea-0cee75a9dcdc" acquired by "delete_volume" :: waited 0.017s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:55:12 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[847a6ad3-56ab-4d31-8808-c59c97cc44ec]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:55:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-42b3aced-2c82-4d09-b8d6-95d344489147 tempest-VolumesGetTest-698723269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7e908487-da14-4d6f-8aea-0cee75a9dcdc {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:55:12 devstack sudo[107137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7e908487-da14-4d6f-8aea-0cee75a9dcdc Jun 17 05:55:12 devstack sudo[107137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:55:13 devstack sudo[107137]: pam_unix(sudo:session): session closed for user root Jun 17 05:55:13 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-42b3aced-2c82-4d09-b8d6-95d344489147 tempest-VolumesGetTest-698723269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7e908487-da14-4d6f-8aea-0cee75a9dcdc" returned: 0 in 0.687s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:55:13 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-42b3aced-2c82-4d09-b8d6-95d344489147 tempest-VolumesGetTest-698723269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7e908487-da14-4d6f-8aea-0cee75a9dcdc {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:55:13 devstack sudo[107142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7e908487-da14-4d6f-8aea-0cee75a9dcdc Jun 17 05:55:13 devstack sudo[107142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:55:13 devstack sudo[107142]: pam_unix(sudo:session): session closed for user root Jun 17 05:55:13 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-42b3aced-2c82-4d09-b8d6-95d344489147 tempest-VolumesGetTest-698723269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-7e908487-da14-4d6f-8aea-0cee75a9dcdc" returned: 0 in 0.604s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:55:13 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-42b3aced-2c82-4d09-b8d6-95d344489147 tempest-VolumesGetTest-698723269 None] Lock "cinder-quobyte-7e908487-da14-4d6f-8aea-0cee75a9dcdc" released by "delete_volume" :: held 1.331s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:55:13 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-42b3aced-2c82-4d09-b8d6-95d344489147 tempest-VolumesGetTest-698723269 None] Created reservations ['126e2bd2-6391-44a2-b685-d6c175300de7', '19b40813-d74e-42ac-8ddf-71f6af97c611', '50367910-eed2-4f35-8cf1-94146c7b2d73', '413ba78b-ba9a-4aab-adec-f0c8c53f64f8'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:55:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-42b3aced-2c82-4d09-b8d6-95d344489147 tempest-VolumesGetTest-698723269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:55:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-42b3aced-2c82-4d09-b8d6-95d344489147 tempest-VolumesGetTest-698723269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:55:14 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-42b3aced-2c82-4d09-b8d6-95d344489147 tempest-VolumesGetTest-698723269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:55:14 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-42b3aced-2c82-4d09-b8d6-95d344489147 tempest-VolumesGetTest-698723269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:55:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-42b3aced-2c82-4d09-b8d6-95d344489147 tempest-VolumesGetTest-698723269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:55:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-42b3aced-2c82-4d09-b8d6-95d344489147 tempest-VolumesGetTest-698723269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:55:14 devstack sudo[107145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:55:14 devstack sudo[107145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:55:14 devstack sudo[107145]: pam_unix(sudo:session): session closed for user root Jun 17 05:55:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-42b3aced-2c82-4d09-b8d6-95d344489147 tempest-VolumesGetTest-698723269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.563s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:55:14 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-42b3aced-2c82-4d09-b8d6-95d344489147 tempest-VolumesGetTest-698723269 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:55:14 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-42b3aced-2c82-4d09-b8d6-95d344489147 tempest-VolumesGetTest-698723269 None] Deleted volume successfully. Jun 17 05:55:14 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-42b3aced-2c82-4d09-b8d6-95d344489147 tempest-VolumesGetTest-698723269 None] Lock "cinder-7e908487-da14-4d6f-8aea-0cee75a9dcdc-delete_volume" released by "delete_volume" :: held 2.082s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:55:15 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-d76bbde8-1ca2-4b9f-831c-86a0a38ad565 tempest-VolumesGetTest-698723269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:55:15 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-d76bbde8-1ca2-4b9f-831c-86a0a38ad565 tempest-VolumesGetTest-698723269 None] Flow 'volume_create_manager' (039da7ae-7f91-4cef-a864-3bc066f405a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:55:15 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-d76bbde8-1ca2-4b9f-831c-86a0a38ad565 tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c23cdf64-c9a1-4a2e-b4ad-70d7dcd24111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:55:15 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-d76bbde8-1ca2-4b9f-831c-86a0a38ad565 tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c23cdf64-c9a1-4a2e-b4ad-70d7dcd24111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:55:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1758121299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00d48db5-5aad-4371-a3ab-54dcc631c348,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8eb62f49ff94572852bf85c00fa935b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:55:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:55:15Z,use_quota=True,user_id='e5372bb75933457aab3cfe0d72de0494',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:55:15 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-d76bbde8-1ca2-4b9f-831c-86a0a38ad565 tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33fdb3a2-3ac0-4d0f-8542-7ab01322afe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:55:15 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-d76bbde8-1ca2-4b9f-831c-86a0a38ad565 tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33fdb3a2-3ac0-4d0f-8542-7ab01322afe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:55:15 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-d76bbde8-1ca2-4b9f-831c-86a0a38ad565 tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8676109a-4020-4db0-9e98-eee3b7776c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:55:15 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-d76bbde8-1ca2-4b9f-831c-86a0a38ad565 tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8676109a-4020-4db0-9e98-eee3b7776c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00d48db5-5aad-4371-a3ab-54dcc631c348', 'volume_name': 'volume-00d48db5-5aad-4371-a3ab-54dcc631c348', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:55:15 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-d76bbde8-1ca2-4b9f-831c-86a0a38ad565 tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd8dd230-e8b8-49d4-885f-30c37872ae79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:55:15 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-d76bbde8-1ca2-4b9f-831c-86a0a38ad565 tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd8dd230-e8b8-49d4-885f-30c37872ae79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:55:15 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-d76bbde8-1ca2-4b9f-831c-86a0a38ad565 tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6099cf5-c8aa-49ac-aaec-be6522af074d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:55:15 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-d76bbde8-1ca2-4b9f-831c-86a0a38ad565 tempest-VolumesGetTest-698723269 None] Volume 00d48db5-5aad-4371-a3ab-54dcc631c348: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00d48db5-5aad-4371-a3ab-54dcc631c348', 'volume_size': 1} Jun 17 05:55:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-d76bbde8-1ca2-4b9f-831c-86a0a38ad565 tempest-VolumesGetTest-698723269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:55:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-d76bbde8-1ca2-4b9f-831c-86a0a38ad565 tempest-VolumesGetTest-698723269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:55:15 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-d76bbde8-1ca2-4b9f-831c-86a0a38ad565 tempest-VolumesGetTest-698723269 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:55:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1758121299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00d48db5-5aad-4371-a3ab-54dcc631c348,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8eb62f49ff94572852bf85c00fa935b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:55:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:55:15Z,use_quota=True,user_id='e5372bb75933457aab3cfe0d72de0494',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:55:15 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-d76bbde8-1ca2-4b9f-831c-86a0a38ad565 tempest-VolumesGetTest-698723269 None] Creating volume 00d48db5-5aad-4371-a3ab-54dcc631c348 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:55:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-d76bbde8-1ca2-4b9f-831c-86a0a38ad565 tempest-VolumesGetTest-698723269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:55:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-d76bbde8-1ca2-4b9f-831c-86a0a38ad565 tempest-VolumesGetTest-698723269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:55:15 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-d76bbde8-1ca2-4b9f-831c-86a0a38ad565 tempest-VolumesGetTest-698723269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:55:15 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-d76bbde8-1ca2-4b9f-831c-86a0a38ad565 tempest-VolumesGetTest-698723269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:55:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-d76bbde8-1ca2-4b9f-831c-86a0a38ad565 tempest-VolumesGetTest-698723269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:55:15 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-d76bbde8-1ca2-4b9f-831c-86a0a38ad565 tempest-VolumesGetTest-698723269 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:55:15 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-d76bbde8-1ca2-4b9f-831c-86a0a38ad565 tempest-VolumesGetTest-698723269 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:55:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-d76bbde8-1ca2-4b9f-831c-86a0a38ad565 tempest-VolumesGetTest-698723269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00d48db5-5aad-4371-a3ab-54dcc631c348 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:55:15 devstack sudo[107148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00d48db5-5aad-4371-a3ab-54dcc631c348 1073741824 Jun 17 05:55:15 devstack sudo[107148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:55:15 devstack sudo[107148]: pam_unix(sudo:session): session closed for user root Jun 17 05:55:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-d76bbde8-1ca2-4b9f-831c-86a0a38ad565 tempest-VolumesGetTest-698723269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00d48db5-5aad-4371-a3ab-54dcc631c348 1073741824" returned: 0 in 0.761s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:55:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-d76bbde8-1ca2-4b9f-831c-86a0a38ad565 tempest-VolumesGetTest-698723269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00d48db5-5aad-4371-a3ab-54dcc631c348 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:55:15 devstack sudo[107156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00d48db5-5aad-4371-a3ab-54dcc631c348 Jun 17 05:55:15 devstack sudo[107156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:55:16 devstack sudo[107156]: pam_unix(sudo:session): session closed for user root Jun 17 05:55:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-d76bbde8-1ca2-4b9f-831c-86a0a38ad565 tempest-VolumesGetTest-698723269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00d48db5-5aad-4371-a3ab-54dcc631c348" returned: 0 in 0.586s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:55:16 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-d76bbde8-1ca2-4b9f-831c-86a0a38ad565 tempest-VolumesGetTest-698723269 None] <== create_volume: return (1390ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:55:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-d76bbde8-1ca2-4b9f-831c-86a0a38ad565 tempest-VolumesGetTest-698723269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.391s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:55:16 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-d76bbde8-1ca2-4b9f-831c-86a0a38ad565 tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6099cf5-c8aa-49ac-aaec-be6522af074d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00d48db5-5aad-4371-a3ab-54dcc631c348', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:55:16 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-d76bbde8-1ca2-4b9f-831c-86a0a38ad565 tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (981686c6-1c3d-4d07-90b5-ebb68252ff29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:55:16 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-d76bbde8-1ca2-4b9f-831c-86a0a38ad565 tempest-VolumesGetTest-698723269 None] Volume volume-00d48db5-5aad-4371-a3ab-54dcc631c348 (00d48db5-5aad-4371-a3ab-54dcc631c348): created successfully Jun 17 05:55:16 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-d76bbde8-1ca2-4b9f-831c-86a0a38ad565 tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (981686c6-1c3d-4d07-90b5-ebb68252ff29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:55:16 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-d76bbde8-1ca2-4b9f-831c-86a0a38ad565 tempest-VolumesGetTest-698723269 None] Flow 'volume_create_manager' (039da7ae-7f91-4cef-a864-3bc066f405a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:55:16 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-d76bbde8-1ca2-4b9f-831c-86a0a38ad565 tempest-VolumesGetTest-698723269 None] Created volume successfully. Jun 17 05:55:17 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:55:17 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] Flow 'volume_create_manager' (e43437e6-8dba-4994-8045-fa040a544b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:55:17 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfb24bd9-1ee9-4a7a-ab4d-8901d82a2dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:55:17 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfb24bd9-1ee9-4a7a-ab4d-8901d82a2dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:55:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1587704964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b235186-0b99-48f9-a006-b03ebb891935,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c8eb62f49ff94572852bf85c00fa935b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:55:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=00d48db5-5aad-4371-a3ab-54dcc631c348,status='creating',terminated_at=None,updated_at=2026-06-17T03:55:18Z,use_quota=True,user_id='e5372bb75933457aab3cfe0d72de0494',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:55:17 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afc81129-503e-4969-bdf6-4bf9f9d77b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:55:17 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afc81129-503e-4969-bdf6-4bf9f9d77b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:55:17 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba417aac-3556-47f1-a587-40ad8f99011b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:55:17 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba417aac-3556-47f1-a587-40ad8f99011b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '2b235186-0b99-48f9-a006-b03ebb891935', 'volume_name': 'volume-2b235186-0b99-48f9-a006-b03ebb891935', 'volume_size': 1, 'source_volid': '00d48db5-5aad-4371-a3ab-54dcc631c348', 'source_volstatus': 'available'}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:55:17 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ae3e444-ccce-4e96-832a-614c949f82ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:55:17 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ae3e444-ccce-4e96-832a-614c949f82ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:55:17 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65aae47a-d23a-41b2-962d-3a9cc7a9dedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:55:17 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] Volume 2b235186-0b99-48f9-a006-b03ebb891935: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-2b235186-0b99-48f9-a006-b03ebb891935', 'volume_size': 1, 'source_volid': '00d48db5-5aad-4371-a3ab-54dcc631c348', 'source_volstatus': 'available'} Jun 17 05:55:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:55:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:55:17 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] Cloning volume 00d48db5-5aad-4371-a3ab-54dcc631c348 to volume 2b235186-0b99-48f9-a006-b03ebb891935 Jun 17 05:55:17 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] Creating offline snapshot fe0ca408-36c6-4d38-a3c5-b7e6456fa19b of volume 00d48db5-5aad-4371-a3ab-54dcc631c348 {{(pid=92083) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 17 05:55:17 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[a794daad-5f6b-44aa-8b6a-4c2b754efee8]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:55:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00d48db5-5aad-4371-a3ab-54dcc631c348 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:55:17 devstack sudo[107162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00d48db5-5aad-4371-a3ab-54dcc631c348 Jun 17 05:55:17 devstack sudo[107162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:55:18 devstack sudo[107162]: pam_unix(sudo:session): session closed for user root Jun 17 05:55:18 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00d48db5-5aad-4371-a3ab-54dcc631c348" returned: 0 in 0.678s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:55:18 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00d48db5-5aad-4371-a3ab-54dcc631c348,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00d48db5-5aad-4371-a3ab-54dcc631c348.fe0ca408-36c6-4d38-a3c5-b7e6456fa19b 1G {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:55:18 devstack sudo[107167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00d48db5-5aad-4371-a3ab-54dcc631c348,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00d48db5-5aad-4371-a3ab-54dcc631c348.fe0ca408-36c6-4d38-a3c5-b7e6456fa19b 1G Jun 17 05:55:18 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:55:19 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root Jun 17 05:55:19 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00d48db5-5aad-4371-a3ab-54dcc631c348,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00d48db5-5aad-4371-a3ab-54dcc631c348.fe0ca408-36c6-4d38-a3c5-b7e6456fa19b 1G" returned: 0 in 0.732s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:55:19 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00d48db5-5aad-4371-a3ab-54dcc631c348 -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00d48db5-5aad-4371-a3ab-54dcc631c348.fe0ca408-36c6-4d38-a3c5-b7e6456fa19b {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:55:19 devstack sudo[107173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00d48db5-5aad-4371-a3ab-54dcc631c348 -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00d48db5-5aad-4371-a3ab-54dcc631c348.fe0ca408-36c6-4d38-a3c5-b7e6456fa19b Jun 17 05:55:19 devstack sudo[107173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:55:19 devstack sudo[107173]: pam_unix(sudo:session): session closed for user root Jun 17 05:55:19 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00d48db5-5aad-4371-a3ab-54dcc631c348 -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00d48db5-5aad-4371-a3ab-54dcc631c348.fe0ca408-36c6-4d38-a3c5-b7e6456fa19b" returned: 0 in 0.612s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:55:19 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00d48db5-5aad-4371-a3ab-54dcc631c348.fe0ca408-36c6-4d38-a3c5-b7e6456fa19b is being set with open permissions: ugo+rw Jun 17 05:55:19 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00d48db5-5aad-4371-a3ab-54dcc631c348.fe0ca408-36c6-4d38-a3c5-b7e6456fa19b {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:55:19 devstack sudo[107179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00d48db5-5aad-4371-a3ab-54dcc631c348.fe0ca408-36c6-4d38-a3c5-b7e6456fa19b Jun 17 05:55:19 devstack sudo[107179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:55:20 devstack sudo[107179]: pam_unix(sudo:session): session closed for user root Jun 17 05:55:20 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00d48db5-5aad-4371-a3ab-54dcc631c348.fe0ca408-36c6-4d38-a3c5-b7e6456fa19b" returned: 0 in 0.562s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:55:20 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00d48db5-5aad-4371-a3ab-54dcc631c348.info {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:55:20 devstack sudo[107182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00d48db5-5aad-4371-a3ab-54dcc631c348.info Jun 17 05:55:20 devstack sudo[107182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:55:20 devstack sudo[107182]: pam_unix(sudo:session): session closed for user root Jun 17 05:55:20 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00d48db5-5aad-4371-a3ab-54dcc631c348.info" returned: 0 in 0.579s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:55:20 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00d48db5-5aad-4371-a3ab-54dcc631c348.info is being set with open permissions: ugo+rw Jun 17 05:55:20 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00d48db5-5aad-4371-a3ab-54dcc631c348.info {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:55:20 devstack sudo[107185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00d48db5-5aad-4371-a3ab-54dcc631c348.info Jun 17 05:55:20 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:55:21 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root Jun 17 05:55:21 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00d48db5-5aad-4371-a3ab-54dcc631c348.info" returned: 0 in 0.565s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:55:21 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] Acquiring lock "cinder-quobyte-2b235186-0b99-48f9-a006-b03ebb891935" by "_copy_volume_from_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:55:21 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] Lock "cinder-quobyte-2b235186-0b99-48f9-a006-b03ebb891935" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:55:21 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] snapshot: fe0ca408-36c6-4d38-a3c5-b7e6456fa19b, volume: 2b235186-0b99-48f9-a006-b03ebb891935, {{(pid=92083) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 17 05:55:21 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:55:21 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:55:21 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:55:21 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:55:21 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:55:21 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6b5469-054f-4616-9ca6-04fa4a8d6912]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:55:21 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00d48db5-5aad-4371-a3ab-54dcc631c348.fe0ca408-36c6-4d38-a3c5-b7e6456fa19b {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:55:21 devstack sudo[107188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00d48db5-5aad-4371-a3ab-54dcc631c348.fe0ca408-36c6-4d38-a3c5-b7e6456fa19b Jun 17 05:55:21 devstack sudo[107188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:55:22 devstack sudo[107188]: pam_unix(sudo:session): session closed for user root Jun 17 05:55:22 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00d48db5-5aad-4371-a3ab-54dcc631c348.fe0ca408-36c6-4d38-a3c5-b7e6456fa19b" returned: 0 in 0.685s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:55:22 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00d48db5-5aad-4371-a3ab-54dcc631c348(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92083) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 05:55:22 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] will copy from snapshot at /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00d48db5-5aad-4371-a3ab-54dcc631c348 {{(pid=92083) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 17 05:55:22 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] Creating direct copy from snapshot {{(pid=92083) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 17 05:55:22 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[2408afa6-4c35-44b7-b2b9-704b7861880d]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:55:22 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00d48db5-5aad-4371-a3ab-54dcc631c348 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:55:22 devstack sudo[107193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00d48db5-5aad-4371-a3ab-54dcc631c348 Jun 17 05:55:22 devstack sudo[107193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:55:22 devstack sudo[107193]: pam_unix(sudo:session): session closed for user root Jun 17 05:55:22 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00d48db5-5aad-4371-a3ab-54dcc631c348" returned: 0 in 0.678s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:55:22 devstack cinder-volume[92083]: DEBUG cinder.utils [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] Path /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2b235186-0b99-48f9-a006-b03ebb891935 not found in is_blk_device check {{(pid=92083) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 17 05:55:22 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00d48db5-5aad-4371-a3ab-54dcc631c348 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2b235186-0b99-48f9-a006-b03ebb891935 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:55:22 devstack sudo[107198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00d48db5-5aad-4371-a3ab-54dcc631c348 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2b235186-0b99-48f9-a006-b03ebb891935 Jun 17 05:55:22 devstack sudo[107198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:55:27 devstack sudo[107198]: pam_unix(sudo:session): session closed for user root Jun 17 05:55:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00d48db5-5aad-4371-a3ab-54dcc631c348 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2b235186-0b99-48f9-a006-b03ebb891935" returned: 0 in 4.449s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:55:27 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[75108456-b009-461c-9f0a-6bcc6c9e03a0]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:55:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00d48db5-5aad-4371-a3ab-54dcc631c348 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:55:27 devstack sudo[107210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00d48db5-5aad-4371-a3ab-54dcc631c348 Jun 17 05:55:27 devstack sudo[107210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:55:27 devstack cinder-volume[92083]: DEBUG oslo_service.periodic_task [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92083) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 05:55:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:55:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:55:27 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:55:27 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:55:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:55:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:55:27 devstack sudo[107212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:55:27 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:55:28 devstack sudo[107210]: pam_unix(sudo:session): session closed for user root Jun 17 05:55:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00d48db5-5aad-4371-a3ab-54dcc631c348" returned: 0 in 0.864s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:55:28 devstack cinder-volume[92083]: DEBUG cinder.image.image_utils [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] Image conversion details: src /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00d48db5-5aad-4371-a3ab-54dcc631c348, size 1024.00 MB, duration 4.45 sec, destination /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2b235186-0b99-48f9-a006-b03ebb891935 {{(pid=92083) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 17 05:55:28 devstack cinder-volume[92083]: INFO cinder.image.image_utils [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] Converted 1024.00 MB image at 230.11 MB/s Jun 17 05:55:28 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2b235186-0b99-48f9-a006-b03ebb891935 is being set with open permissions: ugo+rw Jun 17 05:55:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2b235186-0b99-48f9-a006-b03ebb891935 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:55:28 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root Jun 17 05:55:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.597s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:55:28 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:55:28 devstack cinder-volume[92083]: DEBUG oslo_service.periodic_task [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running periodic task VolumeManager._thread_info {{(pid=92083) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 05:55:28 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] thread count: 28 {{(pid=92083) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 17 05:55:28 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] thread info: [<_MainThread(MainThread, started 133483869905024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92083) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 17 05:55:28 devstack sudo[107219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2b235186-0b99-48f9-a006-b03ebb891935 Jun 17 05:55:28 devstack sudo[107219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:55:28 devstack sudo[107219]: pam_unix(sudo:session): session closed for user root Jun 17 05:55:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2b235186-0b99-48f9-a006-b03ebb891935" returned: 0 in 0.572s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:55:28 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] Lock "cinder-quobyte-2b235186-0b99-48f9-a006-b03ebb891935" released by "_copy_volume_from_snapshot" :: held 7.320s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:55:28 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] Acquiring lock "cinder-quobyte-fe0ca408-36c6-4d38-a3c5-b7e6456fa19b" by "_delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:55:28 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] Lock "cinder-quobyte-fe0ca408-36c6-4d38-a3c5-b7e6456fa19b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:55:28 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] Deleting offline snapshot fe0ca408-36c6-4d38-a3c5-b7e6456fa19b of volume 00d48db5-5aad-4371-a3ab-54dcc631c348 {{(pid=92083) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 17 05:55:28 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] snapshot_file for this snap is: volume-00d48db5-5aad-4371-a3ab-54dcc631c348.fe0ca408-36c6-4d38-a3c5-b7e6456fa19b {{(pid=92083) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 17 05:55:28 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[556b1cfa-9810-484f-855d-9596d26faccc]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:55:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00d48db5-5aad-4371-a3ab-54dcc631c348.fe0ca408-36c6-4d38-a3c5-b7e6456fa19b {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:55:28 devstack sudo[107222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00d48db5-5aad-4371-a3ab-54dcc631c348.fe0ca408-36c6-4d38-a3c5-b7e6456fa19b Jun 17 05:55:28 devstack sudo[107222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:55:29 devstack sudo[107222]: pam_unix(sudo:session): session closed for user root Jun 17 05:55:29 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00d48db5-5aad-4371-a3ab-54dcc631c348.fe0ca408-36c6-4d38-a3c5-b7e6456fa19b" returned: 0 in 0.687s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:55:29 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00d48db5-5aad-4371-a3ab-54dcc631c348(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92083) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 05:55:29 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd878d14-68d1-406f-87d2-047bff19a991]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:55:29 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00d48db5-5aad-4371-a3ab-54dcc631c348 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:55:29 devstack sudo[107228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00d48db5-5aad-4371-a3ab-54dcc631c348 Jun 17 05:55:29 devstack sudo[107228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:55:30 devstack sudo[107228]: pam_unix(sudo:session): session closed for user root Jun 17 05:55:30 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00d48db5-5aad-4371-a3ab-54dcc631c348" returned: 0 in 0.678s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:55:30 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00d48db5-5aad-4371-a3ab-54dcc631c348.fe0ca408-36c6-4d38-a3c5-b7e6456fa19b {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:55:30 devstack sudo[107233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00d48db5-5aad-4371-a3ab-54dcc631c348.fe0ca408-36c6-4d38-a3c5-b7e6456fa19b Jun 17 05:55:30 devstack sudo[107233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:55:30 devstack cinder-volume[92083]: DEBUG dbcounter [-] [92083] Writing DB stats cinder:UPDATE=32,cinder:SELECT=21,cinder:DELETE=4,cinder:INSERT=6 {{(pid=92083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:55:30 devstack sudo[107233]: pam_unix(sudo:session): session closed for user root Jun 17 05:55:30 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00d48db5-5aad-4371-a3ab-54dcc631c348.fe0ca408-36c6-4d38-a3c5-b7e6456fa19b" returned: 0 in 0.654s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:55:30 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00d48db5-5aad-4371-a3ab-54dcc631c348.fe0ca408-36c6-4d38-a3c5-b7e6456fa19b {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:55:30 devstack sudo[107238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00d48db5-5aad-4371-a3ab-54dcc631c348.fe0ca408-36c6-4d38-a3c5-b7e6456fa19b Jun 17 05:55:30 devstack sudo[107238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:55:31 devstack sudo[107238]: pam_unix(sudo:session): session closed for user root Jun 17 05:55:31 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00d48db5-5aad-4371-a3ab-54dcc631c348.fe0ca408-36c6-4d38-a3c5-b7e6456fa19b" returned: 0 in 0.573s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:55:31 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] Lock "cinder-quobyte-fe0ca408-36c6-4d38-a3c5-b7e6456fa19b" released by "_delete_snapshot" :: held 2.673s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:55:31 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.887s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:55:31 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65aae47a-d23a-41b2-962d-3a9cc7a9dedc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b235186-0b99-48f9-a006-b03ebb891935', 'volume_size': 1, 'source_volid': '00d48db5-5aad-4371-a3ab-54dcc631c348', 'source_volstatus': 'available'}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:55:31 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc588ff7-0063-4aea-ba34-02d9502055bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:55:31 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] Volume volume-2b235186-0b99-48f9-a006-b03ebb891935 (2b235186-0b99-48f9-a006-b03ebb891935): created successfully Jun 17 05:55:31 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc588ff7-0063-4aea-ba34-02d9502055bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:55:31 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] Flow 'volume_create_manager' (e43437e6-8dba-4994-8045-fa040a544b6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:55:31 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-6c2e24ea-cc9c-49e7-a97a-ee1739e0bd98 tempest-VolumesGetTest-698723269 None] Created volume successfully. Jun 17 05:55:33 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a173ec9-88b9-410a-8101-4cfeeb506fc9 tempest-VolumesGetTest-698723269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:55:33 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0a173ec9-88b9-410a-8101-4cfeeb506fc9 tempest-VolumesGetTest-698723269 None] Flow 'volume_create_manager' (5345ea2e-e567-410e-9bc6-f9ae14faf761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:55:33 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0a173ec9-88b9-410a-8101-4cfeeb506fc9 tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28396942-fb59-456a-a83d-c4e7a93acacf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:55:33 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0a173ec9-88b9-410a-8101-4cfeeb506fc9 tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28396942-fb59-456a-a83d-c4e7a93acacf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:55:33Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1737068116',display_name='tempest-VolumesGetTest-Volume-1686451305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=218b2b39-4fe5-4d77-ad4b-20b3203e6c1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8eb62f49ff94572852bf85c00fa935b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:55:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:55:33Z,use_quota=True,user_id='e5372bb75933457aab3cfe0d72de0494',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:55:33 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0a173ec9-88b9-410a-8101-4cfeeb506fc9 tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05659b96-5910-4906-8098-e63ac4362606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:55:33 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0a173ec9-88b9-410a-8101-4cfeeb506fc9 tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05659b96-5910-4906-8098-e63ac4362606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:55:33 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0a173ec9-88b9-410a-8101-4cfeeb506fc9 tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e031de2a-3bd6-4238-88f6-07ec5e11176b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:55:33 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0a173ec9-88b9-410a-8101-4cfeeb506fc9 tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e031de2a-3bd6-4238-88f6-07ec5e11176b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '218b2b39-4fe5-4d77-ad4b-20b3203e6c1d', 'volume_name': 'volume-218b2b39-4fe5-4d77-ad4b-20b3203e6c1d', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:55:33 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0a173ec9-88b9-410a-8101-4cfeeb506fc9 tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e0c8ab6-1a10-4123-849a-d20649debdf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:55:33 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0a173ec9-88b9-410a-8101-4cfeeb506fc9 tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e0c8ab6-1a10-4123-849a-d20649debdf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:55:33 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0a173ec9-88b9-410a-8101-4cfeeb506fc9 tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39e3c8fe-1248-4614-8510-5348c0269890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:55:33 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-0a173ec9-88b9-410a-8101-4cfeeb506fc9 tempest-VolumesGetTest-698723269 None] Volume 218b2b39-4fe5-4d77-ad4b-20b3203e6c1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-218b2b39-4fe5-4d77-ad4b-20b3203e6c1d', 'volume_size': 1} Jun 17 05:55:33 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-0a173ec9-88b9-410a-8101-4cfeeb506fc9 tempest-VolumesGetTest-698723269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:55:33 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-0a173ec9-88b9-410a-8101-4cfeeb506fc9 tempest-VolumesGetTest-698723269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:55:33 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-0a173ec9-88b9-410a-8101-4cfeeb506fc9 tempest-VolumesGetTest-698723269 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:55:33Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1737068116',display_name='tempest-VolumesGetTest-Volume-1686451305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=218b2b39-4fe5-4d77-ad4b-20b3203e6c1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8eb62f49ff94572852bf85c00fa935b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:55:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:55:33Z,use_quota=True,user_id='e5372bb75933457aab3cfe0d72de0494',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:55:33 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-0a173ec9-88b9-410a-8101-4cfeeb506fc9 tempest-VolumesGetTest-698723269 None] Creating volume 218b2b39-4fe5-4d77-ad4b-20b3203e6c1d {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:55:33 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-0a173ec9-88b9-410a-8101-4cfeeb506fc9 tempest-VolumesGetTest-698723269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:55:33 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-0a173ec9-88b9-410a-8101-4cfeeb506fc9 tempest-VolumesGetTest-698723269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:55:33 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-0a173ec9-88b9-410a-8101-4cfeeb506fc9 tempest-VolumesGetTest-698723269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:55:33 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-0a173ec9-88b9-410a-8101-4cfeeb506fc9 tempest-VolumesGetTest-698723269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:55:33 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-0a173ec9-88b9-410a-8101-4cfeeb506fc9 tempest-VolumesGetTest-698723269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:55:33 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-0a173ec9-88b9-410a-8101-4cfeeb506fc9 tempest-VolumesGetTest-698723269 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:55:33 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-0a173ec9-88b9-410a-8101-4cfeeb506fc9 tempest-VolumesGetTest-698723269 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:55:33 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0a173ec9-88b9-410a-8101-4cfeeb506fc9 tempest-VolumesGetTest-698723269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-218b2b39-4fe5-4d77-ad4b-20b3203e6c1d 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:55:33 devstack sudo[107279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-218b2b39-4fe5-4d77-ad4b-20b3203e6c1d 1073741824 Jun 17 05:55:33 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:55:33 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root Jun 17 05:55:33 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0a173ec9-88b9-410a-8101-4cfeeb506fc9 tempest-VolumesGetTest-698723269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-218b2b39-4fe5-4d77-ad4b-20b3203e6c1d 1073741824" returned: 0 in 0.757s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:55:34 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0a173ec9-88b9-410a-8101-4cfeeb506fc9 tempest-VolumesGetTest-698723269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-218b2b39-4fe5-4d77-ad4b-20b3203e6c1d {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:55:34 devstack sudo[107284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-218b2b39-4fe5-4d77-ad4b-20b3203e6c1d Jun 17 05:55:34 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:55:34 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root Jun 17 05:55:34 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0a173ec9-88b9-410a-8101-4cfeeb506fc9 tempest-VolumesGetTest-698723269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-218b2b39-4fe5-4d77-ad4b-20b3203e6c1d" returned: 0 in 0.574s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:55:34 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-0a173ec9-88b9-410a-8101-4cfeeb506fc9 tempest-VolumesGetTest-698723269 None] <== create_volume: return (1395ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:55:34 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-0a173ec9-88b9-410a-8101-4cfeeb506fc9 tempest-VolumesGetTest-698723269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.397s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:55:34 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0a173ec9-88b9-410a-8101-4cfeeb506fc9 tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39e3c8fe-1248-4614-8510-5348c0269890) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-218b2b39-4fe5-4d77-ad4b-20b3203e6c1d', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:55:34 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0a173ec9-88b9-410a-8101-4cfeeb506fc9 tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4704614c-18d1-4c93-994f-d08786bed066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:55:34 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-0a173ec9-88b9-410a-8101-4cfeeb506fc9 tempest-VolumesGetTest-698723269 None] Volume volume-218b2b39-4fe5-4d77-ad4b-20b3203e6c1d (218b2b39-4fe5-4d77-ad4b-20b3203e6c1d): created successfully Jun 17 05:55:34 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0a173ec9-88b9-410a-8101-4cfeeb506fc9 tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4704614c-18d1-4c93-994f-d08786bed066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:55:34 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0a173ec9-88b9-410a-8101-4cfeeb506fc9 tempest-VolumesGetTest-698723269 None] Flow 'volume_create_manager' (5345ea2e-e567-410e-9bc6-f9ae14faf761) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:55:34 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-0a173ec9-88b9-410a-8101-4cfeeb506fc9 tempest-VolumesGetTest-698723269 None] Created volume successfully. Jun 17 05:55:35 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-0c43dae1-90dd-45d8-be8b-4d970eefd945 tempest-VolumesGetTest-698723269 None] Acquiring lock "cinder-218b2b39-4fe5-4d77-ad4b-20b3203e6c1d-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:55:35 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-0c43dae1-90dd-45d8-be8b-4d970eefd945 tempest-VolumesGetTest-698723269 None] Lock "cinder-218b2b39-4fe5-4d77-ad4b-20b3203e6c1d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:55:35 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-0c43dae1-90dd-45d8-be8b-4d970eefd945 tempest-VolumesGetTest-698723269 None] Acquiring lock "cinder-quobyte-218b2b39-4fe5-4d77-ad4b-20b3203e6c1d" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:55:35 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-0c43dae1-90dd-45d8-be8b-4d970eefd945 tempest-VolumesGetTest-698723269 None] Lock "cinder-quobyte-218b2b39-4fe5-4d77-ad4b-20b3203e6c1d" acquired by "delete_volume" :: waited 0.019s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:55:35 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bcbaebb-409f-448f-9043-24f2836de88d]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:55:35 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0c43dae1-90dd-45d8-be8b-4d970eefd945 tempest-VolumesGetTest-698723269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-218b2b39-4fe5-4d77-ad4b-20b3203e6c1d {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:55:35 devstack sudo[107287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-218b2b39-4fe5-4d77-ad4b-20b3203e6c1d Jun 17 05:55:35 devstack sudo[107287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:55:36 devstack sudo[107287]: pam_unix(sudo:session): session closed for user root Jun 17 05:55:36 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0c43dae1-90dd-45d8-be8b-4d970eefd945 tempest-VolumesGetTest-698723269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-218b2b39-4fe5-4d77-ad4b-20b3203e6c1d" returned: 0 in 0.684s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:55:36 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0c43dae1-90dd-45d8-be8b-4d970eefd945 tempest-VolumesGetTest-698723269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-218b2b39-4fe5-4d77-ad4b-20b3203e6c1d {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:55:36 devstack sudo[107292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-218b2b39-4fe5-4d77-ad4b-20b3203e6c1d Jun 17 05:55:36 devstack sudo[107292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:55:36 devstack sudo[107292]: pam_unix(sudo:session): session closed for user root Jun 17 05:55:36 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0c43dae1-90dd-45d8-be8b-4d970eefd945 tempest-VolumesGetTest-698723269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-218b2b39-4fe5-4d77-ad4b-20b3203e6c1d" returned: 0 in 0.577s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:55:36 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-0c43dae1-90dd-45d8-be8b-4d970eefd945 tempest-VolumesGetTest-698723269 None] Lock "cinder-quobyte-218b2b39-4fe5-4d77-ad4b-20b3203e6c1d" released by "delete_volume" :: held 1.303s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:55:36 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-0c43dae1-90dd-45d8-be8b-4d970eefd945 tempest-VolumesGetTest-698723269 None] Created reservations ['a2c5f23e-697a-4a44-b76c-26d343a321f6', 'ee95de12-c83c-44f5-ac49-99ef01d2ba48', 'd576dcc0-4172-4497-baeb-da132df322a3', '167aef4a-569c-4e97-843c-adb6e974adb1'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:55:36 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-0c43dae1-90dd-45d8-be8b-4d970eefd945 tempest-VolumesGetTest-698723269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:55:36 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-0c43dae1-90dd-45d8-be8b-4d970eefd945 tempest-VolumesGetTest-698723269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:55:36 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-0c43dae1-90dd-45d8-be8b-4d970eefd945 tempest-VolumesGetTest-698723269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:55:36 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-0c43dae1-90dd-45d8-be8b-4d970eefd945 tempest-VolumesGetTest-698723269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:55:36 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-0c43dae1-90dd-45d8-be8b-4d970eefd945 tempest-VolumesGetTest-698723269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:55:36 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0c43dae1-90dd-45d8-be8b-4d970eefd945 tempest-VolumesGetTest-698723269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:55:36 devstack sudo[107295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:55:36 devstack sudo[107295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:55:37 devstack sudo[107295]: pam_unix(sudo:session): session closed for user root Jun 17 05:55:37 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0c43dae1-90dd-45d8-be8b-4d970eefd945 tempest-VolumesGetTest-698723269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.573s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:55:37 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-0c43dae1-90dd-45d8-be8b-4d970eefd945 tempest-VolumesGetTest-698723269 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:55:37 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-0c43dae1-90dd-45d8-be8b-4d970eefd945 tempest-VolumesGetTest-698723269 None] Deleted volume successfully. Jun 17 05:55:37 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-0c43dae1-90dd-45d8-be8b-4d970eefd945 tempest-VolumesGetTest-698723269 None] Lock "cinder-218b2b39-4fe5-4d77-ad4b-20b3203e6c1d-delete_volume" released by "delete_volume" :: held 2.064s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:55:37 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-eca5eee4-9df9-46c7-a208-f048eca8d383 tempest-VolumesGetTest-698723269 None] Acquiring lock "cinder-2b235186-0b99-48f9-a006-b03ebb891935-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:55:37 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-eca5eee4-9df9-46c7-a208-f048eca8d383 tempest-VolumesGetTest-698723269 None] Lock "cinder-2b235186-0b99-48f9-a006-b03ebb891935-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:55:37 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-eca5eee4-9df9-46c7-a208-f048eca8d383 tempest-VolumesGetTest-698723269 None] Acquiring lock "cinder-quobyte-2b235186-0b99-48f9-a006-b03ebb891935" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:55:37 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-eca5eee4-9df9-46c7-a208-f048eca8d383 tempest-VolumesGetTest-698723269 None] Lock "cinder-quobyte-2b235186-0b99-48f9-a006-b03ebb891935" acquired by "delete_volume" :: waited 0.014s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:55:37 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0e203e-7afc-423b-8a02-6835173b9719]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:55:37 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-eca5eee4-9df9-46c7-a208-f048eca8d383 tempest-VolumesGetTest-698723269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2b235186-0b99-48f9-a006-b03ebb891935 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:55:37 devstack sudo[107298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2b235186-0b99-48f9-a006-b03ebb891935 Jun 17 05:55:37 devstack sudo[107298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:55:38 devstack sudo[107298]: pam_unix(sudo:session): session closed for user root Jun 17 05:55:38 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-eca5eee4-9df9-46c7-a208-f048eca8d383 tempest-VolumesGetTest-698723269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2b235186-0b99-48f9-a006-b03ebb891935" returned: 0 in 0.710s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:55:38 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-eca5eee4-9df9-46c7-a208-f048eca8d383 tempest-VolumesGetTest-698723269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2b235186-0b99-48f9-a006-b03ebb891935 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:55:38 devstack sudo[107303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2b235186-0b99-48f9-a006-b03ebb891935 Jun 17 05:55:38 devstack sudo[107303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:55:39 devstack sudo[107303]: pam_unix(sudo:session): session closed for user root Jun 17 05:55:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-eca5eee4-9df9-46c7-a208-f048eca8d383 tempest-VolumesGetTest-698723269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2b235186-0b99-48f9-a006-b03ebb891935" returned: 0 in 0.593s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:55:39 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-eca5eee4-9df9-46c7-a208-f048eca8d383 tempest-VolumesGetTest-698723269 None] Lock "cinder-quobyte-2b235186-0b99-48f9-a006-b03ebb891935" released by "delete_volume" :: held 1.340s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:55:39 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-eca5eee4-9df9-46c7-a208-f048eca8d383 tempest-VolumesGetTest-698723269 None] Created reservations ['e8f79abe-a8a6-4221-a4d1-a009c40c1660', '069713d5-4e14-4b09-ab10-999310044b48', '6a5ce53c-2acc-4b65-a50e-c404e14f2d81', '8c291345-e946-4a7c-b045-bd1d0e66915b'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:55:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-eca5eee4-9df9-46c7-a208-f048eca8d383 tempest-VolumesGetTest-698723269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:55:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-eca5eee4-9df9-46c7-a208-f048eca8d383 tempest-VolumesGetTest-698723269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:55:39 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-eca5eee4-9df9-46c7-a208-f048eca8d383 tempest-VolumesGetTest-698723269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:55:39 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-eca5eee4-9df9-46c7-a208-f048eca8d383 tempest-VolumesGetTest-698723269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:55:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-eca5eee4-9df9-46c7-a208-f048eca8d383 tempest-VolumesGetTest-698723269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:55:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-eca5eee4-9df9-46c7-a208-f048eca8d383 tempest-VolumesGetTest-698723269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:55:39 devstack sudo[107306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:55:39 devstack sudo[107306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:55:39 devstack sudo[107306]: pam_unix(sudo:session): session closed for user root Jun 17 05:55:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-eca5eee4-9df9-46c7-a208-f048eca8d383 tempest-VolumesGetTest-698723269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.575s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:55:39 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-eca5eee4-9df9-46c7-a208-f048eca8d383 tempest-VolumesGetTest-698723269 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:55:39 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-eca5eee4-9df9-46c7-a208-f048eca8d383 tempest-VolumesGetTest-698723269 None] Deleted volume successfully. Jun 17 05:55:39 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-eca5eee4-9df9-46c7-a208-f048eca8d383 tempest-VolumesGetTest-698723269 None] Lock "cinder-2b235186-0b99-48f9-a006-b03ebb891935-delete_volume" released by "delete_volume" :: held 2.116s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:55:39 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-e4c68f3c-a9d2-4c7a-ba7e-770eccb20a30 tempest-VolumesGetTest-698723269 None] Acquiring lock "cinder-00d48db5-5aad-4371-a3ab-54dcc631c348-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:55:39 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-e4c68f3c-a9d2-4c7a-ba7e-770eccb20a30 tempest-VolumesGetTest-698723269 None] Lock "cinder-00d48db5-5aad-4371-a3ab-54dcc631c348-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:55:39 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-e4c68f3c-a9d2-4c7a-ba7e-770eccb20a30 tempest-VolumesGetTest-698723269 None] Acquiring lock "cinder-quobyte-00d48db5-5aad-4371-a3ab-54dcc631c348" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:55:39 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-e4c68f3c-a9d2-4c7a-ba7e-770eccb20a30 tempest-VolumesGetTest-698723269 None] Lock "cinder-quobyte-00d48db5-5aad-4371-a3ab-54dcc631c348" acquired by "delete_volume" :: waited 0.016s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:55:40 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[b80d7dda-4b89-4261-8b6f-a3f182ce5396]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:55:40 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e4c68f3c-a9d2-4c7a-ba7e-770eccb20a30 tempest-VolumesGetTest-698723269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00d48db5-5aad-4371-a3ab-54dcc631c348 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:55:40 devstack sudo[107310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00d48db5-5aad-4371-a3ab-54dcc631c348 Jun 17 05:55:40 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:55:40 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root Jun 17 05:55:40 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e4c68f3c-a9d2-4c7a-ba7e-770eccb20a30 tempest-VolumesGetTest-698723269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00d48db5-5aad-4371-a3ab-54dcc631c348" returned: 0 in 0.698s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:55:40 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e4c68f3c-a9d2-4c7a-ba7e-770eccb20a30 tempest-VolumesGetTest-698723269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00d48db5-5aad-4371-a3ab-54dcc631c348 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:55:40 devstack sudo[107315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00d48db5-5aad-4371-a3ab-54dcc631c348 Jun 17 05:55:40 devstack sudo[107315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:55:41 devstack sudo[107315]: pam_unix(sudo:session): session closed for user root Jun 17 05:55:41 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e4c68f3c-a9d2-4c7a-ba7e-770eccb20a30 tempest-VolumesGetTest-698723269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-00d48db5-5aad-4371-a3ab-54dcc631c348" returned: 0 in 0.590s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:55:41 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-e4c68f3c-a9d2-4c7a-ba7e-770eccb20a30 tempest-VolumesGetTest-698723269 None] Lock "cinder-quobyte-00d48db5-5aad-4371-a3ab-54dcc631c348" released by "delete_volume" :: held 1.343s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:55:41 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-e4c68f3c-a9d2-4c7a-ba7e-770eccb20a30 tempest-VolumesGetTest-698723269 None] Created reservations ['768ca3a3-ee51-4bef-bedd-f43c2ab56781', '2d15f442-9e5f-473a-9f63-04dd590a6e89', '4ae2475c-f143-4259-b8c5-56bd9ed68955', '90500059-0ace-4c79-8b79-9f47ac419a39'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:55:41 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e4c68f3c-a9d2-4c7a-ba7e-770eccb20a30 tempest-VolumesGetTest-698723269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:55:41 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e4c68f3c-a9d2-4c7a-ba7e-770eccb20a30 tempest-VolumesGetTest-698723269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:55:41 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-e4c68f3c-a9d2-4c7a-ba7e-770eccb20a30 tempest-VolumesGetTest-698723269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:55:41 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-e4c68f3c-a9d2-4c7a-ba7e-770eccb20a30 tempest-VolumesGetTest-698723269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:55:41 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e4c68f3c-a9d2-4c7a-ba7e-770eccb20a30 tempest-VolumesGetTest-698723269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:55:41 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e4c68f3c-a9d2-4c7a-ba7e-770eccb20a30 tempest-VolumesGetTest-698723269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:55:41 devstack sudo[107318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:55:41 devstack sudo[107318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:55:41 devstack sudo[107318]: pam_unix(sudo:session): session closed for user root Jun 17 05:55:41 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e4c68f3c-a9d2-4c7a-ba7e-770eccb20a30 tempest-VolumesGetTest-698723269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.575s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:55:41 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-e4c68f3c-a9d2-4c7a-ba7e-770eccb20a30 tempest-VolumesGetTest-698723269 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:55:41 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-e4c68f3c-a9d2-4c7a-ba7e-770eccb20a30 tempest-VolumesGetTest-698723269 None] Deleted volume successfully. Jun 17 05:55:42 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-e4c68f3c-a9d2-4c7a-ba7e-770eccb20a30 tempest-VolumesGetTest-698723269 None] Lock "cinder-00d48db5-5aad-4371-a3ab-54dcc631c348-delete_volume" released by "delete_volume" :: held 2.095s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:55:42 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5c76ddc-1bd1-40bd-91a5-24740c8a9795 tempest-VolumesGetTest-698723269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:55:42 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e5c76ddc-1bd1-40bd-91a5-24740c8a9795 tempest-VolumesGetTest-698723269 None] Flow 'volume_create_manager' (3c9bc8f7-e5bb-427d-b424-b0d36bdb278e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:55:42 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e5c76ddc-1bd1-40bd-91a5-24740c8a9795 tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92424819-35c8-497a-a0ae-c7c1ae38804f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:55:42 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e5c76ddc-1bd1-40bd-91a5-24740c8a9795 tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92424819-35c8-497a-a0ae-c7c1ae38804f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:55:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-903612102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa552f02-3043-4309-a901-1d69896a385d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c8eb62f49ff94572852bf85c00fa935b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:55:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:55:43Z,use_quota=True,user_id='e5372bb75933457aab3cfe0d72de0494',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:55:42 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e5c76ddc-1bd1-40bd-91a5-24740c8a9795 tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (523e4d14-ea2b-44e5-b5e3-8a32f95e1d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:55:42 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e5c76ddc-1bd1-40bd-91a5-24740c8a9795 tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (523e4d14-ea2b-44e5-b5e3-8a32f95e1d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:55:42 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e5c76ddc-1bd1-40bd-91a5-24740c8a9795 tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03f1f171-1c4c-470f-b1e2-0cb0fe0d5da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:55:42 devstack cinder-volume[92083]: DEBUG cinder.image.glance [None req-e5c76ddc-1bd1-40bd-91a5-24740c8a9795 tempest-VolumesGetTest-698723269 None] Creating Keystone auth plugin from conf {{(pid=92083) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 17 05:55:42 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e5c76ddc-1bd1-40bd-91a5-24740c8a9795 tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03f1f171-1c4c-470f-b1e2-0cb0fe0d5da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fa552f02-3043-4309-a901-1d69896a385d', 'volume_name': 'volume-fa552f02-3043-4309-a901-1d69896a385d', 'volume_size': 1, 'image_id': '3a392502-bf92-4019-8ad1-5b48db42b20f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3a392502-bf92-4019-8ad1-5b48db42b20f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd68ea14f86c14b8aac202e298736b075', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3a392502-bf92-4019-8ad1-5b48db42b20f', 'created_at': datetime.datetime(2026, 6, 17, 3, 31, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 3, 31, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3a392502-bf92-4019-8ad1-5b48db42b20f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:55:42 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e5c76ddc-1bd1-40bd-91a5-24740c8a9795 tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fce60b9-c6a1-417f-ba46-fd4c3116ced6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:55:43 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e5c76ddc-1bd1-40bd-91a5-24740c8a9795 tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fce60b9-c6a1-417f-ba46-fd4c3116ced6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:55:43 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e5c76ddc-1bd1-40bd-91a5-24740c8a9795 tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11fc59d0-cbaa-43ba-a8f7-d60ecc6fd91a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:55:43 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-e5c76ddc-1bd1-40bd-91a5-24740c8a9795 tempest-VolumesGetTest-698723269 None] Volume fa552f02-3043-4309-a901-1d69896a385d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fa552f02-3043-4309-a901-1d69896a385d', 'volume_size': 1, 'image_id': '3a392502-bf92-4019-8ad1-5b48db42b20f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3a392502-bf92-4019-8ad1-5b48db42b20f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd68ea14f86c14b8aac202e298736b075', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3a392502-bf92-4019-8ad1-5b48db42b20f', 'created_at': datetime.datetime(2026, 6, 17, 3, 31, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 3, 31, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3a392502-bf92-4019-8ad1-5b48db42b20f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 17 05:55:43 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5c76ddc-1bd1-40bd-91a5-24740c8a9795 tempest-VolumesGetTest-698723269 None] Trying to clone fa552f02-3043-4309-a901-1d69896a385d from image 3a392502-bf92-4019-8ad1-5b48db42b20f at location (None, [{'url': 'file:///opt/stack/data/glance/images/3a392502-bf92-4019-8ad1-5b48db42b20f', 'metadata': {}}]). {{(pid=92083) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 17 05:55:43 devstack cinder-volume[92083]: DEBUG cinder.image.image_utils [None req-e5c76ddc-1bd1-40bd-91a5-24740c8a9795 tempest-VolumesGetTest-698723269 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3a392502-bf92-4019-8ad1-5b48db42b20f_copbekjadevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=92083) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 17 05:55:43 devstack cinder-volume[92083]: INFO cinder.image.image_utils [None req-e5c76ddc-1bd1-40bd-91a5-24740c8a9795 tempest-VolumesGetTest-698723269 None] Image download 20.69 MB at 20.69 MB/s Jun 17 05:55:43 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b3b4e5-4109-499f-add8-48665b6406b3]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:55:43 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e5c76ddc-1bd1-40bd-91a5-24740c8a9795 tempest-VolumesGetTest-698723269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a392502-bf92-4019-8ad1-5b48db42b20f_copbekjadevstack@QuobyteHD {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:55:43 devstack sudo[107322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a392502-bf92-4019-8ad1-5b48db42b20f_copbekjadevstack@QuobyteHD Jun 17 05:55:43 devstack sudo[107322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:55:44 devstack sudo[107322]: pam_unix(sudo:session): session closed for user root Jun 17 05:55:44 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e5c76ddc-1bd1-40bd-91a5-24740c8a9795 tempest-VolumesGetTest-698723269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a392502-bf92-4019-8ad1-5b48db42b20f_copbekjadevstack@QuobyteHD" returned: 0 in 0.669s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:55:44 devstack cinder-volume[92083]: DEBUG cinder.image.image_utils [None req-e5c76ddc-1bd1-40bd-91a5-24740c8a9795 tempest-VolumesGetTest-698723269 None] Temporary image 3a392502-bf92-4019-8ad1-5b48db42b20f is fetched for user e5372bb75933457aab3cfe0d72de0494. {{(pid=92083) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 17 05:55:44 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1209286-ebba-4643-a830-11ef48886825]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:55:44 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e5c76ddc-1bd1-40bd-91a5-24740c8a9795 tempest-VolumesGetTest-698723269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a392502-bf92-4019-8ad1-5b48db42b20f_copbekjadevstack@QuobyteHD {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:55:44 devstack sudo[107327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a392502-bf92-4019-8ad1-5b48db42b20f_copbekjadevstack@QuobyteHD Jun 17 05:55:44 devstack sudo[107327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:55:44 devstack sudo[107327]: pam_unix(sudo:session): session closed for user root Jun 17 05:55:44 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e5c76ddc-1bd1-40bd-91a5-24740c8a9795 tempest-VolumesGetTest-698723269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a392502-bf92-4019-8ad1-5b48db42b20f_copbekjadevstack@QuobyteHD" returned: 0 in 0.674s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:55:44 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e5c76ddc-1bd1-40bd-91a5-24740c8a9795 tempest-VolumesGetTest-698723269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:55:44 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e5c76ddc-1bd1-40bd-91a5-24740c8a9795 tempest-VolumesGetTest-698723269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:55:44 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-e5c76ddc-1bd1-40bd-91a5-24740c8a9795 tempest-VolumesGetTest-698723269 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:55:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-903612102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa552f02-3043-4309-a901-1d69896a385d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c8eb62f49ff94572852bf85c00fa935b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:55:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:55:43Z,use_quota=True,user_id='e5372bb75933457aab3cfe0d72de0494',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:55:44 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-e5c76ddc-1bd1-40bd-91a5-24740c8a9795 tempest-VolumesGetTest-698723269 None] Creating volume fa552f02-3043-4309-a901-1d69896a385d {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:55:44 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e5c76ddc-1bd1-40bd-91a5-24740c8a9795 tempest-VolumesGetTest-698723269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:55:44 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e5c76ddc-1bd1-40bd-91a5-24740c8a9795 tempest-VolumesGetTest-698723269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:55:44 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-e5c76ddc-1bd1-40bd-91a5-24740c8a9795 tempest-VolumesGetTest-698723269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:55:44 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-e5c76ddc-1bd1-40bd-91a5-24740c8a9795 tempest-VolumesGetTest-698723269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:55:44 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e5c76ddc-1bd1-40bd-91a5-24740c8a9795 tempest-VolumesGetTest-698723269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:55:44 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-e5c76ddc-1bd1-40bd-91a5-24740c8a9795 tempest-VolumesGetTest-698723269 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:55:44 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-e5c76ddc-1bd1-40bd-91a5-24740c8a9795 tempest-VolumesGetTest-698723269 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:55:44 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e5c76ddc-1bd1-40bd-91a5-24740c8a9795 tempest-VolumesGetTest-698723269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-fa552f02-3043-4309-a901-1d69896a385d 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:55:44 devstack sudo[107332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-fa552f02-3043-4309-a901-1d69896a385d 1073741824 Jun 17 05:55:44 devstack sudo[107332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:55:45 devstack sudo[107332]: pam_unix(sudo:session): session closed for user root Jun 17 05:55:45 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e5c76ddc-1bd1-40bd-91a5-24740c8a9795 tempest-VolumesGetTest-698723269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-fa552f02-3043-4309-a901-1d69896a385d 1073741824" returned: 0 in 0.751s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:55:45 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e5c76ddc-1bd1-40bd-91a5-24740c8a9795 tempest-VolumesGetTest-698723269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-fa552f02-3043-4309-a901-1d69896a385d {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:55:45 devstack sudo[107337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-fa552f02-3043-4309-a901-1d69896a385d Jun 17 05:55:45 devstack sudo[107337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:55:46 devstack sudo[107337]: pam_unix(sudo:session): session closed for user root Jun 17 05:55:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e5c76ddc-1bd1-40bd-91a5-24740c8a9795 tempest-VolumesGetTest-698723269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-fa552f02-3043-4309-a901-1d69896a385d" returned: 0 in 0.582s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:55:46 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-e5c76ddc-1bd1-40bd-91a5-24740c8a9795 tempest-VolumesGetTest-698723269 None] <== create_volume: return (1377ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:55:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e5c76ddc-1bd1-40bd-91a5-24740c8a9795 tempest-VolumesGetTest-698723269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.379s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:55:46 devstack cinder-volume[92083]: DEBUG cinder.volume.volume_utils [None req-e5c76ddc-1bd1-40bd-91a5-24740c8a9795 tempest-VolumesGetTest-698723269 None] Attempting download of 3a392502-bf92-4019-8ad1-5b48db42b20f ((None, [{'url': 'file:///opt/stack/data/glance/images/3a392502-bf92-4019-8ad1-5b48db42b20f', 'metadata': {}}])) to volume fa552f02-3043-4309-a901-1d69896a385d. {{(pid=92083) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 17 05:55:46 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba01d80-9f15-4007-939d-e1bf6de36773]: (4, 'raw') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:55:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e5c76ddc-1bd1-40bd-91a5-24740c8a9795 tempest-VolumesGetTest-698723269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3a392502-bf92-4019-8ad1-5b48db42b20f_20fy95et {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:55:46 devstack sudo[107340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3a392502-bf92-4019-8ad1-5b48db42b20f_20fy95et Jun 17 05:55:46 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:55:46 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root Jun 17 05:55:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e5c76ddc-1bd1-40bd-91a5-24740c8a9795 tempest-VolumesGetTest-698723269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3a392502-bf92-4019-8ad1-5b48db42b20f_20fy95et" returned: 0 in 0.664s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:55:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e5c76ddc-1bd1-40bd-91a5-24740c8a9795 tempest-VolumesGetTest-698723269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3a392502-bf92-4019-8ad1-5b48db42b20f_20fy95et {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:55:47 devstack sudo[107344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3a392502-bf92-4019-8ad1-5b48db42b20f_20fy95et Jun 17 05:55:47 devstack sudo[107344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:55:47 devstack sudo[107344]: pam_unix(sudo:session): session closed for user root Jun 17 05:55:47 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e5c76ddc-1bd1-40bd-91a5-24740c8a9795 tempest-VolumesGetTest-698723269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3a392502-bf92-4019-8ad1-5b48db42b20f_20fy95et" returned: 1 in 0.662s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:55:47 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e5c76ddc-1bd1-40bd-91a5-24740c8a9795 tempest-VolumesGetTest-698723269 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3a392502-bf92-4019-8ad1-5b48db42b20f_20fy95et' failed. Not Retrying. {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 05:55:47 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c61b43-ff75-41cf-b304-f379bd4faae9]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:55:47 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e5c76ddc-1bd1-40bd-91a5-24740c8a9795 tempest-VolumesGetTest-698723269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a392502-bf92-4019-8ad1-5b48db42b20f_copbekjadevstack@QuobyteHD {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:55:47 devstack sudo[107348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a392502-bf92-4019-8ad1-5b48db42b20f_copbekjadevstack@QuobyteHD Jun 17 05:55:47 devstack sudo[107348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:55:48 devstack sudo[107348]: pam_unix(sudo:session): session closed for user root Jun 17 05:55:48 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e5c76ddc-1bd1-40bd-91a5-24740c8a9795 tempest-VolumesGetTest-698723269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a392502-bf92-4019-8ad1-5b48db42b20f_copbekjadevstack@QuobyteHD" returned: 0 in 0.668s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:55:48 devstack cinder-volume[92083]: DEBUG cinder.image.image_utils [None req-e5c76ddc-1bd1-40bd-91a5-24740c8a9795 tempest-VolumesGetTest-698723269 None] 3a392502-bf92-4019-8ad1-5b48db42b20f was qcow2, converting to raw {{(pid=92083) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 17 05:55:48 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e5c76ddc-1bd1-40bd-91a5-24740c8a9795 tempest-VolumesGetTest-698723269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3a392502-bf92-4019-8ad1-5b48db42b20f_copbekjadevstack@QuobyteHD /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-fa552f02-3043-4309-a901-1d69896a385d {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:55:48 devstack sudo[107353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3a392502-bf92-4019-8ad1-5b48db42b20f_copbekjadevstack@QuobyteHD /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-fa552f02-3043-4309-a901-1d69896a385d Jun 17 05:55:48 devstack sudo[107353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:55:49 devstack sudo[107353]: pam_unix(sudo:session): session closed for user root Jun 17 05:55:49 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e5c76ddc-1bd1-40bd-91a5-24740c8a9795 tempest-VolumesGetTest-698723269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3a392502-bf92-4019-8ad1-5b48db42b20f_copbekjadevstack@QuobyteHD /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-fa552f02-3043-4309-a901-1d69896a385d" returned: 0 in 1.717s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:55:49 devstack cinder-volume[92083]: DEBUG cinder.image.image_utils [None req-e5c76ddc-1bd1-40bd-91a5-24740c8a9795 tempest-VolumesGetTest-698723269 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3a392502-bf92-4019-8ad1-5b48db42b20f_copbekjadevstack@QuobyteHD, size 112.00 MB, duration 1.72 sec, destination /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-fa552f02-3043-4309-a901-1d69896a385d {{(pid=92083) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 17 05:55:49 devstack cinder-volume[92083]: INFO cinder.image.image_utils [None req-e5c76ddc-1bd1-40bd-91a5-24740c8a9795 tempest-VolumesGetTest-698723269 None] Converted 112.00 MB image at 65.17 MB/s Jun 17 05:55:49 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e5c76ddc-1bd1-40bd-91a5-24740c8a9795 tempest-VolumesGetTest-698723269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-fa552f02-3043-4309-a901-1d69896a385d 1G {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:55:49 devstack sudo[107363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-fa552f02-3043-4309-a901-1d69896a385d 1G Jun 17 05:55:49 devstack sudo[107363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:55:50 devstack sudo[107363]: pam_unix(sudo:session): session closed for user root Jun 17 05:55:50 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e5c76ddc-1bd1-40bd-91a5-24740c8a9795 tempest-VolumesGetTest-698723269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-fa552f02-3043-4309-a901-1d69896a385d 1G" returned: 0 in 0.640s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:55:50 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec08dee-668f-4bea-9a36-ab3c7857878c]: (4, 'raw') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:55:50 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e5c76ddc-1bd1-40bd-91a5-24740c8a9795 tempest-VolumesGetTest-698723269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-fa552f02-3043-4309-a901-1d69896a385d {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:55:50 devstack sudo[107368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-fa552f02-3043-4309-a901-1d69896a385d Jun 17 05:55:50 devstack sudo[107368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:55:51 devstack sudo[107368]: pam_unix(sudo:session): session closed for user root Jun 17 05:55:51 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e5c76ddc-1bd1-40bd-91a5-24740c8a9795 tempest-VolumesGetTest-698723269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-fa552f02-3043-4309-a901-1d69896a385d" returned: 0 in 0.702s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:55:51 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e5c76ddc-1bd1-40bd-91a5-24740c8a9795 tempest-VolumesGetTest-698723269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-fa552f02-3043-4309-a901-1d69896a385d {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:55:51 devstack sudo[107372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-fa552f02-3043-4309-a901-1d69896a385d Jun 17 05:55:51 devstack sudo[107372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:55:52 devstack sudo[107372]: pam_unix(sudo:session): session closed for user root Jun 17 05:55:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e5c76ddc-1bd1-40bd-91a5-24740c8a9795 tempest-VolumesGetTest-698723269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-fa552f02-3043-4309-a901-1d69896a385d" returned: 1 in 0.685s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:55:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e5c76ddc-1bd1-40bd-91a5-24740c8a9795 tempest-VolumesGetTest-698723269 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-fa552f02-3043-4309-a901-1d69896a385d' failed. Not Retrying. {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 05:55:52 devstack cinder-volume[92083]: DEBUG cinder.volume.volume_utils [None req-e5c76ddc-1bd1-40bd-91a5-24740c8a9795 tempest-VolumesGetTest-698723269 None] Downloaded image 3a392502-bf92-4019-8ad1-5b48db42b20f ((None, [{'url': 'file:///opt/stack/data/glance/images/3a392502-bf92-4019-8ad1-5b48db42b20f', 'metadata': {}}])) to volume fa552f02-3043-4309-a901-1d69896a385d successfully. {{(pid=92083) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 17 05:55:52 devstack cinder-volume[92083]: DEBUG cinder.image.image_utils [None req-e5c76ddc-1bd1-40bd-91a5-24740c8a9795 tempest-VolumesGetTest-698723269 None] Temporary image 3a392502-bf92-4019-8ad1-5b48db42b20f for user e5372bb75933457aab3cfe0d72de0494 is deleted. {{(pid=92083) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 17 05:55:52 devstack cinder-volume[92083]: DEBUG cinder.volume.volume_utils [None req-e5c76ddc-1bd1-40bd-91a5-24740c8a9795 tempest-VolumesGetTest-698723269 None] Marking volume fa552f02-3043-4309-a901-1d69896a385d as bootable. {{(pid=92083) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 17 05:55:52 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5c76ddc-1bd1-40bd-91a5-24740c8a9795 tempest-VolumesGetTest-698723269 None] Copying metadata from image 3a392502-bf92-4019-8ad1-5b48db42b20f to fa552f02-3043-4309-a901-1d69896a385d. {{(pid=92083) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 17 05:55:52 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5c76ddc-1bd1-40bd-91a5-24740c8a9795 tempest-VolumesGetTest-698723269 None] Creating volume glance metadata for volume fa552f02-3043-4309-a901-1d69896a385d backed by image 3a392502-bf92-4019-8ad1-5b48db42b20f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3a392502-bf92-4019-8ad1-5b48db42b20f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=92083) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 17 05:55:52 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e5c76ddc-1bd1-40bd-91a5-24740c8a9795 tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11fc59d0-cbaa-43ba-a8f7-d60ecc6fd91a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa552f02-3043-4309-a901-1d69896a385d', 'volume_size': 1, 'image_id': '3a392502-bf92-4019-8ad1-5b48db42b20f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3a392502-bf92-4019-8ad1-5b48db42b20f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd68ea14f86c14b8aac202e298736b075', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3a392502-bf92-4019-8ad1-5b48db42b20f', 'created_at': datetime.datetime(2026, 6, 17, 3, 31, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 3, 31, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3a392502-bf92-4019-8ad1-5b48db42b20f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:55:52 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e5c76ddc-1bd1-40bd-91a5-24740c8a9795 tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b6a702d-4e8f-48a5-8082-21f1cb5a00a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:55:52 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-e5c76ddc-1bd1-40bd-91a5-24740c8a9795 tempest-VolumesGetTest-698723269 None] Volume volume-fa552f02-3043-4309-a901-1d69896a385d (fa552f02-3043-4309-a901-1d69896a385d): created successfully Jun 17 05:55:52 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e5c76ddc-1bd1-40bd-91a5-24740c8a9795 tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b6a702d-4e8f-48a5-8082-21f1cb5a00a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:55:52 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e5c76ddc-1bd1-40bd-91a5-24740c8a9795 tempest-VolumesGetTest-698723269 None] Flow 'volume_create_manager' (3c9bc8f7-e5bb-427d-b424-b0d36bdb278e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:55:52 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-e5c76ddc-1bd1-40bd-91a5-24740c8a9795 tempest-VolumesGetTest-698723269 None] Created volume successfully. Jun 17 05:55:53 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a2fabfc-1762-4d44-a4f1-6396426b9dfb tempest-VolumesGetTest-698723269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:55:53 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0a2fabfc-1762-4d44-a4f1-6396426b9dfb tempest-VolumesGetTest-698723269 None] Flow 'volume_create_manager' (e55112c3-7e76-444f-81b9-a6bd92499a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:55:53 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0a2fabfc-1762-4d44-a4f1-6396426b9dfb tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e99100e5-a43f-4576-8d75-d8c2447dae12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:55:53 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0a2fabfc-1762-4d44-a4f1-6396426b9dfb tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e99100e5-a43f-4576-8d75-d8c2447dae12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:55:54Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-832427260',display_name='tempest-VolumesGetTest-Volume-1710716909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d693b3f-0a41-4b97-9db4-08994d8f04f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8eb62f49ff94572852bf85c00fa935b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:55:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:55:54Z,use_quota=True,user_id='e5372bb75933457aab3cfe0d72de0494',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:55:53 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0a2fabfc-1762-4d44-a4f1-6396426b9dfb tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b88db9c7-e8fe-4010-81b6-5517ebc763a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:55:53 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0a2fabfc-1762-4d44-a4f1-6396426b9dfb tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b88db9c7-e8fe-4010-81b6-5517ebc763a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:55:53 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0a2fabfc-1762-4d44-a4f1-6396426b9dfb tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9adc8816-0f01-4624-9b58-027792609fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:55:53 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0a2fabfc-1762-4d44-a4f1-6396426b9dfb tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9adc8816-0f01-4624-9b58-027792609fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d693b3f-0a41-4b97-9db4-08994d8f04f9', 'volume_name': 'volume-5d693b3f-0a41-4b97-9db4-08994d8f04f9', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:55:53 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0a2fabfc-1762-4d44-a4f1-6396426b9dfb tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (941a9f71-f2cc-4a85-82af-8ac1748c8d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:55:53 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0a2fabfc-1762-4d44-a4f1-6396426b9dfb tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (941a9f71-f2cc-4a85-82af-8ac1748c8d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:55:53 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0a2fabfc-1762-4d44-a4f1-6396426b9dfb tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7542a0d8-80cf-495c-a630-6eb0bbff5910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:55:53 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-0a2fabfc-1762-4d44-a4f1-6396426b9dfb tempest-VolumesGetTest-698723269 None] Volume 5d693b3f-0a41-4b97-9db4-08994d8f04f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d693b3f-0a41-4b97-9db4-08994d8f04f9', 'volume_size': 1} Jun 17 05:55:53 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-0a2fabfc-1762-4d44-a4f1-6396426b9dfb tempest-VolumesGetTest-698723269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:55:53 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-0a2fabfc-1762-4d44-a4f1-6396426b9dfb tempest-VolumesGetTest-698723269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:55:53 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-0a2fabfc-1762-4d44-a4f1-6396426b9dfb tempest-VolumesGetTest-698723269 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:55:54Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-832427260',display_name='tempest-VolumesGetTest-Volume-1710716909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d693b3f-0a41-4b97-9db4-08994d8f04f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8eb62f49ff94572852bf85c00fa935b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:55:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:55:54Z,use_quota=True,user_id='e5372bb75933457aab3cfe0d72de0494',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:55:53 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-0a2fabfc-1762-4d44-a4f1-6396426b9dfb tempest-VolumesGetTest-698723269 None] Creating volume 5d693b3f-0a41-4b97-9db4-08994d8f04f9 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:55:53 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-0a2fabfc-1762-4d44-a4f1-6396426b9dfb tempest-VolumesGetTest-698723269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:55:53 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-0a2fabfc-1762-4d44-a4f1-6396426b9dfb tempest-VolumesGetTest-698723269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:55:53 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-0a2fabfc-1762-4d44-a4f1-6396426b9dfb tempest-VolumesGetTest-698723269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:55:53 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-0a2fabfc-1762-4d44-a4f1-6396426b9dfb tempest-VolumesGetTest-698723269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:55:53 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-0a2fabfc-1762-4d44-a4f1-6396426b9dfb tempest-VolumesGetTest-698723269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:55:53 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-0a2fabfc-1762-4d44-a4f1-6396426b9dfb tempest-VolumesGetTest-698723269 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:55:53 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-0a2fabfc-1762-4d44-a4f1-6396426b9dfb tempest-VolumesGetTest-698723269 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:55:53 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0a2fabfc-1762-4d44-a4f1-6396426b9dfb tempest-VolumesGetTest-698723269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-5d693b3f-0a41-4b97-9db4-08994d8f04f9 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:55:53 devstack sudo[107377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-5d693b3f-0a41-4b97-9db4-08994d8f04f9 1073741824 Jun 17 05:55:53 devstack sudo[107377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:55:54 devstack sudo[107377]: pam_unix(sudo:session): session closed for user root Jun 17 05:55:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0a2fabfc-1762-4d44-a4f1-6396426b9dfb tempest-VolumesGetTest-698723269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-5d693b3f-0a41-4b97-9db4-08994d8f04f9 1073741824" returned: 0 in 0.742s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:55:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0a2fabfc-1762-4d44-a4f1-6396426b9dfb tempest-VolumesGetTest-698723269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-5d693b3f-0a41-4b97-9db4-08994d8f04f9 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:55:54 devstack sudo[107383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-5d693b3f-0a41-4b97-9db4-08994d8f04f9 Jun 17 05:55:54 devstack sudo[107383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:55:55 devstack sudo[107383]: pam_unix(sudo:session): session closed for user root Jun 17 05:55:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0a2fabfc-1762-4d44-a4f1-6396426b9dfb tempest-VolumesGetTest-698723269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-5d693b3f-0a41-4b97-9db4-08994d8f04f9" returned: 0 in 0.600s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:55:55 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-0a2fabfc-1762-4d44-a4f1-6396426b9dfb tempest-VolumesGetTest-698723269 None] <== create_volume: return (1379ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:55:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-0a2fabfc-1762-4d44-a4f1-6396426b9dfb tempest-VolumesGetTest-698723269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.381s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:55:55 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0a2fabfc-1762-4d44-a4f1-6396426b9dfb tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7542a0d8-80cf-495c-a630-6eb0bbff5910) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d693b3f-0a41-4b97-9db4-08994d8f04f9', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:55:55 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0a2fabfc-1762-4d44-a4f1-6396426b9dfb tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5693d38a-13b5-4dd4-84f5-b65e33f4efc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:55:55 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-0a2fabfc-1762-4d44-a4f1-6396426b9dfb tempest-VolumesGetTest-698723269 None] Volume volume-5d693b3f-0a41-4b97-9db4-08994d8f04f9 (5d693b3f-0a41-4b97-9db4-08994d8f04f9): created successfully Jun 17 05:55:55 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0a2fabfc-1762-4d44-a4f1-6396426b9dfb tempest-VolumesGetTest-698723269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5693d38a-13b5-4dd4-84f5-b65e33f4efc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:55:55 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0a2fabfc-1762-4d44-a4f1-6396426b9dfb tempest-VolumesGetTest-698723269 None] Flow 'volume_create_manager' (e55112c3-7e76-444f-81b9-a6bd92499a8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:55:55 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-0a2fabfc-1762-4d44-a4f1-6396426b9dfb tempest-VolumesGetTest-698723269 None] Created volume successfully. Jun 17 05:55:56 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-dd868382-0d67-4f8d-b661-131f35f44993 tempest-VolumesGetTest-698723269 None] Acquiring lock "cinder-5d693b3f-0a41-4b97-9db4-08994d8f04f9-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:55:56 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-dd868382-0d67-4f8d-b661-131f35f44993 tempest-VolumesGetTest-698723269 None] Lock "cinder-5d693b3f-0a41-4b97-9db4-08994d8f04f9-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:55:56 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-dd868382-0d67-4f8d-b661-131f35f44993 tempest-VolumesGetTest-698723269 None] Acquiring lock "cinder-quobyte-5d693b3f-0a41-4b97-9db4-08994d8f04f9" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:55:56 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-dd868382-0d67-4f8d-b661-131f35f44993 tempest-VolumesGetTest-698723269 None] Lock "cinder-quobyte-5d693b3f-0a41-4b97-9db4-08994d8f04f9" acquired by "delete_volume" :: waited 0.015s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:55:56 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d531f170-0926-4961-95f6-c71e9af88e71]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:55:56 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-dd868382-0d67-4f8d-b661-131f35f44993 tempest-VolumesGetTest-698723269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-5d693b3f-0a41-4b97-9db4-08994d8f04f9 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:55:56 devstack sudo[107386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-5d693b3f-0a41-4b97-9db4-08994d8f04f9 Jun 17 05:55:56 devstack sudo[107386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:55:56 devstack sudo[107386]: pam_unix(sudo:session): session closed for user root Jun 17 05:55:56 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-dd868382-0d67-4f8d-b661-131f35f44993 tempest-VolumesGetTest-698723269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-5d693b3f-0a41-4b97-9db4-08994d8f04f9" returned: 0 in 0.710s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:55:56 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-dd868382-0d67-4f8d-b661-131f35f44993 tempest-VolumesGetTest-698723269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-5d693b3f-0a41-4b97-9db4-08994d8f04f9 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:55:56 devstack sudo[107391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-5d693b3f-0a41-4b97-9db4-08994d8f04f9 Jun 17 05:55:56 devstack sudo[107391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:55:57 devstack sudo[107391]: pam_unix(sudo:session): session closed for user root Jun 17 05:55:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-dd868382-0d67-4f8d-b661-131f35f44993 tempest-VolumesGetTest-698723269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-5d693b3f-0a41-4b97-9db4-08994d8f04f9" returned: 0 in 0.588s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:55:57 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-dd868382-0d67-4f8d-b661-131f35f44993 tempest-VolumesGetTest-698723269 None] Lock "cinder-quobyte-5d693b3f-0a41-4b97-9db4-08994d8f04f9" released by "delete_volume" :: held 1.338s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:55:57 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-dd868382-0d67-4f8d-b661-131f35f44993 tempest-VolumesGetTest-698723269 None] Created reservations ['91dafb8a-bf51-4ad1-862d-84374599d0ec', '84da3833-d342-48dd-942d-6c5296043ddf', '3a86fdf4-c1c8-4544-9f32-3fdd3c137da8', 'b2f60a83-1c27-4715-86df-63c74c71bb3f'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:55:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-dd868382-0d67-4f8d-b661-131f35f44993 tempest-VolumesGetTest-698723269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:55:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-dd868382-0d67-4f8d-b661-131f35f44993 tempest-VolumesGetTest-698723269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:55:57 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-dd868382-0d67-4f8d-b661-131f35f44993 tempest-VolumesGetTest-698723269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:55:57 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-dd868382-0d67-4f8d-b661-131f35f44993 tempest-VolumesGetTest-698723269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:55:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-dd868382-0d67-4f8d-b661-131f35f44993 tempest-VolumesGetTest-698723269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:55:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-dd868382-0d67-4f8d-b661-131f35f44993 tempest-VolumesGetTest-698723269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:55:57 devstack sudo[107394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:55:57 devstack sudo[107394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:55:58 devstack sudo[107394]: pam_unix(sudo:session): session closed for user root Jun 17 05:55:58 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-dd868382-0d67-4f8d-b661-131f35f44993 tempest-VolumesGetTest-698723269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.600s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:55:58 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-dd868382-0d67-4f8d-b661-131f35f44993 tempest-VolumesGetTest-698723269 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:55:58 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-dd868382-0d67-4f8d-b661-131f35f44993 tempest-VolumesGetTest-698723269 None] Deleted volume successfully. Jun 17 05:55:58 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-dd868382-0d67-4f8d-b661-131f35f44993 tempest-VolumesGetTest-698723269 None] Lock "cinder-5d693b3f-0a41-4b97-9db4-08994d8f04f9-delete_volume" released by "delete_volume" :: held 2.123s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:55:58 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-f61022e2-0874-491c-9ba2-f53ad0996dfe tempest-VolumesGetTest-698723269 None] Acquiring lock "cinder-fa552f02-3043-4309-a901-1d69896a385d-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:55:58 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-f61022e2-0874-491c-9ba2-f53ad0996dfe tempest-VolumesGetTest-698723269 None] Lock "cinder-fa552f02-3043-4309-a901-1d69896a385d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:55:58 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-f61022e2-0874-491c-9ba2-f53ad0996dfe tempest-VolumesGetTest-698723269 None] Acquiring lock "cinder-quobyte-fa552f02-3043-4309-a901-1d69896a385d" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:55:58 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-f61022e2-0874-491c-9ba2-f53ad0996dfe tempest-VolumesGetTest-698723269 None] Lock "cinder-quobyte-fa552f02-3043-4309-a901-1d69896a385d" acquired by "delete_volume" :: waited 0.023s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:55:58 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb33d1d3-95d4-4b4c-a542-231fd9fe9b25]: (4, 'raw') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:55:58 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f61022e2-0874-491c-9ba2-f53ad0996dfe tempest-VolumesGetTest-698723269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-fa552f02-3043-4309-a901-1d69896a385d {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:55:58 devstack sudo[107398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-fa552f02-3043-4309-a901-1d69896a385d Jun 17 05:55:58 devstack sudo[107398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:55:59 devstack sudo[107398]: pam_unix(sudo:session): session closed for user root Jun 17 05:55:59 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f61022e2-0874-491c-9ba2-f53ad0996dfe tempest-VolumesGetTest-698723269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-fa552f02-3043-4309-a901-1d69896a385d" returned: 0 in 0.704s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:55:59 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f61022e2-0874-491c-9ba2-f53ad0996dfe tempest-VolumesGetTest-698723269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-fa552f02-3043-4309-a901-1d69896a385d {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:55:59 devstack sudo[107402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-fa552f02-3043-4309-a901-1d69896a385d Jun 17 05:55:59 devstack sudo[107402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:55:59 devstack sudo[107402]: pam_unix(sudo:session): session closed for user root Jun 17 05:55:59 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f61022e2-0874-491c-9ba2-f53ad0996dfe tempest-VolumesGetTest-698723269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-fa552f02-3043-4309-a901-1d69896a385d" returned: 1 in 0.700s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:55:59 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f61022e2-0874-491c-9ba2-f53ad0996dfe tempest-VolumesGetTest-698723269 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-fa552f02-3043-4309-a901-1d69896a385d' failed. Not Retrying. {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 05:55:59 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f61022e2-0874-491c-9ba2-f53ad0996dfe tempest-VolumesGetTest-698723269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-fa552f02-3043-4309-a901-1d69896a385d {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:55:59 devstack sudo[107408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-fa552f02-3043-4309-a901-1d69896a385d Jun 17 05:55:59 devstack sudo[107408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:56:00 devstack sudo[107408]: pam_unix(sudo:session): session closed for user root Jun 17 05:56:00 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f61022e2-0874-491c-9ba2-f53ad0996dfe tempest-VolumesGetTest-698723269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-fa552f02-3043-4309-a901-1d69896a385d" returned: 0 in 0.592s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:56:00 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-f61022e2-0874-491c-9ba2-f53ad0996dfe tempest-VolumesGetTest-698723269 None] Lock "cinder-quobyte-fa552f02-3043-4309-a901-1d69896a385d" released by "delete_volume" :: held 2.059s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:56:00 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-f61022e2-0874-491c-9ba2-f53ad0996dfe tempest-VolumesGetTest-698723269 None] Created reservations ['9f3bda45-2344-44fe-b99b-f3e3c02dadb0', '90addf56-f3fe-4c2d-b7ef-6692be1e6979', '51337638-6203-4f81-8242-532f0bb5d3a1', 'cb59eaae-671c-4fd9-a594-9c3d59d4dd3b'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:56:00 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-f61022e2-0874-491c-9ba2-f53ad0996dfe tempest-VolumesGetTest-698723269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:56:00 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-f61022e2-0874-491c-9ba2-f53ad0996dfe tempest-VolumesGetTest-698723269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:56:00 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-f61022e2-0874-491c-9ba2-f53ad0996dfe tempest-VolumesGetTest-698723269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:56:00 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-f61022e2-0874-491c-9ba2-f53ad0996dfe tempest-VolumesGetTest-698723269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:56:00 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-f61022e2-0874-491c-9ba2-f53ad0996dfe tempest-VolumesGetTest-698723269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:56:00 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f61022e2-0874-491c-9ba2-f53ad0996dfe tempest-VolumesGetTest-698723269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:56:00 devstack sudo[107411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:56:00 devstack sudo[107411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:56:01 devstack sudo[107411]: pam_unix(sudo:session): session closed for user root Jun 17 05:56:01 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f61022e2-0874-491c-9ba2-f53ad0996dfe tempest-VolumesGetTest-698723269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.587s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:56:01 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-f61022e2-0874-491c-9ba2-f53ad0996dfe tempest-VolumesGetTest-698723269 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:56:01 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-f61022e2-0874-491c-9ba2-f53ad0996dfe tempest-VolumesGetTest-698723269 None] Deleted volume successfully. Jun 17 05:56:01 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-f61022e2-0874-491c-9ba2-f53ad0996dfe tempest-VolumesGetTest-698723269 None] Lock "cinder-fa552f02-3043-4309-a901-1d69896a385d-delete_volume" released by "delete_volume" :: held 2.848s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:56:03 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-35a8118f-0837-4bd9-a094-9ec8e5520c77 tempest-VolumesSnapshotListTestJSON-478678762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:56:03 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-35a8118f-0837-4bd9-a094-9ec8e5520c77 tempest-VolumesSnapshotListTestJSON-478678762 None] Flow 'volume_create_manager' (f1c1e01e-9047-49bf-9531-9a00a9b3122f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:56:03 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-35a8118f-0837-4bd9-a094-9ec8e5520c77 tempest-VolumesSnapshotListTestJSON-478678762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20e173ed-77e7-4d8a-8ca0-09003da24523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:56:04 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-35a8118f-0837-4bd9-a094-9ec8e5520c77 tempest-VolumesSnapshotListTestJSON-478678762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20e173ed-77e7-4d8a-8ca0-09003da24523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:56:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1078796680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f023a7bf-bf38-4627-80f9-002499f1a220,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eadad082895a4ee8995334f750522b6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:56:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:56:04Z,use_quota=True,user_id='4bed93aee38d4593ba528b5d3e7b5fe8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:56:04 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-35a8118f-0837-4bd9-a094-9ec8e5520c77 tempest-VolumesSnapshotListTestJSON-478678762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13e7eb38-fc70-4199-8820-ecd46543e1e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:56:04 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-35a8118f-0837-4bd9-a094-9ec8e5520c77 tempest-VolumesSnapshotListTestJSON-478678762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13e7eb38-fc70-4199-8820-ecd46543e1e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:56:04 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-35a8118f-0837-4bd9-a094-9ec8e5520c77 tempest-VolumesSnapshotListTestJSON-478678762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c7edd5b-e0ae-40c0-957c-4f1d977ae0cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:56:04 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-35a8118f-0837-4bd9-a094-9ec8e5520c77 tempest-VolumesSnapshotListTestJSON-478678762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c7edd5b-e0ae-40c0-957c-4f1d977ae0cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f023a7bf-bf38-4627-80f9-002499f1a220', 'volume_name': 'volume-f023a7bf-bf38-4627-80f9-002499f1a220', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:56:04 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-35a8118f-0837-4bd9-a094-9ec8e5520c77 tempest-VolumesSnapshotListTestJSON-478678762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83e5ec7c-6dc4-4561-be04-f5af187b4ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:56:04 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-35a8118f-0837-4bd9-a094-9ec8e5520c77 tempest-VolumesSnapshotListTestJSON-478678762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83e5ec7c-6dc4-4561-be04-f5af187b4ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:56:04 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-35a8118f-0837-4bd9-a094-9ec8e5520c77 tempest-VolumesSnapshotListTestJSON-478678762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f221b8d-7d5a-4e1e-a6dc-415b02d00054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:56:04 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-35a8118f-0837-4bd9-a094-9ec8e5520c77 tempest-VolumesSnapshotListTestJSON-478678762 None] Volume f023a7bf-bf38-4627-80f9-002499f1a220: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f023a7bf-bf38-4627-80f9-002499f1a220', 'volume_size': 1} Jun 17 05:56:04 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-35a8118f-0837-4bd9-a094-9ec8e5520c77 tempest-VolumesSnapshotListTestJSON-478678762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:56:04 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-35a8118f-0837-4bd9-a094-9ec8e5520c77 tempest-VolumesSnapshotListTestJSON-478678762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:56:04 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-35a8118f-0837-4bd9-a094-9ec8e5520c77 tempest-VolumesSnapshotListTestJSON-478678762 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:56:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1078796680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f023a7bf-bf38-4627-80f9-002499f1a220,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eadad082895a4ee8995334f750522b6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:56:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:56:04Z,use_quota=True,user_id='4bed93aee38d4593ba528b5d3e7b5fe8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:56:04 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-35a8118f-0837-4bd9-a094-9ec8e5520c77 tempest-VolumesSnapshotListTestJSON-478678762 None] Creating volume f023a7bf-bf38-4627-80f9-002499f1a220 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:56:04 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-35a8118f-0837-4bd9-a094-9ec8e5520c77 tempest-VolumesSnapshotListTestJSON-478678762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:56:04 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-35a8118f-0837-4bd9-a094-9ec8e5520c77 tempest-VolumesSnapshotListTestJSON-478678762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:56:04 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-35a8118f-0837-4bd9-a094-9ec8e5520c77 tempest-VolumesSnapshotListTestJSON-478678762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:56:04 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-35a8118f-0837-4bd9-a094-9ec8e5520c77 tempest-VolumesSnapshotListTestJSON-478678762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:56:04 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-35a8118f-0837-4bd9-a094-9ec8e5520c77 tempest-VolumesSnapshotListTestJSON-478678762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:56:04 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-35a8118f-0837-4bd9-a094-9ec8e5520c77 tempest-VolumesSnapshotListTestJSON-478678762 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:56:04 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-35a8118f-0837-4bd9-a094-9ec8e5520c77 tempest-VolumesSnapshotListTestJSON-478678762 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:56:04 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-35a8118f-0837-4bd9-a094-9ec8e5520c77 tempest-VolumesSnapshotListTestJSON-478678762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:56:04 devstack sudo[107414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220 1073741824 Jun 17 05:56:04 devstack sudo[107414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:56:04 devstack sudo[107414]: pam_unix(sudo:session): session closed for user root Jun 17 05:56:04 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-35a8118f-0837-4bd9-a094-9ec8e5520c77 tempest-VolumesSnapshotListTestJSON-478678762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220 1073741824" returned: 0 in 0.747s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:56:04 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-35a8118f-0837-4bd9-a094-9ec8e5520c77 tempest-VolumesSnapshotListTestJSON-478678762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:56:04 devstack sudo[107420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220 Jun 17 05:56:04 devstack sudo[107420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:56:05 devstack sudo[107420]: pam_unix(sudo:session): session closed for user root Jun 17 05:56:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-35a8118f-0837-4bd9-a094-9ec8e5520c77 tempest-VolumesSnapshotListTestJSON-478678762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220" returned: 0 in 0.581s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:56:05 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-35a8118f-0837-4bd9-a094-9ec8e5520c77 tempest-VolumesSnapshotListTestJSON-478678762 None] <== create_volume: return (1372ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:56:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-35a8118f-0837-4bd9-a094-9ec8e5520c77 tempest-VolumesSnapshotListTestJSON-478678762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.375s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:56:05 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-35a8118f-0837-4bd9-a094-9ec8e5520c77 tempest-VolumesSnapshotListTestJSON-478678762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f221b8d-7d5a-4e1e-a6dc-415b02d00054) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f023a7bf-bf38-4627-80f9-002499f1a220', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:56:05 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-35a8118f-0837-4bd9-a094-9ec8e5520c77 tempest-VolumesSnapshotListTestJSON-478678762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b170fac3-58fb-4dab-92c2-0e2bb5e01999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:56:05 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-35a8118f-0837-4bd9-a094-9ec8e5520c77 tempest-VolumesSnapshotListTestJSON-478678762 None] Volume volume-f023a7bf-bf38-4627-80f9-002499f1a220 (f023a7bf-bf38-4627-80f9-002499f1a220): created successfully Jun 17 05:56:05 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-35a8118f-0837-4bd9-a094-9ec8e5520c77 tempest-VolumesSnapshotListTestJSON-478678762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b170fac3-58fb-4dab-92c2-0e2bb5e01999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:56:05 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-35a8118f-0837-4bd9-a094-9ec8e5520c77 tempest-VolumesSnapshotListTestJSON-478678762 None] Flow 'volume_create_manager' (f1c1e01e-9047-49bf-9531-9a00a9b3122f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:56:05 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-35a8118f-0837-4bd9-a094-9ec8e5520c77 tempest-VolumesSnapshotListTestJSON-478678762 None] Created volume successfully. Jun 17 05:56:06 devstack cinder-volume[92083]: DEBUG dbcounter [-] [92083] Writing DB stats cinder:SELECT=56,cinder:UPDATE=88,cinder:INSERT=25,cinder:DELETE=8 {{(pid=92083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:56:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-d4c863fd-5d02-48b5-aa7a-158e2126903f tempest-VolumesSnapshotListTestJSON-478678762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:56:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-d4c863fd-5d02-48b5-aa7a-158e2126903f tempest-VolumesSnapshotListTestJSON-478678762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:56:06 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-d4c863fd-5d02-48b5-aa7a-158e2126903f tempest-VolumesSnapshotListTestJSON-478678762 None] Creating offline snapshot 8e044da2-4caa-4a52-b127-fb38c43e5e82 of volume f023a7bf-bf38-4627-80f9-002499f1a220 {{(pid=92083) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 17 05:56:06 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c11664-28b7-4a14-a020-9fa0a2f1478a]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:56:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-d4c863fd-5d02-48b5-aa7a-158e2126903f tempest-VolumesSnapshotListTestJSON-478678762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:56:06 devstack sudo[107423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220 Jun 17 05:56:06 devstack sudo[107423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:56:06 devstack sudo[107423]: pam_unix(sudo:session): session closed for user root Jun 17 05:56:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-d4c863fd-5d02-48b5-aa7a-158e2126903f tempest-VolumesSnapshotListTestJSON-478678762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220" returned: 0 in 0.684s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:56:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-d4c863fd-5d02-48b5-aa7a-158e2126903f tempest-VolumesSnapshotListTestJSON-478678762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.8e044da2-4caa-4a52-b127-fb38c43e5e82 1G {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:56:06 devstack sudo[107428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.8e044da2-4caa-4a52-b127-fb38c43e5e82 1G Jun 17 05:56:06 devstack sudo[107428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:56:07 devstack sudo[107428]: pam_unix(sudo:session): session closed for user root Jun 17 05:56:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-d4c863fd-5d02-48b5-aa7a-158e2126903f tempest-VolumesSnapshotListTestJSON-478678762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.8e044da2-4caa-4a52-b127-fb38c43e5e82 1G" returned: 0 in 0.691s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:56:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-d4c863fd-5d02-48b5-aa7a-158e2126903f tempest-VolumesSnapshotListTestJSON-478678762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f023a7bf-bf38-4627-80f9-002499f1a220 -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.8e044da2-4caa-4a52-b127-fb38c43e5e82 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:56:07 devstack sudo[107434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f023a7bf-bf38-4627-80f9-002499f1a220 -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.8e044da2-4caa-4a52-b127-fb38c43e5e82 Jun 17 05:56:07 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:56:08 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root Jun 17 05:56:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-d4c863fd-5d02-48b5-aa7a-158e2126903f tempest-VolumesSnapshotListTestJSON-478678762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f023a7bf-bf38-4627-80f9-002499f1a220 -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.8e044da2-4caa-4a52-b127-fb38c43e5e82" returned: 0 in 0.612s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:56:08 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [None req-d4c863fd-5d02-48b5-aa7a-158e2126903f tempest-VolumesSnapshotListTestJSON-478678762 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.8e044da2-4caa-4a52-b127-fb38c43e5e82 is being set with open permissions: ugo+rw Jun 17 05:56:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-d4c863fd-5d02-48b5-aa7a-158e2126903f tempest-VolumesSnapshotListTestJSON-478678762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.8e044da2-4caa-4a52-b127-fb38c43e5e82 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:56:08 devstack sudo[107440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.8e044da2-4caa-4a52-b127-fb38c43e5e82 Jun 17 05:56:08 devstack sudo[107440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:56:08 devstack sudo[107440]: pam_unix(sudo:session): session closed for user root Jun 17 05:56:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-d4c863fd-5d02-48b5-aa7a-158e2126903f tempest-VolumesSnapshotListTestJSON-478678762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.8e044da2-4caa-4a52-b127-fb38c43e5e82" returned: 0 in 0.560s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:56:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-d4c863fd-5d02-48b5-aa7a-158e2126903f tempest-VolumesSnapshotListTestJSON-478678762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.info {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:56:08 devstack sudo[107443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.info Jun 17 05:56:08 devstack sudo[107443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:56:09 devstack sudo[107443]: pam_unix(sudo:session): session closed for user root Jun 17 05:56:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-d4c863fd-5d02-48b5-aa7a-158e2126903f tempest-VolumesSnapshotListTestJSON-478678762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.info" returned: 0 in 0.585s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:56:09 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [None req-d4c863fd-5d02-48b5-aa7a-158e2126903f tempest-VolumesSnapshotListTestJSON-478678762 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.info is being set with open permissions: ugo+rw Jun 17 05:56:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-d4c863fd-5d02-48b5-aa7a-158e2126903f tempest-VolumesSnapshotListTestJSON-478678762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.info {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:56:09 devstack sudo[107447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.info Jun 17 05:56:09 devstack sudo[107447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:56:10 devstack sudo[107447]: pam_unix(sudo:session): session closed for user root Jun 17 05:56:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-d4c863fd-5d02-48b5-aa7a-158e2126903f tempest-VolumesSnapshotListTestJSON-478678762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.info" returned: 0 in 0.589s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:56:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-d4c863fd-5d02-48b5-aa7a-158e2126903f tempest-VolumesSnapshotListTestJSON-478678762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.798s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:56:10 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-d4c863fd-5d02-48b5-aa7a-158e2126903f tempest-VolumesSnapshotListTestJSON-478678762 None] Create snapshot completed successfully Jun 17 05:56:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-9e411973-1fe7-40d1-95f1-b5b59521c06d tempest-VolumesSnapshotListTestJSON-478678762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:56:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-9e411973-1fe7-40d1-95f1-b5b59521c06d tempest-VolumesSnapshotListTestJSON-478678762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:56:10 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-9e411973-1fe7-40d1-95f1-b5b59521c06d tempest-VolumesSnapshotListTestJSON-478678762 None] Creating offline snapshot 843c61fd-86b4-4765-96a7-59ccaebbe7a0 of volume f023a7bf-bf38-4627-80f9-002499f1a220 {{(pid=92083) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 17 05:56:10 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[f14bb651-121a-4261-a2c5-479ff865d778]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:56:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-9e411973-1fe7-40d1-95f1-b5b59521c06d tempest-VolumesSnapshotListTestJSON-478678762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.8e044da2-4caa-4a52-b127-fb38c43e5e82 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:56:10 devstack sudo[107450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.8e044da2-4caa-4a52-b127-fb38c43e5e82 Jun 17 05:56:10 devstack sudo[107450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:56:11 devstack sudo[107450]: pam_unix(sudo:session): session closed for user root Jun 17 05:56:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-9e411973-1fe7-40d1-95f1-b5b59521c06d tempest-VolumesSnapshotListTestJSON-478678762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.8e044da2-4caa-4a52-b127-fb38c43e5e82" returned: 0 in 0.687s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:56:11 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-9e411973-1fe7-40d1-95f1-b5b59521c06d tempest-VolumesSnapshotListTestJSON-478678762 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f023a7bf-bf38-4627-80f9-002499f1a220(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92083) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 05:56:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-9e411973-1fe7-40d1-95f1-b5b59521c06d tempest-VolumesSnapshotListTestJSON-478678762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.8e044da2-4caa-4a52-b127-fb38c43e5e82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.843c61fd-86b4-4765-96a7-59ccaebbe7a0 1G {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:56:11 devstack sudo[107455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.8e044da2-4caa-4a52-b127-fb38c43e5e82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.843c61fd-86b4-4765-96a7-59ccaebbe7a0 1G Jun 17 05:56:11 devstack sudo[107455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:56:12 devstack sudo[107455]: pam_unix(sudo:session): session closed for user root Jun 17 05:56:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-9e411973-1fe7-40d1-95f1-b5b59521c06d tempest-VolumesSnapshotListTestJSON-478678762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.8e044da2-4caa-4a52-b127-fb38c43e5e82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.843c61fd-86b4-4765-96a7-59ccaebbe7a0 1G" returned: 0 in 0.746s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:56:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-9e411973-1fe7-40d1-95f1-b5b59521c06d tempest-VolumesSnapshotListTestJSON-478678762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f023a7bf-bf38-4627-80f9-002499f1a220.8e044da2-4caa-4a52-b127-fb38c43e5e82 -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.843c61fd-86b4-4765-96a7-59ccaebbe7a0 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:56:12 devstack sudo[107460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f023a7bf-bf38-4627-80f9-002499f1a220.8e044da2-4caa-4a52-b127-fb38c43e5e82 -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.843c61fd-86b4-4765-96a7-59ccaebbe7a0 Jun 17 05:56:12 devstack sudo[107460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:56:12 devstack sudo[107460]: pam_unix(sudo:session): session closed for user root Jun 17 05:56:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-9e411973-1fe7-40d1-95f1-b5b59521c06d tempest-VolumesSnapshotListTestJSON-478678762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f023a7bf-bf38-4627-80f9-002499f1a220.8e044da2-4caa-4a52-b127-fb38c43e5e82 -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.843c61fd-86b4-4765-96a7-59ccaebbe7a0" returned: 0 in 0.654s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:56:12 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [None req-9e411973-1fe7-40d1-95f1-b5b59521c06d tempest-VolumesSnapshotListTestJSON-478678762 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.843c61fd-86b4-4765-96a7-59ccaebbe7a0 is being set with open permissions: ugo+rw Jun 17 05:56:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-9e411973-1fe7-40d1-95f1-b5b59521c06d tempest-VolumesSnapshotListTestJSON-478678762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.843c61fd-86b4-4765-96a7-59ccaebbe7a0 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:56:12 devstack sudo[107465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.843c61fd-86b4-4765-96a7-59ccaebbe7a0 Jun 17 05:56:12 devstack sudo[107465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:56:13 devstack sudo[107465]: pam_unix(sudo:session): session closed for user root Jun 17 05:56:13 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-9e411973-1fe7-40d1-95f1-b5b59521c06d tempest-VolumesSnapshotListTestJSON-478678762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.843c61fd-86b4-4765-96a7-59ccaebbe7a0" returned: 0 in 0.580s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:56:13 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-9e411973-1fe7-40d1-95f1-b5b59521c06d tempest-VolumesSnapshotListTestJSON-478678762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.760s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:56:13 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-9e411973-1fe7-40d1-95f1-b5b59521c06d tempest-VolumesSnapshotListTestJSON-478678762 None] Create snapshot completed successfully Jun 17 05:56:13 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-5d4efcbe-1880-424b-b16d-29fc18118870 tempest-VolumesSnapshotListTestJSON-478678762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:56:13 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-5d4efcbe-1880-424b-b16d-29fc18118870 tempest-VolumesSnapshotListTestJSON-478678762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:56:13 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-5d4efcbe-1880-424b-b16d-29fc18118870 tempest-VolumesSnapshotListTestJSON-478678762 None] Creating offline snapshot 3548fd7f-250f-41f3-a64d-da8d509837e2 of volume f023a7bf-bf38-4627-80f9-002499f1a220 {{(pid=92083) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 17 05:56:13 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5a2285-9a31-42eb-a6ca-17b36bc6f96c]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:56:13 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-5d4efcbe-1880-424b-b16d-29fc18118870 tempest-VolumesSnapshotListTestJSON-478678762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.843c61fd-86b4-4765-96a7-59ccaebbe7a0 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:56:13 devstack sudo[107468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.843c61fd-86b4-4765-96a7-59ccaebbe7a0 Jun 17 05:56:13 devstack sudo[107468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:56:14 devstack sudo[107468]: pam_unix(sudo:session): session closed for user root Jun 17 05:56:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-5d4efcbe-1880-424b-b16d-29fc18118870 tempest-VolumesSnapshotListTestJSON-478678762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.843c61fd-86b4-4765-96a7-59ccaebbe7a0" returned: 0 in 0.677s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:56:14 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-5d4efcbe-1880-424b-b16d-29fc18118870 tempest-VolumesSnapshotListTestJSON-478678762 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f023a7bf-bf38-4627-80f9-002499f1a220(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92083) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 05:56:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-5d4efcbe-1880-424b-b16d-29fc18118870 tempest-VolumesSnapshotListTestJSON-478678762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.843c61fd-86b4-4765-96a7-59ccaebbe7a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.3548fd7f-250f-41f3-a64d-da8d509837e2 1G {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:56:14 devstack sudo[107473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.843c61fd-86b4-4765-96a7-59ccaebbe7a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.3548fd7f-250f-41f3-a64d-da8d509837e2 1G Jun 17 05:56:14 devstack sudo[107473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:56:15 devstack sudo[107473]: pam_unix(sudo:session): session closed for user root Jun 17 05:56:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-5d4efcbe-1880-424b-b16d-29fc18118870 tempest-VolumesSnapshotListTestJSON-478678762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.843c61fd-86b4-4765-96a7-59ccaebbe7a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.3548fd7f-250f-41f3-a64d-da8d509837e2 1G" returned: 0 in 0.761s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:56:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-5d4efcbe-1880-424b-b16d-29fc18118870 tempest-VolumesSnapshotListTestJSON-478678762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f023a7bf-bf38-4627-80f9-002499f1a220.843c61fd-86b4-4765-96a7-59ccaebbe7a0 -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.3548fd7f-250f-41f3-a64d-da8d509837e2 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:56:15 devstack sudo[107480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f023a7bf-bf38-4627-80f9-002499f1a220.843c61fd-86b4-4765-96a7-59ccaebbe7a0 -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.3548fd7f-250f-41f3-a64d-da8d509837e2 Jun 17 05:56:15 devstack sudo[107480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:56:15 devstack sudo[107480]: pam_unix(sudo:session): session closed for user root Jun 17 05:56:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-5d4efcbe-1880-424b-b16d-29fc18118870 tempest-VolumesSnapshotListTestJSON-478678762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f023a7bf-bf38-4627-80f9-002499f1a220.843c61fd-86b4-4765-96a7-59ccaebbe7a0 -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.3548fd7f-250f-41f3-a64d-da8d509837e2" returned: 0 in 0.619s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:56:15 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [None req-5d4efcbe-1880-424b-b16d-29fc18118870 tempest-VolumesSnapshotListTestJSON-478678762 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.3548fd7f-250f-41f3-a64d-da8d509837e2 is being set with open permissions: ugo+rw Jun 17 05:56:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-5d4efcbe-1880-424b-b16d-29fc18118870 tempest-VolumesSnapshotListTestJSON-478678762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.3548fd7f-250f-41f3-a64d-da8d509837e2 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:56:15 devstack sudo[107485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.3548fd7f-250f-41f3-a64d-da8d509837e2 Jun 17 05:56:15 devstack sudo[107485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:56:16 devstack sudo[107485]: pam_unix(sudo:session): session closed for user root Jun 17 05:56:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-5d4efcbe-1880-424b-b16d-29fc18118870 tempest-VolumesSnapshotListTestJSON-478678762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.3548fd7f-250f-41f3-a64d-da8d509837e2" returned: 0 in 0.570s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:56:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-5d4efcbe-1880-424b-b16d-29fc18118870 tempest-VolumesSnapshotListTestJSON-478678762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.710s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:56:16 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-5d4efcbe-1880-424b-b16d-29fc18118870 tempest-VolumesSnapshotListTestJSON-478678762 None] Create snapshot completed successfully Jun 17 05:56:17 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-56a80268-4630-4e85-b92f-702b659eab95 tempest-VolumesSnapshotListTestJSON-478678762 None] Acquiring lock "cinder-3548fd7f-250f-41f3-a64d-da8d509837e2-delete_snapshot" by "delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:56:17 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-56a80268-4630-4e85-b92f-702b659eab95 tempest-VolumesSnapshotListTestJSON-478678762 None] Lock "cinder-3548fd7f-250f-41f3-a64d-da8d509837e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:56:17 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-56a80268-4630-4e85-b92f-702b659eab95 tempest-VolumesSnapshotListTestJSON-478678762 None] Acquiring lock "cinder-quobyte-f023a7bf-bf38-4627-80f9-002499f1a220" by "delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:56:17 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-56a80268-4630-4e85-b92f-702b659eab95 tempest-VolumesSnapshotListTestJSON-478678762 None] Lock "cinder-quobyte-f023a7bf-bf38-4627-80f9-002499f1a220" acquired by "delete_snapshot" :: waited 0.018s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:56:17 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-56a80268-4630-4e85-b92f-702b659eab95 tempest-VolumesSnapshotListTestJSON-478678762 None] Acquiring lock "cinder-quobyte-3548fd7f-250f-41f3-a64d-da8d509837e2" by "_delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:56:17 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-56a80268-4630-4e85-b92f-702b659eab95 tempest-VolumesSnapshotListTestJSON-478678762 None] Lock "cinder-quobyte-3548fd7f-250f-41f3-a64d-da8d509837e2" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:56:17 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-56a80268-4630-4e85-b92f-702b659eab95 tempest-VolumesSnapshotListTestJSON-478678762 None] Deleting offline snapshot 3548fd7f-250f-41f3-a64d-da8d509837e2 of volume f023a7bf-bf38-4627-80f9-002499f1a220 {{(pid=92083) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 17 05:56:17 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-56a80268-4630-4e85-b92f-702b659eab95 tempest-VolumesSnapshotListTestJSON-478678762 None] snapshot_file for this snap is: volume-f023a7bf-bf38-4627-80f9-002499f1a220.3548fd7f-250f-41f3-a64d-da8d509837e2 {{(pid=92083) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 17 05:56:17 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac9ea37-ebf1-431f-baa6-fa8540179877]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:56:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-56a80268-4630-4e85-b92f-702b659eab95 tempest-VolumesSnapshotListTestJSON-478678762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.3548fd7f-250f-41f3-a64d-da8d509837e2 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:56:17 devstack sudo[107494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.3548fd7f-250f-41f3-a64d-da8d509837e2 Jun 17 05:56:17 devstack sudo[107494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:56:18 devstack sudo[107494]: pam_unix(sudo:session): session closed for user root Jun 17 05:56:18 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-56a80268-4630-4e85-b92f-702b659eab95 tempest-VolumesSnapshotListTestJSON-478678762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.3548fd7f-250f-41f3-a64d-da8d509837e2" returned: 0 in 0.676s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:56:18 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-56a80268-4630-4e85-b92f-702b659eab95 tempest-VolumesSnapshotListTestJSON-478678762 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f023a7bf-bf38-4627-80f9-002499f1a220(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92083) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 05:56:18 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb5428c-a79d-4ef4-a126-5210f544b9f9]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:56:18 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-56a80268-4630-4e85-b92f-702b659eab95 tempest-VolumesSnapshotListTestJSON-478678762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.843c61fd-86b4-4765-96a7-59ccaebbe7a0 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:56:18 devstack sudo[107499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.843c61fd-86b4-4765-96a7-59ccaebbe7a0 Jun 17 05:56:18 devstack sudo[107499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:56:19 devstack sudo[107499]: pam_unix(sudo:session): session closed for user root Jun 17 05:56:19 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-56a80268-4630-4e85-b92f-702b659eab95 tempest-VolumesSnapshotListTestJSON-478678762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.843c61fd-86b4-4765-96a7-59ccaebbe7a0" returned: 0 in 0.678s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:56:19 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-56a80268-4630-4e85-b92f-702b659eab95 tempest-VolumesSnapshotListTestJSON-478678762 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f023a7bf-bf38-4627-80f9-002499f1a220(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92083) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 05:56:19 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-56a80268-4630-4e85-b92f-702b659eab95 tempest-VolumesSnapshotListTestJSON-478678762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.3548fd7f-250f-41f3-a64d-da8d509837e2 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:56:19 devstack sudo[107504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.3548fd7f-250f-41f3-a64d-da8d509837e2 Jun 17 05:56:19 devstack sudo[107504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:56:19 devstack sudo[107504]: pam_unix(sudo:session): session closed for user root Jun 17 05:56:19 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-56a80268-4630-4e85-b92f-702b659eab95 tempest-VolumesSnapshotListTestJSON-478678762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.3548fd7f-250f-41f3-a64d-da8d509837e2" returned: 0 in 0.736s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:56:19 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-56a80268-4630-4e85-b92f-702b659eab95 tempest-VolumesSnapshotListTestJSON-478678762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.3548fd7f-250f-41f3-a64d-da8d509837e2 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:56:19 devstack sudo[107510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.3548fd7f-250f-41f3-a64d-da8d509837e2 Jun 17 05:56:19 devstack sudo[107510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:56:20 devstack sudo[107510]: pam_unix(sudo:session): session closed for user root Jun 17 05:56:20 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-56a80268-4630-4e85-b92f-702b659eab95 tempest-VolumesSnapshotListTestJSON-478678762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.3548fd7f-250f-41f3-a64d-da8d509837e2" returned: 0 in 0.574s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:56:20 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-56a80268-4630-4e85-b92f-702b659eab95 tempest-VolumesSnapshotListTestJSON-478678762 None] Lock "cinder-quobyte-3548fd7f-250f-41f3-a64d-da8d509837e2" released by "_delete_snapshot" :: held 2.747s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:56:20 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-56a80268-4630-4e85-b92f-702b659eab95 tempest-VolumesSnapshotListTestJSON-478678762 None] Lock "cinder-quobyte-f023a7bf-bf38-4627-80f9-002499f1a220" released by "delete_snapshot" :: held 2.767s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:56:20 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-56a80268-4630-4e85-b92f-702b659eab95 tempest-VolumesSnapshotListTestJSON-478678762 None] Created reservations ['dc603fc5-c7c2-451e-b30d-22543a94fb8d', '767e0eb5-2688-461b-9b23-0d7f33827103', 'aa443858-8bb2-48a7-ae1e-40d3a620d3e9', 'd600e57d-5cd9-49e8-adc9-de1a40ead2f6'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:56:20 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-56a80268-4630-4e85-b92f-702b659eab95 tempest-VolumesSnapshotListTestJSON-478678762 None] Delete snapshot completed successfully. Jun 17 05:56:20 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-56a80268-4630-4e85-b92f-702b659eab95 tempest-VolumesSnapshotListTestJSON-478678762 None] Lock "cinder-3548fd7f-250f-41f3-a64d-da8d509837e2-delete_snapshot" released by "delete_snapshot" :: held 2.891s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:56:20 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-03a102cd-aa1f-40fd-b699-1451a1d04259 tempest-VolumesSnapshotListTestJSON-478678762 None] Acquiring lock "cinder-843c61fd-86b4-4765-96a7-59ccaebbe7a0-delete_snapshot" by "delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:56:20 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-03a102cd-aa1f-40fd-b699-1451a1d04259 tempest-VolumesSnapshotListTestJSON-478678762 None] Lock "cinder-843c61fd-86b4-4765-96a7-59ccaebbe7a0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:56:20 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-03a102cd-aa1f-40fd-b699-1451a1d04259 tempest-VolumesSnapshotListTestJSON-478678762 None] Acquiring lock "cinder-quobyte-f023a7bf-bf38-4627-80f9-002499f1a220" by "delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:56:20 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-03a102cd-aa1f-40fd-b699-1451a1d04259 tempest-VolumesSnapshotListTestJSON-478678762 None] Lock "cinder-quobyte-f023a7bf-bf38-4627-80f9-002499f1a220" acquired by "delete_snapshot" :: waited 0.013s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:56:20 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-03a102cd-aa1f-40fd-b699-1451a1d04259 tempest-VolumesSnapshotListTestJSON-478678762 None] Acquiring lock "cinder-quobyte-843c61fd-86b4-4765-96a7-59ccaebbe7a0" by "_delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:56:20 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-03a102cd-aa1f-40fd-b699-1451a1d04259 tempest-VolumesSnapshotListTestJSON-478678762 None] Lock "cinder-quobyte-843c61fd-86b4-4765-96a7-59ccaebbe7a0" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:56:20 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-03a102cd-aa1f-40fd-b699-1451a1d04259 tempest-VolumesSnapshotListTestJSON-478678762 None] Deleting offline snapshot 843c61fd-86b4-4765-96a7-59ccaebbe7a0 of volume f023a7bf-bf38-4627-80f9-002499f1a220 {{(pid=92083) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 17 05:56:20 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-03a102cd-aa1f-40fd-b699-1451a1d04259 tempest-VolumesSnapshotListTestJSON-478678762 None] snapshot_file for this snap is: volume-f023a7bf-bf38-4627-80f9-002499f1a220.843c61fd-86b4-4765-96a7-59ccaebbe7a0 {{(pid=92083) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 17 05:56:20 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b6880b-f604-4c67-afea-35d8107bcc6b]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:56:20 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-03a102cd-aa1f-40fd-b699-1451a1d04259 tempest-VolumesSnapshotListTestJSON-478678762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.843c61fd-86b4-4765-96a7-59ccaebbe7a0 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:56:21 devstack sudo[107513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.843c61fd-86b4-4765-96a7-59ccaebbe7a0 Jun 17 05:56:21 devstack sudo[107513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:56:21 devstack sudo[107513]: pam_unix(sudo:session): session closed for user root Jun 17 05:56:21 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-03a102cd-aa1f-40fd-b699-1451a1d04259 tempest-VolumesSnapshotListTestJSON-478678762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.843c61fd-86b4-4765-96a7-59ccaebbe7a0" returned: 0 in 0.672s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:56:21 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-03a102cd-aa1f-40fd-b699-1451a1d04259 tempest-VolumesSnapshotListTestJSON-478678762 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f023a7bf-bf38-4627-80f9-002499f1a220(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92083) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 05:56:21 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cfc7734-7d6e-44eb-bc0c-053e1dcf16eb]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:56:21 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-03a102cd-aa1f-40fd-b699-1451a1d04259 tempest-VolumesSnapshotListTestJSON-478678762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.8e044da2-4caa-4a52-b127-fb38c43e5e82 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:56:21 devstack sudo[107518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.8e044da2-4caa-4a52-b127-fb38c43e5e82 Jun 17 05:56:21 devstack sudo[107518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:56:22 devstack sudo[107518]: pam_unix(sudo:session): session closed for user root Jun 17 05:56:22 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-03a102cd-aa1f-40fd-b699-1451a1d04259 tempest-VolumesSnapshotListTestJSON-478678762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.8e044da2-4caa-4a52-b127-fb38c43e5e82" returned: 0 in 0.676s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:56:22 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-03a102cd-aa1f-40fd-b699-1451a1d04259 tempest-VolumesSnapshotListTestJSON-478678762 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f023a7bf-bf38-4627-80f9-002499f1a220(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92083) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 05:56:22 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-03a102cd-aa1f-40fd-b699-1451a1d04259 tempest-VolumesSnapshotListTestJSON-478678762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.843c61fd-86b4-4765-96a7-59ccaebbe7a0 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:56:22 devstack sudo[107523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.843c61fd-86b4-4765-96a7-59ccaebbe7a0 Jun 17 05:56:22 devstack sudo[107523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:56:22 devstack sudo[107523]: pam_unix(sudo:session): session closed for user root Jun 17 05:56:23 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-03a102cd-aa1f-40fd-b699-1451a1d04259 tempest-VolumesSnapshotListTestJSON-478678762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.843c61fd-86b4-4765-96a7-59ccaebbe7a0" returned: 0 in 0.681s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:56:23 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-03a102cd-aa1f-40fd-b699-1451a1d04259 tempest-VolumesSnapshotListTestJSON-478678762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.843c61fd-86b4-4765-96a7-59ccaebbe7a0 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:56:23 devstack sudo[107528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.843c61fd-86b4-4765-96a7-59ccaebbe7a0 Jun 17 05:56:23 devstack sudo[107528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:56:23 devstack sudo[107528]: pam_unix(sudo:session): session closed for user root Jun 17 05:56:23 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-03a102cd-aa1f-40fd-b699-1451a1d04259 tempest-VolumesSnapshotListTestJSON-478678762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.843c61fd-86b4-4765-96a7-59ccaebbe7a0" returned: 0 in 0.592s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:56:23 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-03a102cd-aa1f-40fd-b699-1451a1d04259 tempest-VolumesSnapshotListTestJSON-478678762 None] Lock "cinder-quobyte-843c61fd-86b4-4765-96a7-59ccaebbe7a0" released by "_delete_snapshot" :: held 2.705s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:56:23 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-03a102cd-aa1f-40fd-b699-1451a1d04259 tempest-VolumesSnapshotListTestJSON-478678762 None] Lock "cinder-quobyte-f023a7bf-bf38-4627-80f9-002499f1a220" released by "delete_snapshot" :: held 2.727s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:56:23 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-03a102cd-aa1f-40fd-b699-1451a1d04259 tempest-VolumesSnapshotListTestJSON-478678762 None] Created reservations ['582138a6-4a51-4541-a020-64c58a8b2aaf', 'ec7b705f-6d98-4038-a625-513a58ae4e14', '2441427f-757a-480b-b4ec-342a6b88fe64', '24741920-1375-4f10-a15a-df6d92a06194'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:56:23 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-03a102cd-aa1f-40fd-b699-1451a1d04259 tempest-VolumesSnapshotListTestJSON-478678762 None] Delete snapshot completed successfully. Jun 17 05:56:23 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-03a102cd-aa1f-40fd-b699-1451a1d04259 tempest-VolumesSnapshotListTestJSON-478678762 None] Lock "cinder-843c61fd-86b4-4765-96a7-59ccaebbe7a0-delete_snapshot" released by "delete_snapshot" :: held 2.846s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:56:24 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-5ae7b4e0-44cd-4d34-bd91-01fdedc72945 tempest-VolumesSnapshotListTestJSON-478678762 None] Acquiring lock "cinder-8e044da2-4caa-4a52-b127-fb38c43e5e82-delete_snapshot" by "delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:56:24 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-5ae7b4e0-44cd-4d34-bd91-01fdedc72945 tempest-VolumesSnapshotListTestJSON-478678762 None] Lock "cinder-8e044da2-4caa-4a52-b127-fb38c43e5e82-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:56:24 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-5ae7b4e0-44cd-4d34-bd91-01fdedc72945 tempest-VolumesSnapshotListTestJSON-478678762 None] Acquiring lock "cinder-quobyte-f023a7bf-bf38-4627-80f9-002499f1a220" by "delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:56:24 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-5ae7b4e0-44cd-4d34-bd91-01fdedc72945 tempest-VolumesSnapshotListTestJSON-478678762 None] Lock "cinder-quobyte-f023a7bf-bf38-4627-80f9-002499f1a220" acquired by "delete_snapshot" :: waited 0.013s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:56:24 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-5ae7b4e0-44cd-4d34-bd91-01fdedc72945 tempest-VolumesSnapshotListTestJSON-478678762 None] Acquiring lock "cinder-quobyte-8e044da2-4caa-4a52-b127-fb38c43e5e82" by "_delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:56:24 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-5ae7b4e0-44cd-4d34-bd91-01fdedc72945 tempest-VolumesSnapshotListTestJSON-478678762 None] Lock "cinder-quobyte-8e044da2-4caa-4a52-b127-fb38c43e5e82" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:56:24 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-5ae7b4e0-44cd-4d34-bd91-01fdedc72945 tempest-VolumesSnapshotListTestJSON-478678762 None] Deleting offline snapshot 8e044da2-4caa-4a52-b127-fb38c43e5e82 of volume f023a7bf-bf38-4627-80f9-002499f1a220 {{(pid=92083) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 17 05:56:24 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-5ae7b4e0-44cd-4d34-bd91-01fdedc72945 tempest-VolumesSnapshotListTestJSON-478678762 None] snapshot_file for this snap is: volume-f023a7bf-bf38-4627-80f9-002499f1a220.8e044da2-4caa-4a52-b127-fb38c43e5e82 {{(pid=92083) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 17 05:56:24 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[607aa191-559b-43ab-b358-77e2eba96f25]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:56:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-5ae7b4e0-44cd-4d34-bd91-01fdedc72945 tempest-VolumesSnapshotListTestJSON-478678762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.8e044da2-4caa-4a52-b127-fb38c43e5e82 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:56:24 devstack sudo[107531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.8e044da2-4caa-4a52-b127-fb38c43e5e82 Jun 17 05:56:24 devstack sudo[107531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:56:24 devstack sudo[107531]: pam_unix(sudo:session): session closed for user root Jun 17 05:56:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-5ae7b4e0-44cd-4d34-bd91-01fdedc72945 tempest-VolumesSnapshotListTestJSON-478678762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.8e044da2-4caa-4a52-b127-fb38c43e5e82" returned: 0 in 0.680s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:56:24 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-5ae7b4e0-44cd-4d34-bd91-01fdedc72945 tempest-VolumesSnapshotListTestJSON-478678762 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f023a7bf-bf38-4627-80f9-002499f1a220(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92083) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 05:56:24 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb453453-28b9-4bcd-9a2e-7fcd08a03bd6]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:56:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-5ae7b4e0-44cd-4d34-bd91-01fdedc72945 tempest-VolumesSnapshotListTestJSON-478678762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:56:24 devstack sudo[107536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220 Jun 17 05:56:24 devstack sudo[107536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:56:25 devstack sudo[107536]: pam_unix(sudo:session): session closed for user root Jun 17 05:56:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-5ae7b4e0-44cd-4d34-bd91-01fdedc72945 tempest-VolumesSnapshotListTestJSON-478678762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220" returned: 0 in 0.668s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:56:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-5ae7b4e0-44cd-4d34-bd91-01fdedc72945 tempest-VolumesSnapshotListTestJSON-478678762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.8e044da2-4caa-4a52-b127-fb38c43e5e82 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:56:25 devstack sudo[107541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.8e044da2-4caa-4a52-b127-fb38c43e5e82 Jun 17 05:56:25 devstack sudo[107541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:56:26 devstack sudo[107541]: pam_unix(sudo:session): session closed for user root Jun 17 05:56:26 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-5ae7b4e0-44cd-4d34-bd91-01fdedc72945 tempest-VolumesSnapshotListTestJSON-478678762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.8e044da2-4caa-4a52-b127-fb38c43e5e82" returned: 0 in 0.646s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:56:26 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-5ae7b4e0-44cd-4d34-bd91-01fdedc72945 tempest-VolumesSnapshotListTestJSON-478678762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.8e044da2-4caa-4a52-b127-fb38c43e5e82 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:56:26 devstack sudo[107546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.8e044da2-4caa-4a52-b127-fb38c43e5e82 Jun 17 05:56:26 devstack sudo[107546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:56:26 devstack sudo[107546]: pam_unix(sudo:session): session closed for user root Jun 17 05:56:26 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-5ae7b4e0-44cd-4d34-bd91-01fdedc72945 tempest-VolumesSnapshotListTestJSON-478678762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220.8e044da2-4caa-4a52-b127-fb38c43e5e82" returned: 0 in 0.567s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:56:26 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-5ae7b4e0-44cd-4d34-bd91-01fdedc72945 tempest-VolumesSnapshotListTestJSON-478678762 None] Lock "cinder-quobyte-8e044da2-4caa-4a52-b127-fb38c43e5e82" released by "_delete_snapshot" :: held 2.659s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:56:26 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-5ae7b4e0-44cd-4d34-bd91-01fdedc72945 tempest-VolumesSnapshotListTestJSON-478678762 None] Lock "cinder-quobyte-f023a7bf-bf38-4627-80f9-002499f1a220" released by "delete_snapshot" :: held 2.680s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:56:26 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-5ae7b4e0-44cd-4d34-bd91-01fdedc72945 tempest-VolumesSnapshotListTestJSON-478678762 None] Created reservations ['2331a895-0dac-450e-adee-63e955d6ba70', '1fef3587-1e41-40f0-b294-fb393d812461', 'e9f0e074-a7be-4e8d-9693-b45d2a2a6944', '4c315848-13de-4039-94d9-dc50c6ae5efc'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:56:26 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-5ae7b4e0-44cd-4d34-bd91-01fdedc72945 tempest-VolumesSnapshotListTestJSON-478678762 None] Delete snapshot completed successfully. Jun 17 05:56:26 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-5ae7b4e0-44cd-4d34-bd91-01fdedc72945 tempest-VolumesSnapshotListTestJSON-478678762 None] Lock "cinder-8e044da2-4caa-4a52-b127-fb38c43e5e82-delete_snapshot" released by "delete_snapshot" :: held 2.801s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:56:27 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-389b6c14-3f25-4637-916b-ddea5eecccf0 tempest-VolumesSnapshotListTestJSON-478678762 None] Acquiring lock "cinder-f023a7bf-bf38-4627-80f9-002499f1a220-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:56:27 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-389b6c14-3f25-4637-916b-ddea5eecccf0 tempest-VolumesSnapshotListTestJSON-478678762 None] Lock "cinder-f023a7bf-bf38-4627-80f9-002499f1a220-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:56:27 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-389b6c14-3f25-4637-916b-ddea5eecccf0 tempest-VolumesSnapshotListTestJSON-478678762 None] Acquiring lock "cinder-quobyte-f023a7bf-bf38-4627-80f9-002499f1a220" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:56:27 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-389b6c14-3f25-4637-916b-ddea5eecccf0 tempest-VolumesSnapshotListTestJSON-478678762 None] Lock "cinder-quobyte-f023a7bf-bf38-4627-80f9-002499f1a220" acquired by "delete_volume" :: waited 0.013s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:56:27 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eaba7e7-766c-4245-9696-5fc9db7164ab]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:56:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-389b6c14-3f25-4637-916b-ddea5eecccf0 tempest-VolumesSnapshotListTestJSON-478678762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:56:27 devstack sudo[107549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220 Jun 17 05:56:27 devstack sudo[107549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:56:27 devstack cinder-volume[92083]: DEBUG oslo_service.periodic_task [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92083) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 05:56:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:56:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:56:27 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:56:27 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:56:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:56:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:56:27 devstack sudo[107551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:56:27 devstack sudo[107551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:56:28 devstack sudo[107549]: pam_unix(sudo:session): session closed for user root Jun 17 05:56:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-389b6c14-3f25-4637-916b-ddea5eecccf0 tempest-VolumesSnapshotListTestJSON-478678762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220" returned: 0 in 0.697s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:56:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-389b6c14-3f25-4637-916b-ddea5eecccf0 tempest-VolumesSnapshotListTestJSON-478678762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:56:28 devstack sudo[107556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220 Jun 17 05:56:28 devstack sudo[107556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:56:28 devstack sudo[107551]: pam_unix(sudo:session): session closed for user root Jun 17 05:56:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.580s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:56:28 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:56:28 devstack cinder-volume[92083]: DEBUG oslo_service.periodic_task [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running periodic task VolumeManager._thread_info {{(pid=92083) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 05:56:28 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] thread count: 28 {{(pid=92083) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 17 05:56:28 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] thread info: [<_MainThread(MainThread, started 133483869905024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92083) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 17 05:56:28 devstack sudo[107556]: pam_unix(sudo:session): session closed for user root Jun 17 05:56:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-389b6c14-3f25-4637-916b-ddea5eecccf0 tempest-VolumesSnapshotListTestJSON-478678762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-f023a7bf-bf38-4627-80f9-002499f1a220" returned: 0 in 0.601s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:56:28 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-389b6c14-3f25-4637-916b-ddea5eecccf0 tempest-VolumesSnapshotListTestJSON-478678762 None] Lock "cinder-quobyte-f023a7bf-bf38-4627-80f9-002499f1a220" released by "delete_volume" :: held 1.350s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:56:28 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-389b6c14-3f25-4637-916b-ddea5eecccf0 tempest-VolumesSnapshotListTestJSON-478678762 None] Created reservations ['7e64f77c-c465-422b-b304-e1dce09157bb', '57a491d9-a4d1-4db9-a386-8c0fe80779e8', '3ac52780-fa49-441b-9a9e-1ea54e5b5fce', 'f23992ad-c95e-4722-939f-df3fb3c200a6'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:56:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-389b6c14-3f25-4637-916b-ddea5eecccf0 tempest-VolumesSnapshotListTestJSON-478678762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:56:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-389b6c14-3f25-4637-916b-ddea5eecccf0 tempest-VolumesSnapshotListTestJSON-478678762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:56:28 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-389b6c14-3f25-4637-916b-ddea5eecccf0 tempest-VolumesSnapshotListTestJSON-478678762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:56:28 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-389b6c14-3f25-4637-916b-ddea5eecccf0 tempest-VolumesSnapshotListTestJSON-478678762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:56:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-389b6c14-3f25-4637-916b-ddea5eecccf0 tempest-VolumesSnapshotListTestJSON-478678762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:56:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-389b6c14-3f25-4637-916b-ddea5eecccf0 tempest-VolumesSnapshotListTestJSON-478678762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:56:28 devstack sudo[107561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:56:28 devstack sudo[107561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:56:29 devstack sudo[107561]: pam_unix(sudo:session): session closed for user root Jun 17 05:56:29 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-389b6c14-3f25-4637-916b-ddea5eecccf0 tempest-VolumesSnapshotListTestJSON-478678762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.591s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:56:29 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-389b6c14-3f25-4637-916b-ddea5eecccf0 tempest-VolumesSnapshotListTestJSON-478678762 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:56:29 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-389b6c14-3f25-4637-916b-ddea5eecccf0 tempest-VolumesSnapshotListTestJSON-478678762 None] Deleted volume successfully. Jun 17 05:56:29 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-389b6c14-3f25-4637-916b-ddea5eecccf0 tempest-VolumesSnapshotListTestJSON-478678762 None] Lock "cinder-f023a7bf-bf38-4627-80f9-002499f1a220-delete_volume" released by "delete_volume" :: held 2.122s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:56:38 devstack cinder-volume[92083]: DEBUG dbcounter [-] [92083] Writing DB stats cinder:SELECT=26,cinder:INSERT=8,cinder:DELETE=1,cinder:UPDATE=24 {{(pid=92083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:56:39 devstack cinder-volume[92083]: DEBUG dbcounter [-] [92083] Writing DB stats cinder:UPDATE=85,cinder:SELECT=77,cinder:DELETE=7,cinder:INSERT=29 {{(pid=92083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:56:53 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-73b3f0c1-5577-4f8e-ba59-6aafc436aded tempest-TestShelveInstance-904320389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:56:53 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-73b3f0c1-5577-4f8e-ba59-6aafc436aded tempest-TestShelveInstance-904320389 None] Flow 'volume_create_manager' (8a962bac-102c-4c17-bae2-e9c9064527fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:56:53 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-73b3f0c1-5577-4f8e-ba59-6aafc436aded tempest-TestShelveInstance-904320389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c90c659-5ab4-4266-b02d-4bf880c9c22e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:56:53 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-73b3f0c1-5577-4f8e-ba59-6aafc436aded tempest-TestShelveInstance-904320389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c90c659-5ab4-4266-b02d-4bf880c9c22e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:56:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-363008663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b29b7f45-bbe5-4332-b6dd-638ef7c9b763,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa64514fc1c64ef1ad88fdbe16beb1a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:56:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:56:54Z,use_quota=True,user_id='a78b6f539d12497384f1d95656cd29c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:56:53 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-73b3f0c1-5577-4f8e-ba59-6aafc436aded tempest-TestShelveInstance-904320389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea84ffdb-8a49-4239-99e6-96edddfe0e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:56:53 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-73b3f0c1-5577-4f8e-ba59-6aafc436aded tempest-TestShelveInstance-904320389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea84ffdb-8a49-4239-99e6-96edddfe0e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:56:53 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-73b3f0c1-5577-4f8e-ba59-6aafc436aded tempest-TestShelveInstance-904320389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4d2a508-e7c0-43f0-87fe-f783a56c1e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:56:53 devstack cinder-volume[92083]: DEBUG cinder.image.glance [None req-73b3f0c1-5577-4f8e-ba59-6aafc436aded tempest-TestShelveInstance-904320389 None] Creating Keystone auth plugin from conf {{(pid=92083) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 17 05:56:54 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-73b3f0c1-5577-4f8e-ba59-6aafc436aded tempest-TestShelveInstance-904320389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4d2a508-e7c0-43f0-87fe-f783a56c1e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b29b7f45-bbe5-4332-b6dd-638ef7c9b763', 'volume_name': 'volume-b29b7f45-bbe5-4332-b6dd-638ef7c9b763', 'volume_size': 1, 'image_id': '3a392502-bf92-4019-8ad1-5b48db42b20f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3a392502-bf92-4019-8ad1-5b48db42b20f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd68ea14f86c14b8aac202e298736b075', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3a392502-bf92-4019-8ad1-5b48db42b20f', 'created_at': datetime.datetime(2026, 6, 17, 3, 31, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 3, 31, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3a392502-bf92-4019-8ad1-5b48db42b20f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:56:54 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-73b3f0c1-5577-4f8e-ba59-6aafc436aded tempest-TestShelveInstance-904320389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72519b35-61c1-4f0d-8685-020d5b2a80f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:56:54 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-73b3f0c1-5577-4f8e-ba59-6aafc436aded tempest-TestShelveInstance-904320389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72519b35-61c1-4f0d-8685-020d5b2a80f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:56:54 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-73b3f0c1-5577-4f8e-ba59-6aafc436aded tempest-TestShelveInstance-904320389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3812614b-6da0-4365-a77b-589bea1a25d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:56:54 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-73b3f0c1-5577-4f8e-ba59-6aafc436aded tempest-TestShelveInstance-904320389 None] Volume b29b7f45-bbe5-4332-b6dd-638ef7c9b763: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b29b7f45-bbe5-4332-b6dd-638ef7c9b763', 'volume_size': 1, 'image_id': '3a392502-bf92-4019-8ad1-5b48db42b20f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3a392502-bf92-4019-8ad1-5b48db42b20f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd68ea14f86c14b8aac202e298736b075', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3a392502-bf92-4019-8ad1-5b48db42b20f', 'created_at': datetime.datetime(2026, 6, 17, 3, 31, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 3, 31, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3a392502-bf92-4019-8ad1-5b48db42b20f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 17 05:56:54 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-73b3f0c1-5577-4f8e-ba59-6aafc436aded tempest-TestShelveInstance-904320389 None] Trying to clone b29b7f45-bbe5-4332-b6dd-638ef7c9b763 from image 3a392502-bf92-4019-8ad1-5b48db42b20f at location (None, [{'url': 'file:///opt/stack/data/glance/images/3a392502-bf92-4019-8ad1-5b48db42b20f', 'metadata': {}}]). {{(pid=92083) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 17 05:56:54 devstack cinder-volume[92083]: DEBUG cinder.image.image_utils [None req-73b3f0c1-5577-4f8e-ba59-6aafc436aded tempest-TestShelveInstance-904320389 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3a392502-bf92-4019-8ad1-5b48db42b20f_vmufxwcsdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=92083) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 17 05:56:54 devstack cinder-volume[92083]: INFO cinder.image.image_utils [None req-73b3f0c1-5577-4f8e-ba59-6aafc436aded tempest-TestShelveInstance-904320389 None] Image download 20.69 MB at 20.69 MB/s Jun 17 05:56:54 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db515a1-944a-434f-ac4a-d186d6a942fc]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:56:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-73b3f0c1-5577-4f8e-ba59-6aafc436aded tempest-TestShelveInstance-904320389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a392502-bf92-4019-8ad1-5b48db42b20f_vmufxwcsdevstack@QuobyteHD {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:56:54 devstack sudo[107608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a392502-bf92-4019-8ad1-5b48db42b20f_vmufxwcsdevstack@QuobyteHD Jun 17 05:56:54 devstack sudo[107608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:56:55 devstack sudo[107608]: pam_unix(sudo:session): session closed for user root Jun 17 05:56:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-73b3f0c1-5577-4f8e-ba59-6aafc436aded tempest-TestShelveInstance-904320389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a392502-bf92-4019-8ad1-5b48db42b20f_vmufxwcsdevstack@QuobyteHD" returned: 0 in 0.656s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:56:55 devstack cinder-volume[92083]: DEBUG cinder.image.image_utils [None req-73b3f0c1-5577-4f8e-ba59-6aafc436aded tempest-TestShelveInstance-904320389 None] Temporary image 3a392502-bf92-4019-8ad1-5b48db42b20f is fetched for user a78b6f539d12497384f1d95656cd29c9. {{(pid=92083) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 17 05:56:55 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f003b6-c8f0-4a6e-8f55-7008007fa093]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:56:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-73b3f0c1-5577-4f8e-ba59-6aafc436aded tempest-TestShelveInstance-904320389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a392502-bf92-4019-8ad1-5b48db42b20f_vmufxwcsdevstack@QuobyteHD {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:56:55 devstack sudo[107613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a392502-bf92-4019-8ad1-5b48db42b20f_vmufxwcsdevstack@QuobyteHD Jun 17 05:56:55 devstack sudo[107613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:56:55 devstack sudo[107613]: pam_unix(sudo:session): session closed for user root Jun 17 05:56:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-73b3f0c1-5577-4f8e-ba59-6aafc436aded tempest-TestShelveInstance-904320389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a392502-bf92-4019-8ad1-5b48db42b20f_vmufxwcsdevstack@QuobyteHD" returned: 0 in 0.675s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:56:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-73b3f0c1-5577-4f8e-ba59-6aafc436aded tempest-TestShelveInstance-904320389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:56:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-73b3f0c1-5577-4f8e-ba59-6aafc436aded tempest-TestShelveInstance-904320389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:56:55 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-73b3f0c1-5577-4f8e-ba59-6aafc436aded tempest-TestShelveInstance-904320389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:56:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-363008663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b29b7f45-bbe5-4332-b6dd-638ef7c9b763,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa64514fc1c64ef1ad88fdbe16beb1a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:56:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:56:54Z,use_quota=True,user_id='a78b6f539d12497384f1d95656cd29c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:56:55 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-73b3f0c1-5577-4f8e-ba59-6aafc436aded tempest-TestShelveInstance-904320389 None] Creating volume b29b7f45-bbe5-4332-b6dd-638ef7c9b763 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:56:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-73b3f0c1-5577-4f8e-ba59-6aafc436aded tempest-TestShelveInstance-904320389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:56:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-73b3f0c1-5577-4f8e-ba59-6aafc436aded tempest-TestShelveInstance-904320389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:56:55 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-73b3f0c1-5577-4f8e-ba59-6aafc436aded tempest-TestShelveInstance-904320389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:56:55 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-73b3f0c1-5577-4f8e-ba59-6aafc436aded tempest-TestShelveInstance-904320389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:56:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-73b3f0c1-5577-4f8e-ba59-6aafc436aded tempest-TestShelveInstance-904320389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:56:55 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-73b3f0c1-5577-4f8e-ba59-6aafc436aded tempest-TestShelveInstance-904320389 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:56:55 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-73b3f0c1-5577-4f8e-ba59-6aafc436aded tempest-TestShelveInstance-904320389 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:56:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-73b3f0c1-5577-4f8e-ba59-6aafc436aded tempest-TestShelveInstance-904320389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b29b7f45-bbe5-4332-b6dd-638ef7c9b763 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:56:56 devstack sudo[107618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b29b7f45-bbe5-4332-b6dd-638ef7c9b763 1073741824 Jun 17 05:56:56 devstack sudo[107618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:56:56 devstack sudo[107618]: pam_unix(sudo:session): session closed for user root Jun 17 05:56:56 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-73b3f0c1-5577-4f8e-ba59-6aafc436aded tempest-TestShelveInstance-904320389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b29b7f45-bbe5-4332-b6dd-638ef7c9b763 1073741824" returned: 0 in 0.767s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:56:56 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-73b3f0c1-5577-4f8e-ba59-6aafc436aded tempest-TestShelveInstance-904320389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b29b7f45-bbe5-4332-b6dd-638ef7c9b763 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:56:56 devstack sudo[107623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b29b7f45-bbe5-4332-b6dd-638ef7c9b763 Jun 17 05:56:56 devstack sudo[107623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:56:57 devstack sudo[107623]: pam_unix(sudo:session): session closed for user root Jun 17 05:56:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-73b3f0c1-5577-4f8e-ba59-6aafc436aded tempest-TestShelveInstance-904320389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b29b7f45-bbe5-4332-b6dd-638ef7c9b763" returned: 0 in 0.591s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:56:57 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-73b3f0c1-5577-4f8e-ba59-6aafc436aded tempest-TestShelveInstance-904320389 None] <== create_volume: return (1400ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:56:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-73b3f0c1-5577-4f8e-ba59-6aafc436aded tempest-TestShelveInstance-904320389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.403s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:56:57 devstack cinder-volume[92083]: DEBUG cinder.volume.volume_utils [None req-73b3f0c1-5577-4f8e-ba59-6aafc436aded tempest-TestShelveInstance-904320389 None] Attempting download of 3a392502-bf92-4019-8ad1-5b48db42b20f ((None, [{'url': 'file:///opt/stack/data/glance/images/3a392502-bf92-4019-8ad1-5b48db42b20f', 'metadata': {}}])) to volume b29b7f45-bbe5-4332-b6dd-638ef7c9b763. {{(pid=92083) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 17 05:56:57 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dfe7fcc-8089-4539-884e-f981e5abbaf6]: (4, 'raw') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:56:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-73b3f0c1-5577-4f8e-ba59-6aafc436aded tempest-TestShelveInstance-904320389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3a392502-bf92-4019-8ad1-5b48db42b20f_mcmzt0o0 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:56:57 devstack sudo[107626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3a392502-bf92-4019-8ad1-5b48db42b20f_mcmzt0o0 Jun 17 05:56:57 devstack sudo[107626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:56:58 devstack sudo[107626]: pam_unix(sudo:session): session closed for user root Jun 17 05:56:58 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-73b3f0c1-5577-4f8e-ba59-6aafc436aded tempest-TestShelveInstance-904320389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3a392502-bf92-4019-8ad1-5b48db42b20f_mcmzt0o0" returned: 0 in 0.665s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:56:58 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-73b3f0c1-5577-4f8e-ba59-6aafc436aded tempest-TestShelveInstance-904320389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3a392502-bf92-4019-8ad1-5b48db42b20f_mcmzt0o0 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:56:58 devstack sudo[107630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3a392502-bf92-4019-8ad1-5b48db42b20f_mcmzt0o0 Jun 17 05:56:58 devstack sudo[107630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:56:58 devstack sudo[107630]: pam_unix(sudo:session): session closed for user root Jun 17 05:56:58 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-73b3f0c1-5577-4f8e-ba59-6aafc436aded tempest-TestShelveInstance-904320389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3a392502-bf92-4019-8ad1-5b48db42b20f_mcmzt0o0" returned: 1 in 0.648s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:56:58 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-73b3f0c1-5577-4f8e-ba59-6aafc436aded tempest-TestShelveInstance-904320389 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3a392502-bf92-4019-8ad1-5b48db42b20f_mcmzt0o0' failed. Not Retrying. {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 05:56:58 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c24903d-fdcf-4402-91aa-d652005a1f02]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:56:58 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-73b3f0c1-5577-4f8e-ba59-6aafc436aded tempest-TestShelveInstance-904320389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a392502-bf92-4019-8ad1-5b48db42b20f_vmufxwcsdevstack@QuobyteHD {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:56:58 devstack sudo[107635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a392502-bf92-4019-8ad1-5b48db42b20f_vmufxwcsdevstack@QuobyteHD Jun 17 05:56:58 devstack sudo[107635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:56:59 devstack sudo[107635]: pam_unix(sudo:session): session closed for user root Jun 17 05:56:59 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-73b3f0c1-5577-4f8e-ba59-6aafc436aded tempest-TestShelveInstance-904320389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a392502-bf92-4019-8ad1-5b48db42b20f_vmufxwcsdevstack@QuobyteHD" returned: 0 in 0.677s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:56:59 devstack cinder-volume[92083]: DEBUG cinder.image.image_utils [None req-73b3f0c1-5577-4f8e-ba59-6aafc436aded tempest-TestShelveInstance-904320389 None] 3a392502-bf92-4019-8ad1-5b48db42b20f was qcow2, converting to raw {{(pid=92083) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 17 05:56:59 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-73b3f0c1-5577-4f8e-ba59-6aafc436aded tempest-TestShelveInstance-904320389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3a392502-bf92-4019-8ad1-5b48db42b20f_vmufxwcsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b29b7f45-bbe5-4332-b6dd-638ef7c9b763 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:56:59 devstack sudo[107641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3a392502-bf92-4019-8ad1-5b48db42b20f_vmufxwcsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b29b7f45-bbe5-4332-b6dd-638ef7c9b763 Jun 17 05:56:59 devstack sudo[107641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:57:01 devstack sudo[107641]: pam_unix(sudo:session): session closed for user root Jun 17 05:57:01 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-73b3f0c1-5577-4f8e-ba59-6aafc436aded tempest-TestShelveInstance-904320389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3a392502-bf92-4019-8ad1-5b48db42b20f_vmufxwcsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b29b7f45-bbe5-4332-b6dd-638ef7c9b763" returned: 0 in 1.786s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:57:01 devstack cinder-volume[92083]: DEBUG cinder.image.image_utils [None req-73b3f0c1-5577-4f8e-ba59-6aafc436aded tempest-TestShelveInstance-904320389 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3a392502-bf92-4019-8ad1-5b48db42b20f_vmufxwcsdevstack@QuobyteHD, size 112.00 MB, duration 1.79 sec, destination /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b29b7f45-bbe5-4332-b6dd-638ef7c9b763 {{(pid=92083) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 17 05:57:01 devstack cinder-volume[92083]: INFO cinder.image.image_utils [None req-73b3f0c1-5577-4f8e-ba59-6aafc436aded tempest-TestShelveInstance-904320389 None] Converted 112.00 MB image at 62.67 MB/s Jun 17 05:57:01 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-73b3f0c1-5577-4f8e-ba59-6aafc436aded tempest-TestShelveInstance-904320389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b29b7f45-bbe5-4332-b6dd-638ef7c9b763 1G {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:57:01 devstack sudo[107651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b29b7f45-bbe5-4332-b6dd-638ef7c9b763 1G Jun 17 05:57:01 devstack sudo[107651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:57:01 devstack sudo[107651]: pam_unix(sudo:session): session closed for user root Jun 17 05:57:01 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-73b3f0c1-5577-4f8e-ba59-6aafc436aded tempest-TestShelveInstance-904320389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b29b7f45-bbe5-4332-b6dd-638ef7c9b763 1G" returned: 0 in 0.636s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:57:01 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7450299-5312-49dd-8f28-bed6a77852f2]: (4, 'raw') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:57:01 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-73b3f0c1-5577-4f8e-ba59-6aafc436aded tempest-TestShelveInstance-904320389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b29b7f45-bbe5-4332-b6dd-638ef7c9b763 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:57:02 devstack sudo[107656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b29b7f45-bbe5-4332-b6dd-638ef7c9b763 Jun 17 05:57:02 devstack sudo[107656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:57:02 devstack sudo[107656]: pam_unix(sudo:session): session closed for user root Jun 17 05:57:02 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-73b3f0c1-5577-4f8e-ba59-6aafc436aded tempest-TestShelveInstance-904320389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b29b7f45-bbe5-4332-b6dd-638ef7c9b763" returned: 0 in 0.667s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:57:02 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-73b3f0c1-5577-4f8e-ba59-6aafc436aded tempest-TestShelveInstance-904320389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b29b7f45-bbe5-4332-b6dd-638ef7c9b763 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:57:02 devstack sudo[107660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b29b7f45-bbe5-4332-b6dd-638ef7c9b763 Jun 17 05:57:02 devstack sudo[107660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:57:03 devstack sudo[107660]: pam_unix(sudo:session): session closed for user root Jun 17 05:57:03 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-73b3f0c1-5577-4f8e-ba59-6aafc436aded tempest-TestShelveInstance-904320389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b29b7f45-bbe5-4332-b6dd-638ef7c9b763" returned: 1 in 0.663s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:57:03 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-73b3f0c1-5577-4f8e-ba59-6aafc436aded tempest-TestShelveInstance-904320389 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b29b7f45-bbe5-4332-b6dd-638ef7c9b763' failed. Not Retrying. {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 05:57:03 devstack cinder-volume[92083]: DEBUG cinder.volume.volume_utils [None req-73b3f0c1-5577-4f8e-ba59-6aafc436aded tempest-TestShelveInstance-904320389 None] Downloaded image 3a392502-bf92-4019-8ad1-5b48db42b20f ((None, [{'url': 'file:///opt/stack/data/glance/images/3a392502-bf92-4019-8ad1-5b48db42b20f', 'metadata': {}}])) to volume b29b7f45-bbe5-4332-b6dd-638ef7c9b763 successfully. {{(pid=92083) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 17 05:57:03 devstack cinder-volume[92083]: DEBUG cinder.image.image_utils [None req-73b3f0c1-5577-4f8e-ba59-6aafc436aded tempest-TestShelveInstance-904320389 None] Temporary image 3a392502-bf92-4019-8ad1-5b48db42b20f for user a78b6f539d12497384f1d95656cd29c9 is deleted. {{(pid=92083) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 17 05:57:03 devstack cinder-volume[92083]: DEBUG cinder.volume.volume_utils [None req-73b3f0c1-5577-4f8e-ba59-6aafc436aded tempest-TestShelveInstance-904320389 None] Marking volume b29b7f45-bbe5-4332-b6dd-638ef7c9b763 as bootable. {{(pid=92083) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 17 05:57:03 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-73b3f0c1-5577-4f8e-ba59-6aafc436aded tempest-TestShelveInstance-904320389 None] Copying metadata from image 3a392502-bf92-4019-8ad1-5b48db42b20f to b29b7f45-bbe5-4332-b6dd-638ef7c9b763. {{(pid=92083) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 17 05:57:03 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-73b3f0c1-5577-4f8e-ba59-6aafc436aded tempest-TestShelveInstance-904320389 None] Creating volume glance metadata for volume b29b7f45-bbe5-4332-b6dd-638ef7c9b763 backed by image 3a392502-bf92-4019-8ad1-5b48db42b20f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3a392502-bf92-4019-8ad1-5b48db42b20f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=92083) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 17 05:57:03 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-73b3f0c1-5577-4f8e-ba59-6aafc436aded tempest-TestShelveInstance-904320389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3812614b-6da0-4365-a77b-589bea1a25d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b29b7f45-bbe5-4332-b6dd-638ef7c9b763', 'volume_size': 1, 'image_id': '3a392502-bf92-4019-8ad1-5b48db42b20f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3a392502-bf92-4019-8ad1-5b48db42b20f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd68ea14f86c14b8aac202e298736b075', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3a392502-bf92-4019-8ad1-5b48db42b20f', 'created_at': datetime.datetime(2026, 6, 17, 3, 31, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 3, 31, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3a392502-bf92-4019-8ad1-5b48db42b20f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:57:03 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-73b3f0c1-5577-4f8e-ba59-6aafc436aded tempest-TestShelveInstance-904320389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fb06f5c-2aa3-44b1-add2-1ea0c78a549c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:57:03 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-73b3f0c1-5577-4f8e-ba59-6aafc436aded tempest-TestShelveInstance-904320389 None] Volume volume-b29b7f45-bbe5-4332-b6dd-638ef7c9b763 (b29b7f45-bbe5-4332-b6dd-638ef7c9b763): created successfully Jun 17 05:57:03 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-73b3f0c1-5577-4f8e-ba59-6aafc436aded tempest-TestShelveInstance-904320389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fb06f5c-2aa3-44b1-add2-1ea0c78a549c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:57:03 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-73b3f0c1-5577-4f8e-ba59-6aafc436aded tempest-TestShelveInstance-904320389 None] Flow 'volume_create_manager' (8a962bac-102c-4c17-bae2-e9c9064527fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:57:03 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-73b3f0c1-5577-4f8e-ba59-6aafc436aded tempest-TestShelveInstance-904320389 None] Created volume successfully. Jun 17 05:57:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-47e3e02c-c25b-4428-8399-2a1a40230b3b req-adfee14f-27b4-4e88-80e4-0ac908ccf66d tempest-TestShelveInstance-904320389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:57:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-47e3e02c-c25b-4428-8399-2a1a40230b3b req-adfee14f-27b4-4e88-80e4-0ac908ccf66d tempest-TestShelveInstance-904320389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:57:11 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[b628cdde-beae-44ab-bd16-575350f72724]: (4, 'raw') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:57:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-47e3e02c-c25b-4428-8399-2a1a40230b3b req-adfee14f-27b4-4e88-80e4-0ac908ccf66d tempest-TestShelveInstance-904320389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b29b7f45-bbe5-4332-b6dd-638ef7c9b763 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:57:11 devstack sudo[107676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b29b7f45-bbe5-4332-b6dd-638ef7c9b763 Jun 17 05:57:11 devstack sudo[107676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:57:12 devstack sudo[107676]: pam_unix(sudo:session): session closed for user root Jun 17 05:57:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-47e3e02c-c25b-4428-8399-2a1a40230b3b req-adfee14f-27b4-4e88-80e4-0ac908ccf66d tempest-TestShelveInstance-904320389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b29b7f45-bbe5-4332-b6dd-638ef7c9b763" returned: 0 in 0.709s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:57:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-47e3e02c-c25b-4428-8399-2a1a40230b3b req-adfee14f-27b4-4e88-80e4-0ac908ccf66d tempest-TestShelveInstance-904320389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b29b7f45-bbe5-4332-b6dd-638ef7c9b763 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:57:12 devstack sudo[107681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b29b7f45-bbe5-4332-b6dd-638ef7c9b763 Jun 17 05:57:12 devstack sudo[107681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:57:12 devstack sudo[107681]: pam_unix(sudo:session): session closed for user root Jun 17 05:57:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-47e3e02c-c25b-4428-8399-2a1a40230b3b req-adfee14f-27b4-4e88-80e4-0ac908ccf66d tempest-TestShelveInstance-904320389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b29b7f45-bbe5-4332-b6dd-638ef7c9b763" returned: 1 in 0.673s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:57:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-47e3e02c-c25b-4428-8399-2a1a40230b3b req-adfee14f-27b4-4e88-80e4-0ac908ccf66d tempest-TestShelveInstance-904320389 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b29b7f45-bbe5-4332-b6dd-638ef7c9b763' failed. Not Retrying. {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 05:57:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-47e3e02c-c25b-4428-8399-2a1a40230b3b req-adfee14f-27b4-4e88-80e4-0ac908ccf66d tempest-TestShelveInstance-904320389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.420s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:57:12 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [req-47e3e02c-c25b-4428-8399-2a1a40230b3b req-adfee14f-27b4-4e88-80e4-0ac908ccf66d tempest-TestShelveInstance-904320389 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f', 'name': 'volume-b29b7f45-bbe5-4332-b6dd-638ef7c9b763', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8c772df3-8ddb-478d-bc26-ff09316dcbf2', 'enforce_multipath': True} {{(pid=92083) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 17 05:57:12 devstack cinder-volume[92083]: INFO cinder.volume.manager [req-47e3e02c-c25b-4428-8399-2a1a40230b3b req-adfee14f-27b4-4e88-80e4-0ac908ccf66d tempest-TestShelveInstance-904320389 None] attachment_update completed successfully. Jun 17 05:57:22 devstack cinder-volume[92083]: DEBUG dbcounter [-] [92083] Writing DB stats cinder:UPDATE=9,cinder:SELECT=15,cinder:INSERT=3 {{(pid=92083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:57:22 devstack cinder-volume[92083]: DEBUG dbcounter [-] [92083] Writing DB stats cinder:SELECT=16,cinder:INSERT=11,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=92083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:57:27 devstack cinder-volume[92083]: DEBUG oslo_service.periodic_task [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92083) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 05:57:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:57:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:57:27 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:57:27 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:57:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:57:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:57:27 devstack sudo[108139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:57:27 devstack sudo[108139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:57:28 devstack sudo[108139]: pam_unix(sudo:session): session closed for user root Jun 17 05:57:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.574s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:57:28 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:57:28 devstack cinder-volume[92083]: DEBUG oslo_service.periodic_task [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running periodic task VolumeManager._thread_info {{(pid=92083) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 05:57:28 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] thread count: 28 {{(pid=92083) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 17 05:57:28 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] thread info: [<_MainThread(MainThread, started 133483869905024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92083) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 17 05:57:49 devstack cinder-volume[92083]: INFO cinder.volume.manager [req-659c82eb-9dc4-4961-ab7a-223d676b2ace req-489b25d8-63c3-4566-bcd7-062e00d36a36 tempest-TestShelveInstance-904320389 None] Terminate volume connection completed successfully. Jun 17 05:57:49 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [req-659c82eb-9dc4-4961-ab7a-223d676b2ace req-489b25d8-63c3-4566-bcd7-062e00d36a36 tempest-TestShelveInstance-904320389 None] Deleting attachment 8c772df3-8ddb-478d-bc26-ff09316dcbf2. {{(pid=92083) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 17 05:57:53 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-477e4c2f-65f1-4e2b-b1ab-637b2df06eb5 req-4e290232-ea31-4d5f-a481-e7756c8d5144 tempest-TestShelveInstance-904320389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:57:53 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-477e4c2f-65f1-4e2b-b1ab-637b2df06eb5 req-4e290232-ea31-4d5f-a481-e7756c8d5144 tempest-TestShelveInstance-904320389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:57:53 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ee59cd-6f67-4e9e-8dee-0f9cd5f85be2]: (4, 'raw') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:57:53 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-477e4c2f-65f1-4e2b-b1ab-637b2df06eb5 req-4e290232-ea31-4d5f-a481-e7756c8d5144 tempest-TestShelveInstance-904320389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b29b7f45-bbe5-4332-b6dd-638ef7c9b763 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:57:53 devstack sudo[108351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b29b7f45-bbe5-4332-b6dd-638ef7c9b763 Jun 17 05:57:53 devstack sudo[108351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:57:54 devstack sudo[108351]: pam_unix(sudo:session): session closed for user root Jun 17 05:57:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-477e4c2f-65f1-4e2b-b1ab-637b2df06eb5 req-4e290232-ea31-4d5f-a481-e7756c8d5144 tempest-TestShelveInstance-904320389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b29b7f45-bbe5-4332-b6dd-638ef7c9b763" returned: 0 in 0.667s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:57:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-477e4c2f-65f1-4e2b-b1ab-637b2df06eb5 req-4e290232-ea31-4d5f-a481-e7756c8d5144 tempest-TestShelveInstance-904320389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b29b7f45-bbe5-4332-b6dd-638ef7c9b763 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:57:54 devstack sudo[108355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b29b7f45-bbe5-4332-b6dd-638ef7c9b763 Jun 17 05:57:54 devstack sudo[108355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:57:55 devstack sudo[108355]: pam_unix(sudo:session): session closed for user root Jun 17 05:57:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-477e4c2f-65f1-4e2b-b1ab-637b2df06eb5 req-4e290232-ea31-4d5f-a481-e7756c8d5144 tempest-TestShelveInstance-904320389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b29b7f45-bbe5-4332-b6dd-638ef7c9b763" returned: 1 in 0.701s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:57:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-477e4c2f-65f1-4e2b-b1ab-637b2df06eb5 req-4e290232-ea31-4d5f-a481-e7756c8d5144 tempest-TestShelveInstance-904320389 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b29b7f45-bbe5-4332-b6dd-638ef7c9b763' failed. Not Retrying. {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 05:57:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-477e4c2f-65f1-4e2b-b1ab-637b2df06eb5 req-4e290232-ea31-4d5f-a481-e7756c8d5144 tempest-TestShelveInstance-904320389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.413s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:57:55 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [req-477e4c2f-65f1-4e2b-b1ab-637b2df06eb5 req-4e290232-ea31-4d5f-a481-e7756c8d5144 tempest-TestShelveInstance-904320389 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f', 'name': 'volume-b29b7f45-bbe5-4332-b6dd-638ef7c9b763', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '68f30050-477e-481c-a500-61a46aea9dbb', 'enforce_multipath': True} {{(pid=92083) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 17 05:57:55 devstack cinder-volume[92083]: INFO cinder.volume.manager [req-477e4c2f-65f1-4e2b-b1ab-637b2df06eb5 req-4e290232-ea31-4d5f-a481-e7756c8d5144 tempest-TestShelveInstance-904320389 None] attachment_update completed successfully. Jun 17 05:58:05 devstack cinder-volume[92083]: DEBUG dbcounter [-] [92083] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=92083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:58:05 devstack cinder-volume[92083]: DEBUG dbcounter [-] [92083] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=92083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:58:27 devstack cinder-volume[92083]: DEBUG oslo_service.periodic_task [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92083) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 05:58:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:58:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:58:27 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:58:27 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:58:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:58:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:58:27 devstack sudo[108849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:58:27 devstack sudo[108849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:58:28 devstack sudo[108849]: pam_unix(sudo:session): session closed for user root Jun 17 05:58:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.588s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:58:28 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:58:28 devstack cinder-volume[92083]: DEBUG oslo_service.periodic_task [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running periodic task VolumeManager._thread_info {{(pid=92083) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 05:58:28 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] thread count: 28 {{(pid=92083) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 17 05:58:28 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] thread info: [<_MainThread(MainThread, started 133483869905024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92083) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 17 05:58:32 devstack cinder-volume[92083]: INFO cinder.volume.manager [req-67902684-c1fc-4b64-a91a-75fedf6a333b req-ada12d4d-90dc-490e-9447-75d87964e0ae tempest-TestShelveInstance-904320389 None] Terminate volume connection completed successfully. Jun 17 05:58:32 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [req-67902684-c1fc-4b64-a91a-75fedf6a333b req-ada12d4d-90dc-490e-9447-75d87964e0ae tempest-TestShelveInstance-904320389 None] Deleting attachment 68f30050-477e-481c-a500-61a46aea9dbb. {{(pid=92083) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 17 05:58:33 devstack cinder-volume[92083]: DEBUG cinder.coordination [req-67902684-c1fc-4b64-a91a-75fedf6a333b req-fc1f5831-c743-41f4-a6c8-a1c9865aa17b tempest-TestShelveInstance-904320389 None] Acquiring lock "cinder-b29b7f45-bbe5-4332-b6dd-638ef7c9b763-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:58:33 devstack cinder-volume[92083]: DEBUG cinder.coordination [req-67902684-c1fc-4b64-a91a-75fedf6a333b req-fc1f5831-c743-41f4-a6c8-a1c9865aa17b tempest-TestShelveInstance-904320389 None] Lock "cinder-b29b7f45-bbe5-4332-b6dd-638ef7c9b763-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:58:33 devstack cinder-volume[92083]: DEBUG cinder.coordination [req-67902684-c1fc-4b64-a91a-75fedf6a333b req-fc1f5831-c743-41f4-a6c8-a1c9865aa17b tempest-TestShelveInstance-904320389 None] Acquiring lock "cinder-quobyte-b29b7f45-bbe5-4332-b6dd-638ef7c9b763" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:58:33 devstack cinder-volume[92083]: DEBUG cinder.coordination [req-67902684-c1fc-4b64-a91a-75fedf6a333b req-fc1f5831-c743-41f4-a6c8-a1c9865aa17b tempest-TestShelveInstance-904320389 None] Lock "cinder-quobyte-b29b7f45-bbe5-4332-b6dd-638ef7c9b763" acquired by "delete_volume" :: waited 0.015s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:58:33 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[4374c6a6-c403-403d-a0ed-ab7eebb0df71]: (4, 'raw') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:58:33 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-67902684-c1fc-4b64-a91a-75fedf6a333b req-fc1f5831-c743-41f4-a6c8-a1c9865aa17b tempest-TestShelveInstance-904320389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b29b7f45-bbe5-4332-b6dd-638ef7c9b763 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:58:33 devstack sudo[108941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b29b7f45-bbe5-4332-b6dd-638ef7c9b763 Jun 17 05:58:33 devstack sudo[108941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:58:34 devstack sudo[108941]: pam_unix(sudo:session): session closed for user root Jun 17 05:58:34 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-67902684-c1fc-4b64-a91a-75fedf6a333b req-fc1f5831-c743-41f4-a6c8-a1c9865aa17b tempest-TestShelveInstance-904320389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b29b7f45-bbe5-4332-b6dd-638ef7c9b763" returned: 0 in 0.685s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:58:34 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-67902684-c1fc-4b64-a91a-75fedf6a333b req-fc1f5831-c743-41f4-a6c8-a1c9865aa17b tempest-TestShelveInstance-904320389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b29b7f45-bbe5-4332-b6dd-638ef7c9b763 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:58:34 devstack sudo[108945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b29b7f45-bbe5-4332-b6dd-638ef7c9b763 Jun 17 05:58:34 devstack sudo[108945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:58:34 devstack sudo[108945]: pam_unix(sudo:session): session closed for user root Jun 17 05:58:34 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-67902684-c1fc-4b64-a91a-75fedf6a333b req-fc1f5831-c743-41f4-a6c8-a1c9865aa17b tempest-TestShelveInstance-904320389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b29b7f45-bbe5-4332-b6dd-638ef7c9b763" returned: 1 in 0.672s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:58:34 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-67902684-c1fc-4b64-a91a-75fedf6a333b req-fc1f5831-c743-41f4-a6c8-a1c9865aa17b tempest-TestShelveInstance-904320389 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b29b7f45-bbe5-4332-b6dd-638ef7c9b763' failed. Not Retrying. {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 05:58:34 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-67902684-c1fc-4b64-a91a-75fedf6a333b req-fc1f5831-c743-41f4-a6c8-a1c9865aa17b tempest-TestShelveInstance-904320389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b29b7f45-bbe5-4332-b6dd-638ef7c9b763 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:58:34 devstack sudo[108950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b29b7f45-bbe5-4332-b6dd-638ef7c9b763 Jun 17 05:58:34 devstack sudo[108950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:58:35 devstack sudo[108950]: pam_unix(sudo:session): session closed for user root Jun 17 05:58:35 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-67902684-c1fc-4b64-a91a-75fedf6a333b req-fc1f5831-c743-41f4-a6c8-a1c9865aa17b tempest-TestShelveInstance-904320389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b29b7f45-bbe5-4332-b6dd-638ef7c9b763" returned: 0 in 0.580s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:58:35 devstack cinder-volume[92083]: DEBUG cinder.coordination [req-67902684-c1fc-4b64-a91a-75fedf6a333b req-fc1f5831-c743-41f4-a6c8-a1c9865aa17b tempest-TestShelveInstance-904320389 None] Lock "cinder-quobyte-b29b7f45-bbe5-4332-b6dd-638ef7c9b763" released by "delete_volume" :: held 1.998s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:58:35 devstack cinder-volume[92083]: DEBUG cinder.quota [req-67902684-c1fc-4b64-a91a-75fedf6a333b req-fc1f5831-c743-41f4-a6c8-a1c9865aa17b tempest-TestShelveInstance-904320389 None] Created reservations ['d1f77bc3-121b-4824-b7f1-31e3e68b9e5f', '275bc939-c071-47e7-9718-03484ab6a384', '305ae744-9a69-4152-80c8-e87f16a3b3c3', 'b129c774-2b5f-4cea-914c-bf20804d04bb'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:58:35 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-67902684-c1fc-4b64-a91a-75fedf6a333b req-fc1f5831-c743-41f4-a6c8-a1c9865aa17b tempest-TestShelveInstance-904320389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:58:35 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-67902684-c1fc-4b64-a91a-75fedf6a333b req-fc1f5831-c743-41f4-a6c8-a1c9865aa17b tempest-TestShelveInstance-904320389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:58:35 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [req-67902684-c1fc-4b64-a91a-75fedf6a333b req-fc1f5831-c743-41f4-a6c8-a1c9865aa17b tempest-TestShelveInstance-904320389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:58:35 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [req-67902684-c1fc-4b64-a91a-75fedf6a333b req-fc1f5831-c743-41f4-a6c8-a1c9865aa17b tempest-TestShelveInstance-904320389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:58:35 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-67902684-c1fc-4b64-a91a-75fedf6a333b req-fc1f5831-c743-41f4-a6c8-a1c9865aa17b tempest-TestShelveInstance-904320389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:58:35 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-67902684-c1fc-4b64-a91a-75fedf6a333b req-fc1f5831-c743-41f4-a6c8-a1c9865aa17b tempest-TestShelveInstance-904320389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:58:35 devstack sudo[108953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:58:35 devstack sudo[108953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:58:36 devstack sudo[108953]: pam_unix(sudo:session): session closed for user root Jun 17 05:58:36 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-67902684-c1fc-4b64-a91a-75fedf6a333b req-fc1f5831-c743-41f4-a6c8-a1c9865aa17b tempest-TestShelveInstance-904320389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.594s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:58:36 devstack cinder-volume[92083]: DEBUG cinder.manager [req-67902684-c1fc-4b64-a91a-75fedf6a333b req-fc1f5831-c743-41f4-a6c8-a1c9865aa17b tempest-TestShelveInstance-904320389 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:58:36 devstack cinder-volume[92083]: INFO cinder.volume.manager [req-67902684-c1fc-4b64-a91a-75fedf6a333b req-fc1f5831-c743-41f4-a6c8-a1c9865aa17b tempest-TestShelveInstance-904320389 None] Deleted volume successfully. Jun 17 05:58:36 devstack cinder-volume[92083]: DEBUG cinder.coordination [req-67902684-c1fc-4b64-a91a-75fedf6a333b req-fc1f5831-c743-41f4-a6c8-a1c9865aa17b tempest-TestShelveInstance-904320389 None] Lock "cinder-b29b7f45-bbe5-4332-b6dd-638ef7c9b763-delete_volume" released by "delete_volume" :: held 2.772s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:58:45 devstack cinder-volume[92083]: DEBUG dbcounter [-] [92083] Writing DB stats cinder:SELECT=7,cinder:INSERT=1,cinder:UPDATE=6 {{(pid=92083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:58:46 devstack cinder-volume[92083]: DEBUG dbcounter [-] [92083] Writing DB stats cinder:SELECT=5,cinder:UPDATE=10,cinder:INSERT=3,cinder:DELETE=1 {{(pid=92083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:58:57 devstack cinder-volume[92083]: DEBUG dbcounter [-] [92083] Writing DB stats cinder:SELECT=1 {{(pid=92083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:58:57 devstack cinder-volume[92083]: DEBUG dbcounter [-] [92083] Writing DB stats cinder:UPDATE=1 {{(pid=92083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:59:06 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e15110d-e398-4778-801e-432db4b591e0 tempest-TestStampPattern-495104060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:59:06 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8e15110d-e398-4778-801e-432db4b591e0 tempest-TestStampPattern-495104060 None] Flow 'volume_create_manager' (f3ebb0b0-0327-42ec-b602-d8667b581700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:59:06 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8e15110d-e398-4778-801e-432db4b591e0 tempest-TestStampPattern-495104060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (115ed669-0958-43c2-bc8d-434261f71d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:59:06 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8e15110d-e398-4778-801e-432db4b591e0 tempest-TestStampPattern-495104060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (115ed669-0958-43c2-bc8d-434261f71d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:59:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1215225731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ec21353-8765-48b4-9804-1aec1f6a3ea3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bd3e526a96445ac9e65691d0a644ee2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:59:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:59:06Z,use_quota=True,user_id='63da6e98016b47a483f6d9813ed85c05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:59:06 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8e15110d-e398-4778-801e-432db4b591e0 tempest-TestStampPattern-495104060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d947398-3f02-4210-84f8-5e3a8144d44b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:59:06 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8e15110d-e398-4778-801e-432db4b591e0 tempest-TestStampPattern-495104060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d947398-3f02-4210-84f8-5e3a8144d44b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:59:06 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8e15110d-e398-4778-801e-432db4b591e0 tempest-TestStampPattern-495104060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfbc2396-b085-4ada-a7da-77bdcea3cdec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:59:06 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8e15110d-e398-4778-801e-432db4b591e0 tempest-TestStampPattern-495104060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfbc2396-b085-4ada-a7da-77bdcea3cdec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ec21353-8765-48b4-9804-1aec1f6a3ea3', 'volume_name': 'volume-6ec21353-8765-48b4-9804-1aec1f6a3ea3', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:59:06 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8e15110d-e398-4778-801e-432db4b591e0 tempest-TestStampPattern-495104060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f45c88d9-1cac-4748-8c9c-6f4cd8f58429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:59:06 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8e15110d-e398-4778-801e-432db4b591e0 tempest-TestStampPattern-495104060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f45c88d9-1cac-4748-8c9c-6f4cd8f58429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:59:06 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8e15110d-e398-4778-801e-432db4b591e0 tempest-TestStampPattern-495104060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd758c9a-7dc6-4698-9e1b-8328146840f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:59:06 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-8e15110d-e398-4778-801e-432db4b591e0 tempest-TestStampPattern-495104060 None] Volume 6ec21353-8765-48b4-9804-1aec1f6a3ea3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ec21353-8765-48b4-9804-1aec1f6a3ea3', 'volume_size': 1} Jun 17 05:59:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-8e15110d-e398-4778-801e-432db4b591e0 tempest-TestStampPattern-495104060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:59:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-8e15110d-e398-4778-801e-432db4b591e0 tempest-TestStampPattern-495104060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:59:06 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-8e15110d-e398-4778-801e-432db4b591e0 tempest-TestStampPattern-495104060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:59:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1215225731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ec21353-8765-48b4-9804-1aec1f6a3ea3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bd3e526a96445ac9e65691d0a644ee2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:59:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:59:06Z,use_quota=True,user_id='63da6e98016b47a483f6d9813ed85c05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:59:06 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-8e15110d-e398-4778-801e-432db4b591e0 tempest-TestStampPattern-495104060 None] Creating volume 6ec21353-8765-48b4-9804-1aec1f6a3ea3 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:59:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-8e15110d-e398-4778-801e-432db4b591e0 tempest-TestStampPattern-495104060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:59:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-8e15110d-e398-4778-801e-432db4b591e0 tempest-TestStampPattern-495104060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:59:06 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-8e15110d-e398-4778-801e-432db4b591e0 tempest-TestStampPattern-495104060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:59:06 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-8e15110d-e398-4778-801e-432db4b591e0 tempest-TestStampPattern-495104060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:59:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-8e15110d-e398-4778-801e-432db4b591e0 tempest-TestStampPattern-495104060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:59:06 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-8e15110d-e398-4778-801e-432db4b591e0 tempest-TestStampPattern-495104060 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:59:06 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-8e15110d-e398-4778-801e-432db4b591e0 tempest-TestStampPattern-495104060 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 05:59:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8e15110d-e398-4778-801e-432db4b591e0 tempest-TestStampPattern-495104060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ec21353-8765-48b4-9804-1aec1f6a3ea3 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:59:06 devstack sudo[108968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ec21353-8765-48b4-9804-1aec1f6a3ea3 1073741824 Jun 17 05:59:06 devstack sudo[108968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:59:07 devstack sudo[108968]: pam_unix(sudo:session): session closed for user root Jun 17 05:59:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8e15110d-e398-4778-801e-432db4b591e0 tempest-TestStampPattern-495104060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ec21353-8765-48b4-9804-1aec1f6a3ea3 1073741824" returned: 0 in 0.859s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:59:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8e15110d-e398-4778-801e-432db4b591e0 tempest-TestStampPattern-495104060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ec21353-8765-48b4-9804-1aec1f6a3ea3 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:59:07 devstack sudo[108976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ec21353-8765-48b4-9804-1aec1f6a3ea3 Jun 17 05:59:07 devstack sudo[108976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:59:07 devstack sudo[108976]: pam_unix(sudo:session): session closed for user root Jun 17 05:59:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8e15110d-e398-4778-801e-432db4b591e0 tempest-TestStampPattern-495104060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ec21353-8765-48b4-9804-1aec1f6a3ea3" returned: 0 in 0.581s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:59:07 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-8e15110d-e398-4778-801e-432db4b591e0 tempest-TestStampPattern-495104060 None] <== create_volume: return (1494ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:59:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-8e15110d-e398-4778-801e-432db4b591e0 tempest-TestStampPattern-495104060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.496s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:59:07 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8e15110d-e398-4778-801e-432db4b591e0 tempest-TestStampPattern-495104060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd758c9a-7dc6-4698-9e1b-8328146840f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ec21353-8765-48b4-9804-1aec1f6a3ea3', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:59:07 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8e15110d-e398-4778-801e-432db4b591e0 tempest-TestStampPattern-495104060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5999615-2b0b-40d6-8948-7c4dafda9cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:59:07 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-8e15110d-e398-4778-801e-432db4b591e0 tempest-TestStampPattern-495104060 None] Volume volume-6ec21353-8765-48b4-9804-1aec1f6a3ea3 (6ec21353-8765-48b4-9804-1aec1f6a3ea3): created successfully Jun 17 05:59:07 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8e15110d-e398-4778-801e-432db4b591e0 tempest-TestStampPattern-495104060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5999615-2b0b-40d6-8948-7c4dafda9cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:59:07 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8e15110d-e398-4778-801e-432db4b591e0 tempest-TestStampPattern-495104060 None] Flow 'volume_create_manager' (f3ebb0b0-0327-42ec-b602-d8667b581700) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:59:07 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-8e15110d-e398-4778-801e-432db4b591e0 tempest-TestStampPattern-495104060 None] Created volume successfully. Jun 17 05:59:17 devstack cinder-volume[92083]: DEBUG dbcounter [-] [92083] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1 {{(pid=92083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:59:17 devstack cinder-volume[92083]: DEBUG dbcounter [-] [92083] Writing DB stats cinder:SELECT=3,cinder:INSERT=1,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=92083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:59:27 devstack cinder-volume[92083]: DEBUG oslo_service.periodic_task [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92083) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 05:59:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:59:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:59:27 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:59:27 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:59:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:59:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:59:27 devstack sudo[109072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 05:59:27 devstack sudo[109072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:59:28 devstack sudo[109072]: pam_unix(sudo:session): session closed for user root Jun 17 05:59:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.599s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:59:28 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:59:28 devstack cinder-volume[92083]: DEBUG oslo_service.periodic_task [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running periodic task VolumeManager._thread_info {{(pid=92083) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 05:59:28 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] thread count: 28 {{(pid=92083) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 17 05:59:28 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] thread info: [<_MainThread(MainThread, started 133483869905024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92083) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 17 05:59:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-ac569d36-861a-4da6-b7df-29fbe796dfb9 req-51dd9306-14aa-40bb-a196-211dd1b43fd9 tempest-TestStampPattern-495104060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:59:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-ac569d36-861a-4da6-b7df-29fbe796dfb9 req-51dd9306-14aa-40bb-a196-211dd1b43fd9 tempest-TestStampPattern-495104060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:59:46 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb632f52-f0a9-4165-b029-bf292c4b73dc]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:59:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-ac569d36-861a-4da6-b7df-29fbe796dfb9 req-51dd9306-14aa-40bb-a196-211dd1b43fd9 tempest-TestStampPattern-495104060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ec21353-8765-48b4-9804-1aec1f6a3ea3 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:59:46 devstack sudo[109142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ec21353-8765-48b4-9804-1aec1f6a3ea3 Jun 17 05:59:46 devstack sudo[109142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:59:46 devstack sudo[109142]: pam_unix(sudo:session): session closed for user root Jun 17 05:59:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-ac569d36-861a-4da6-b7df-29fbe796dfb9 req-51dd9306-14aa-40bb-a196-211dd1b43fd9 tempest-TestStampPattern-495104060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ec21353-8765-48b4-9804-1aec1f6a3ea3" returned: 0 in 0.701s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:59:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-ac569d36-861a-4da6-b7df-29fbe796dfb9 req-51dd9306-14aa-40bb-a196-211dd1b43fd9 tempest-TestStampPattern-495104060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.719s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:59:46 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [req-ac569d36-861a-4da6-b7df-29fbe796dfb9 req-51dd9306-14aa-40bb-a196-211dd1b43fd9 tempest-TestStampPattern-495104060 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f', 'name': 'volume-6ec21353-8765-48b4-9804-1aec1f6a3ea3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b2effc47-ce67-4dad-b578-06d4cc664d2f', 'enforce_multipath': True} {{(pid=92083) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 17 05:59:46 devstack cinder-volume[92083]: INFO cinder.volume.manager [req-ac569d36-861a-4da6-b7df-29fbe796dfb9 req-51dd9306-14aa-40bb-a196-211dd1b43fd9 tempest-TestStampPattern-495104060 None] attachment_update completed successfully. Jun 17 05:59:55 devstack cinder-volume[92083]: INFO cinder.volume.manager [req-74544704-85cf-4d91-9ae2-b99d247e71bc req-5bcc9766-fd80-4278-bdde-03658bc36b3d tempest-TestStampPattern-495104060 None] Terminate volume connection completed successfully. Jun 17 05:59:55 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [req-74544704-85cf-4d91-9ae2-b99d247e71bc req-5bcc9766-fd80-4278-bdde-03658bc36b3d tempest-TestStampPattern-495104060 None] Deleting attachment b2effc47-ce67-4dad-b578-06d4cc664d2f. {{(pid=92083) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 17 05:59:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-a83ab911-06c0-4c2d-865e-5640a0a2a5d6 tempest-TestStampPattern-495104060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:59:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-a83ab911-06c0-4c2d-865e-5640a0a2a5d6 tempest-TestStampPattern-495104060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:59:57 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-a83ab911-06c0-4c2d-865e-5640a0a2a5d6 tempest-TestStampPattern-495104060 None] Creating offline snapshot ce2d3aed-2d41-4643-b3fc-b260f4101914 of volume 6ec21353-8765-48b4-9804-1aec1f6a3ea3 {{(pid=92083) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 17 05:59:57 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b688db7-a1ae-4edb-bdfb-1883bdb7b48d]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:59:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a83ab911-06c0-4c2d-865e-5640a0a2a5d6 tempest-TestStampPattern-495104060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ec21353-8765-48b4-9804-1aec1f6a3ea3 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:59:57 devstack sudo[109579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ec21353-8765-48b4-9804-1aec1f6a3ea3 Jun 17 05:59:57 devstack sudo[109579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:59:57 devstack sudo[109579]: pam_unix(sudo:session): session closed for user root Jun 17 05:59:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a83ab911-06c0-4c2d-865e-5640a0a2a5d6 tempest-TestStampPattern-495104060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ec21353-8765-48b4-9804-1aec1f6a3ea3" returned: 0 in 0.709s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:59:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a83ab911-06c0-4c2d-865e-5640a0a2a5d6 tempest-TestStampPattern-495104060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ec21353-8765-48b4-9804-1aec1f6a3ea3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ec21353-8765-48b4-9804-1aec1f6a3ea3.ce2d3aed-2d41-4643-b3fc-b260f4101914 1G {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:59:57 devstack sudo[109586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ec21353-8765-48b4-9804-1aec1f6a3ea3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ec21353-8765-48b4-9804-1aec1f6a3ea3.ce2d3aed-2d41-4643-b3fc-b260f4101914 1G Jun 17 05:59:57 devstack sudo[109586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:59:58 devstack sudo[109586]: pam_unix(sudo:session): session closed for user root Jun 17 05:59:58 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a83ab911-06c0-4c2d-865e-5640a0a2a5d6 tempest-TestStampPattern-495104060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ec21353-8765-48b4-9804-1aec1f6a3ea3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ec21353-8765-48b4-9804-1aec1f6a3ea3.ce2d3aed-2d41-4643-b3fc-b260f4101914 1G" returned: 0 in 0.721s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:59:58 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a83ab911-06c0-4c2d-865e-5640a0a2a5d6 tempest-TestStampPattern-495104060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ec21353-8765-48b4-9804-1aec1f6a3ea3 -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ec21353-8765-48b4-9804-1aec1f6a3ea3.ce2d3aed-2d41-4643-b3fc-b260f4101914 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:59:58 devstack sudo[109591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ec21353-8765-48b4-9804-1aec1f6a3ea3 -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ec21353-8765-48b4-9804-1aec1f6a3ea3.ce2d3aed-2d41-4643-b3fc-b260f4101914 Jun 17 05:59:58 devstack sudo[109591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:59:59 devstack sudo[109591]: pam_unix(sudo:session): session closed for user root Jun 17 05:59:59 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a83ab911-06c0-4c2d-865e-5640a0a2a5d6 tempest-TestStampPattern-495104060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ec21353-8765-48b4-9804-1aec1f6a3ea3 -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ec21353-8765-48b4-9804-1aec1f6a3ea3.ce2d3aed-2d41-4643-b3fc-b260f4101914" returned: 0 in 0.633s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:59:59 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [None req-a83ab911-06c0-4c2d-865e-5640a0a2a5d6 tempest-TestStampPattern-495104060 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ec21353-8765-48b4-9804-1aec1f6a3ea3.ce2d3aed-2d41-4643-b3fc-b260f4101914 is being set with open permissions: ugo+rw Jun 17 05:59:59 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a83ab911-06c0-4c2d-865e-5640a0a2a5d6 tempest-TestStampPattern-495104060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ec21353-8765-48b4-9804-1aec1f6a3ea3.ce2d3aed-2d41-4643-b3fc-b260f4101914 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:59:59 devstack sudo[109602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ec21353-8765-48b4-9804-1aec1f6a3ea3.ce2d3aed-2d41-4643-b3fc-b260f4101914 Jun 17 05:59:59 devstack sudo[109602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:59:59 devstack sudo[109602]: pam_unix(sudo:session): session closed for user root Jun 17 05:59:59 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a83ab911-06c0-4c2d-865e-5640a0a2a5d6 tempest-TestStampPattern-495104060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ec21353-8765-48b4-9804-1aec1f6a3ea3.ce2d3aed-2d41-4643-b3fc-b260f4101914" returned: 0 in 0.578s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:59:59 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a83ab911-06c0-4c2d-865e-5640a0a2a5d6 tempest-TestStampPattern-495104060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ec21353-8765-48b4-9804-1aec1f6a3ea3.info {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:59:59 devstack sudo[109607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ec21353-8765-48b4-9804-1aec1f6a3ea3.info Jun 17 05:59:59 devstack sudo[109607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:00:00 devstack sudo[109607]: pam_unix(sudo:session): session closed for user root Jun 17 06:00:00 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a83ab911-06c0-4c2d-865e-5640a0a2a5d6 tempest-TestStampPattern-495104060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ec21353-8765-48b4-9804-1aec1f6a3ea3.info" returned: 0 in 0.588s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:00:00 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [None req-a83ab911-06c0-4c2d-865e-5640a0a2a5d6 tempest-TestStampPattern-495104060 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ec21353-8765-48b4-9804-1aec1f6a3ea3.info is being set with open permissions: ugo+rw Jun 17 06:00:00 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a83ab911-06c0-4c2d-865e-5640a0a2a5d6 tempest-TestStampPattern-495104060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ec21353-8765-48b4-9804-1aec1f6a3ea3.info {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:00:00 devstack sudo[109610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ec21353-8765-48b4-9804-1aec1f6a3ea3.info Jun 17 06:00:00 devstack sudo[109610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:00:00 devstack sudo[109610]: pam_unix(sudo:session): session closed for user root Jun 17 06:00:00 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a83ab911-06c0-4c2d-865e-5640a0a2a5d6 tempest-TestStampPattern-495104060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ec21353-8765-48b4-9804-1aec1f6a3ea3.info" returned: 0 in 0.582s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:00:00 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-a83ab911-06c0-4c2d-865e-5640a0a2a5d6 tempest-TestStampPattern-495104060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.889s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:00:01 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-a83ab911-06c0-4c2d-865e-5640a0a2a5d6 tempest-TestStampPattern-495104060 None] Create snapshot completed successfully Jun 17 06:00:10 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-854484d9-0372-4df0-bddc-c44bf0fe1bc5 tempest-TestStampPattern-495104060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 06:00:10 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-854484d9-0372-4df0-bddc-c44bf0fe1bc5 tempest-TestStampPattern-495104060 None] Flow 'volume_create_manager' (18e3c136-2b99-4947-b5c9-21aadd3d951e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 06:00:10 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-854484d9-0372-4df0-bddc-c44bf0fe1bc5 tempest-TestStampPattern-495104060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (942850ca-ea1a-4ff2-9bec-935c49ae3e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:00:10 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-854484d9-0372-4df0-bddc-c44bf0fe1bc5 tempest-TestStampPattern-495104060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (942850ca-ea1a-4ff2-9bec-935c49ae3e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T04:00:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1719290003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=120c54ff-c149-49ee-b3a2-3eeb68cd23b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bd3e526a96445ac9e65691d0a644ee2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T04:00:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ce2d3aed-2d41-4643-b3fc-b260f4101914,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T04:00:11Z,use_quota=True,user_id='63da6e98016b47a483f6d9813ed85c05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:00:10 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-854484d9-0372-4df0-bddc-c44bf0fe1bc5 tempest-TestStampPattern-495104060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75087ca7-ef80-4149-be71-1d127f795345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:00:10 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-854484d9-0372-4df0-bddc-c44bf0fe1bc5 tempest-TestStampPattern-495104060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75087ca7-ef80-4149-be71-1d127f795345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:00:10 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-854484d9-0372-4df0-bddc-c44bf0fe1bc5 tempest-TestStampPattern-495104060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e18db31-63e6-4175-94e9-21c1e74c5d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:00:10 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-854484d9-0372-4df0-bddc-c44bf0fe1bc5 tempest-TestStampPattern-495104060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e18db31-63e6-4175-94e9-21c1e74c5d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '120c54ff-c149-49ee-b3a2-3eeb68cd23b6', 'volume_name': 'volume-120c54ff-c149-49ee-b3a2-3eeb68cd23b6', 'volume_size': 1, 'snapshot_id': 'ce2d3aed-2d41-4643-b3fc-b260f4101914'}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:00:10 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-854484d9-0372-4df0-bddc-c44bf0fe1bc5 tempest-TestStampPattern-495104060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fad8d42b-117d-4f10-8f7c-8b284bd3ac8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:00:10 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-854484d9-0372-4df0-bddc-c44bf0fe1bc5 tempest-TestStampPattern-495104060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fad8d42b-117d-4f10-8f7c-8b284bd3ac8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:00:10 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-854484d9-0372-4df0-bddc-c44bf0fe1bc5 tempest-TestStampPattern-495104060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2662a26a-8531-4e22-9304-a5e595fad91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:00:10 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-854484d9-0372-4df0-bddc-c44bf0fe1bc5 tempest-TestStampPattern-495104060 None] Volume 120c54ff-c149-49ee-b3a2-3eeb68cd23b6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-120c54ff-c149-49ee-b3a2-3eeb68cd23b6', 'volume_size': 1, 'snapshot_id': 'ce2d3aed-2d41-4643-b3fc-b260f4101914'} Jun 17 06:00:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-854484d9-0372-4df0-bddc-c44bf0fe1bc5 tempest-TestStampPattern-495104060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:00:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-854484d9-0372-4df0-bddc-c44bf0fe1bc5 tempest-TestStampPattern-495104060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:00:10 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-854484d9-0372-4df0-bddc-c44bf0fe1bc5 tempest-TestStampPattern-495104060 None] Acquiring lock "cinder-quobyte-ce2d3aed-2d41-4643-b3fc-b260f4101914-120c54ff-c149-49ee-b3a2-3eeb68cd23b6" by "_create_volume_from_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:00:10 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-854484d9-0372-4df0-bddc-c44bf0fe1bc5 tempest-TestStampPattern-495104060 None] Lock "cinder-quobyte-ce2d3aed-2d41-4643-b3fc-b260f4101914-120c54ff-c149-49ee-b3a2-3eeb68cd23b6" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:00:10 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-854484d9-0372-4df0-bddc-c44bf0fe1bc5 tempest-TestStampPattern-495104060 None] Creating volume 120c54ff-c149-49ee-b3a2-3eeb68cd23b6 from snapshot ce2d3aed-2d41-4643-b3fc-b260f4101914 {{(pid=92083) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 17 06:00:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-854484d9-0372-4df0-bddc-c44bf0fe1bc5 tempest-TestStampPattern-495104060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:00:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-854484d9-0372-4df0-bddc-c44bf0fe1bc5 tempest-TestStampPattern-495104060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:00:10 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-854484d9-0372-4df0-bddc-c44bf0fe1bc5 tempest-TestStampPattern-495104060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 06:00:10 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-854484d9-0372-4df0-bddc-c44bf0fe1bc5 tempest-TestStampPattern-495104060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 06:00:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-854484d9-0372-4df0-bddc-c44bf0fe1bc5 tempest-TestStampPattern-495104060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:00:10 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-854484d9-0372-4df0-bddc-c44bf0fe1bc5 tempest-TestStampPattern-495104060 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 06:00:10 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-854484d9-0372-4df0-bddc-c44bf0fe1bc5 tempest-TestStampPattern-495104060 None] Acquiring lock "cinder-quobyte-120c54ff-c149-49ee-b3a2-3eeb68cd23b6" by "_copy_volume_from_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:00:10 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-854484d9-0372-4df0-bddc-c44bf0fe1bc5 tempest-TestStampPattern-495104060 None] Lock "cinder-quobyte-120c54ff-c149-49ee-b3a2-3eeb68cd23b6" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:00:10 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-854484d9-0372-4df0-bddc-c44bf0fe1bc5 tempest-TestStampPattern-495104060 None] snapshot: ce2d3aed-2d41-4643-b3fc-b260f4101914, volume: 120c54ff-c149-49ee-b3a2-3eeb68cd23b6, {{(pid=92083) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 17 06:00:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-854484d9-0372-4df0-bddc-c44bf0fe1bc5 tempest-TestStampPattern-495104060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:00:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-854484d9-0372-4df0-bddc-c44bf0fe1bc5 tempest-TestStampPattern-495104060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:00:10 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-854484d9-0372-4df0-bddc-c44bf0fe1bc5 tempest-TestStampPattern-495104060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 06:00:10 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-854484d9-0372-4df0-bddc-c44bf0fe1bc5 tempest-TestStampPattern-495104060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 06:00:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-854484d9-0372-4df0-bddc-c44bf0fe1bc5 tempest-TestStampPattern-495104060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:00:10 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[60669c33-b17e-4136-aea1-0e9e5f922ebe]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 06:00:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-854484d9-0372-4df0-bddc-c44bf0fe1bc5 tempest-TestStampPattern-495104060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ec21353-8765-48b4-9804-1aec1f6a3ea3.ce2d3aed-2d41-4643-b3fc-b260f4101914 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:00:11 devstack sudo[109649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ec21353-8765-48b4-9804-1aec1f6a3ea3.ce2d3aed-2d41-4643-b3fc-b260f4101914 Jun 17 06:00:11 devstack sudo[109649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:00:11 devstack sudo[109649]: pam_unix(sudo:session): session closed for user root Jun 17 06:00:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-854484d9-0372-4df0-bddc-c44bf0fe1bc5 tempest-TestStampPattern-495104060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ec21353-8765-48b4-9804-1aec1f6a3ea3.ce2d3aed-2d41-4643-b3fc-b260f4101914" returned: 0 in 0.726s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:00:11 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-854484d9-0372-4df0-bddc-c44bf0fe1bc5 tempest-TestStampPattern-495104060 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ec21353-8765-48b4-9804-1aec1f6a3ea3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92083) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 06:00:11 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-854484d9-0372-4df0-bddc-c44bf0fe1bc5 tempest-TestStampPattern-495104060 None] will copy from snapshot at /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ec21353-8765-48b4-9804-1aec1f6a3ea3 {{(pid=92083) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 17 06:00:11 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-854484d9-0372-4df0-bddc-c44bf0fe1bc5 tempest-TestStampPattern-495104060 None] Creating direct copy from snapshot {{(pid=92083) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 17 06:00:11 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd8d875-b721-4658-aba2-7b6a68883eed]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 06:00:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-854484d9-0372-4df0-bddc-c44bf0fe1bc5 tempest-TestStampPattern-495104060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ec21353-8765-48b4-9804-1aec1f6a3ea3 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:00:11 devstack sudo[109656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ec21353-8765-48b4-9804-1aec1f6a3ea3 Jun 17 06:00:11 devstack sudo[109656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:00:12 devstack sudo[109656]: pam_unix(sudo:session): session closed for user root Jun 17 06:00:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-854484d9-0372-4df0-bddc-c44bf0fe1bc5 tempest-TestStampPattern-495104060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ec21353-8765-48b4-9804-1aec1f6a3ea3" returned: 0 in 0.714s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:00:12 devstack cinder-volume[92083]: DEBUG cinder.utils [None req-854484d9-0372-4df0-bddc-c44bf0fe1bc5 tempest-TestStampPattern-495104060 None] Path /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-120c54ff-c149-49ee-b3a2-3eeb68cd23b6 not found in is_blk_device check {{(pid=92083) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 17 06:00:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-854484d9-0372-4df0-bddc-c44bf0fe1bc5 tempest-TestStampPattern-495104060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ec21353-8765-48b4-9804-1aec1f6a3ea3 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-120c54ff-c149-49ee-b3a2-3eeb68cd23b6 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:00:12 devstack sudo[109661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ec21353-8765-48b4-9804-1aec1f6a3ea3 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-120c54ff-c149-49ee-b3a2-3eeb68cd23b6 Jun 17 06:00:12 devstack sudo[109661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:00:17 devstack sudo[109661]: pam_unix(sudo:session): session closed for user root Jun 17 06:00:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-854484d9-0372-4df0-bddc-c44bf0fe1bc5 tempest-TestStampPattern-495104060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ec21353-8765-48b4-9804-1aec1f6a3ea3 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-120c54ff-c149-49ee-b3a2-3eeb68cd23b6" returned: 0 in 4.856s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:00:17 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4303a08-7771-41ae-baf8-8a98a471300b]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 06:00:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-854484d9-0372-4df0-bddc-c44bf0fe1bc5 tempest-TestStampPattern-495104060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ec21353-8765-48b4-9804-1aec1f6a3ea3 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:00:17 devstack sudo[109680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ec21353-8765-48b4-9804-1aec1f6a3ea3 Jun 17 06:00:17 devstack sudo[109680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:00:18 devstack sudo[109680]: pam_unix(sudo:session): session closed for user root Jun 17 06:00:18 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-854484d9-0372-4df0-bddc-c44bf0fe1bc5 tempest-TestStampPattern-495104060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ec21353-8765-48b4-9804-1aec1f6a3ea3" returned: 0 in 0.957s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:00:18 devstack cinder-volume[92083]: DEBUG cinder.image.image_utils [None req-854484d9-0372-4df0-bddc-c44bf0fe1bc5 tempest-TestStampPattern-495104060 None] Image conversion details: src /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ec21353-8765-48b4-9804-1aec1f6a3ea3, size 1024.00 MB, duration 4.86 sec, destination /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-120c54ff-c149-49ee-b3a2-3eeb68cd23b6 {{(pid=92083) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 17 06:00:18 devstack cinder-volume[92083]: INFO cinder.image.image_utils [None req-854484d9-0372-4df0-bddc-c44bf0fe1bc5 tempest-TestStampPattern-495104060 None] Converted 1024.00 MB image at 210.81 MB/s Jun 17 06:00:18 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [None req-854484d9-0372-4df0-bddc-c44bf0fe1bc5 tempest-TestStampPattern-495104060 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-120c54ff-c149-49ee-b3a2-3eeb68cd23b6 is being set with open permissions: ugo+rw Jun 17 06:00:18 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-854484d9-0372-4df0-bddc-c44bf0fe1bc5 tempest-TestStampPattern-495104060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-120c54ff-c149-49ee-b3a2-3eeb68cd23b6 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:00:18 devstack sudo[109686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-120c54ff-c149-49ee-b3a2-3eeb68cd23b6 Jun 17 06:00:18 devstack sudo[109686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:00:19 devstack sudo[109686]: pam_unix(sudo:session): session closed for user root Jun 17 06:00:19 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-854484d9-0372-4df0-bddc-c44bf0fe1bc5 tempest-TestStampPattern-495104060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-120c54ff-c149-49ee-b3a2-3eeb68cd23b6" returned: 0 in 0.834s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:00:19 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-854484d9-0372-4df0-bddc-c44bf0fe1bc5 tempest-TestStampPattern-495104060 None] Lock "cinder-quobyte-120c54ff-c149-49ee-b3a2-3eeb68cd23b6" released by "_copy_volume_from_snapshot" :: held 8.183s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:00:19 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-854484d9-0372-4df0-bddc-c44bf0fe1bc5 tempest-TestStampPattern-495104060 None] Lock "cinder-quobyte-ce2d3aed-2d41-4643-b3fc-b260f4101914-120c54ff-c149-49ee-b3a2-3eeb68cd23b6" released by "_create_volume_from_snapshot" :: held 8.213s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:00:19 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-854484d9-0372-4df0-bddc-c44bf0fe1bc5 tempest-TestStampPattern-495104060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.229s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:00:19 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-854484d9-0372-4df0-bddc-c44bf0fe1bc5 tempest-TestStampPattern-495104060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2662a26a-8531-4e22-9304-a5e595fad91e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-120c54ff-c149-49ee-b3a2-3eeb68cd23b6', 'volume_size': 1, 'snapshot_id': 'ce2d3aed-2d41-4643-b3fc-b260f4101914'}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:00:19 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-854484d9-0372-4df0-bddc-c44bf0fe1bc5 tempest-TestStampPattern-495104060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a963299f-784b-4cff-ac4f-8666b4517d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:00:19 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-854484d9-0372-4df0-bddc-c44bf0fe1bc5 tempest-TestStampPattern-495104060 None] Volume volume-120c54ff-c149-49ee-b3a2-3eeb68cd23b6 (120c54ff-c149-49ee-b3a2-3eeb68cd23b6): created successfully Jun 17 06:00:19 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-854484d9-0372-4df0-bddc-c44bf0fe1bc5 tempest-TestStampPattern-495104060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a963299f-784b-4cff-ac4f-8666b4517d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:00:19 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-854484d9-0372-4df0-bddc-c44bf0fe1bc5 tempest-TestStampPattern-495104060 None] Flow 'volume_create_manager' (18e3c136-2b99-4947-b5c9-21aadd3d951e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 06:00:19 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-854484d9-0372-4df0-bddc-c44bf0fe1bc5 tempest-TestStampPattern-495104060 None] Created volume successfully. Jun 17 06:00:27 devstack cinder-volume[92083]: DEBUG oslo_service.periodic_task [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92083) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 06:00:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:00:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:00:27 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 06:00:27 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 06:00:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:00:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:00:27 devstack sudo[109758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 06:00:27 devstack sudo[109758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:00:28 devstack sudo[109758]: pam_unix(sudo:session): session closed for user root Jun 17 06:00:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.632s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:00:28 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 06:00:28 devstack cinder-volume[92083]: DEBUG oslo_service.periodic_task [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running periodic task VolumeManager._thread_info {{(pid=92083) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 06:00:28 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] thread count: 28 {{(pid=92083) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 17 06:00:28 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] thread info: [<_MainThread(MainThread, started 133483869905024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92083) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 17 06:00:29 devstack cinder-volume[92083]: DEBUG dbcounter [-] [92083] Writing DB stats cinder:SELECT=11,cinder:UPDATE=5,cinder:INSERT=1,cinder:DELETE=1 {{(pid=92083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 06:00:29 devstack cinder-volume[92083]: DEBUG dbcounter [-] [92083] Writing DB stats cinder:SELECT=14,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=92083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 06:00:57 devstack cinder-volume[92083]: DEBUG dbcounter [-] [92083] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=92083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 06:01:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-1cea8497-b17e-4647-a35e-1ce4e4a50348 req-30ff5cef-0066-4f03-b8b4-9009e5c09e32 tempest-TestStampPattern-495104060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:01:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-1cea8497-b17e-4647-a35e-1ce4e4a50348 req-30ff5cef-0066-4f03-b8b4-9009e5c09e32 tempest-TestStampPattern-495104060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:01:08 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff03ed1-07ee-4dd2-b69d-68ae0ec224f6]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 06:01:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-1cea8497-b17e-4647-a35e-1ce4e4a50348 req-30ff5cef-0066-4f03-b8b4-9009e5c09e32 tempest-TestStampPattern-495104060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-120c54ff-c149-49ee-b3a2-3eeb68cd23b6 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:01:08 devstack sudo[109841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-120c54ff-c149-49ee-b3a2-3eeb68cd23b6 Jun 17 06:01:08 devstack sudo[109841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:01:08 devstack sudo[109841]: pam_unix(sudo:session): session closed for user root Jun 17 06:01:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [req-1cea8497-b17e-4647-a35e-1ce4e4a50348 req-30ff5cef-0066-4f03-b8b4-9009e5c09e32 tempest-TestStampPattern-495104060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-120c54ff-c149-49ee-b3a2-3eeb68cd23b6" returned: 0 in 0.714s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:01:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [req-1cea8497-b17e-4647-a35e-1ce4e4a50348 req-30ff5cef-0066-4f03-b8b4-9009e5c09e32 tempest-TestStampPattern-495104060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.734s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:01:08 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [req-1cea8497-b17e-4647-a35e-1ce4e4a50348 req-30ff5cef-0066-4f03-b8b4-9009e5c09e32 tempest-TestStampPattern-495104060 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f', 'name': 'volume-120c54ff-c149-49ee-b3a2-3eeb68cd23b6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cd7e3114-374d-47cc-ae0d-ad6d5a8c25f6', 'enforce_multipath': True} {{(pid=92083) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 17 06:01:08 devstack cinder-volume[92083]: INFO cinder.volume.manager [req-1cea8497-b17e-4647-a35e-1ce4e4a50348 req-30ff5cef-0066-4f03-b8b4-9009e5c09e32 tempest-TestStampPattern-495104060 None] attachment_update completed successfully. Jun 17 06:01:15 devstack cinder-volume[92083]: INFO cinder.volume.manager [req-0f6d5dbe-6d5b-4cc7-a907-6e74a0a1dcab req-194d6c61-04eb-4d51-a6f6-671e88c11745 tempest-TestStampPattern-495104060 None] Terminate volume connection completed successfully. Jun 17 06:01:15 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [req-0f6d5dbe-6d5b-4cc7-a907-6e74a0a1dcab req-194d6c61-04eb-4d51-a6f6-671e88c11745 tempest-TestStampPattern-495104060 None] Deleting attachment cd7e3114-374d-47cc-ae0d-ad6d5a8c25f6. {{(pid=92083) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 17 06:01:24 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-6ae6ade3-5e6c-4fcf-b1bd-af2be326b7bc tempest-TestStampPattern-495104060 None] Acquiring lock "cinder-120c54ff-c149-49ee-b3a2-3eeb68cd23b6-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:01:24 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-6ae6ade3-5e6c-4fcf-b1bd-af2be326b7bc tempest-TestStampPattern-495104060 None] Lock "cinder-120c54ff-c149-49ee-b3a2-3eeb68cd23b6-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:01:24 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-6ae6ade3-5e6c-4fcf-b1bd-af2be326b7bc tempest-TestStampPattern-495104060 None] Acquiring lock "cinder-quobyte-120c54ff-c149-49ee-b3a2-3eeb68cd23b6" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:01:24 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-6ae6ade3-5e6c-4fcf-b1bd-af2be326b7bc tempest-TestStampPattern-495104060 None] Lock "cinder-quobyte-120c54ff-c149-49ee-b3a2-3eeb68cd23b6" acquired by "delete_volume" :: waited 0.013s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:01:24 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da2bc3f-ce44-4efe-94ce-657c9384ff93]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 06:01:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6ae6ade3-5e6c-4fcf-b1bd-af2be326b7bc tempest-TestStampPattern-495104060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-120c54ff-c149-49ee-b3a2-3eeb68cd23b6 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:01:24 devstack sudo[110320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-120c54ff-c149-49ee-b3a2-3eeb68cd23b6 Jun 17 06:01:24 devstack sudo[110320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:01:24 devstack sudo[110320]: pam_unix(sudo:session): session closed for user root Jun 17 06:01:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6ae6ade3-5e6c-4fcf-b1bd-af2be326b7bc tempest-TestStampPattern-495104060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-120c54ff-c149-49ee-b3a2-3eeb68cd23b6" returned: 0 in 0.675s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:01:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6ae6ade3-5e6c-4fcf-b1bd-af2be326b7bc tempest-TestStampPattern-495104060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-120c54ff-c149-49ee-b3a2-3eeb68cd23b6 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:01:24 devstack sudo[110325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-120c54ff-c149-49ee-b3a2-3eeb68cd23b6 Jun 17 06:01:24 devstack sudo[110325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:01:25 devstack sudo[110325]: pam_unix(sudo:session): session closed for user root Jun 17 06:01:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6ae6ade3-5e6c-4fcf-b1bd-af2be326b7bc tempest-TestStampPattern-495104060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-120c54ff-c149-49ee-b3a2-3eeb68cd23b6" returned: 0 in 0.596s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:01:25 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-6ae6ade3-5e6c-4fcf-b1bd-af2be326b7bc tempest-TestStampPattern-495104060 None] Lock "cinder-quobyte-120c54ff-c149-49ee-b3a2-3eeb68cd23b6" released by "delete_volume" :: held 1.307s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:01:25 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-6ae6ade3-5e6c-4fcf-b1bd-af2be326b7bc tempest-TestStampPattern-495104060 None] Created reservations ['d515a648-762f-44f6-8578-f2dba6464312', 'dc2825aa-0545-4ff9-ab9f-71f03b98fb5d', 'bc3c5832-7406-4283-b7fe-49dd3087011d', '50981f43-f925-45af-95f9-ff56ac08662a'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 06:01:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-6ae6ade3-5e6c-4fcf-b1bd-af2be326b7bc tempest-TestStampPattern-495104060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:01:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-6ae6ade3-5e6c-4fcf-b1bd-af2be326b7bc tempest-TestStampPattern-495104060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:01:25 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-6ae6ade3-5e6c-4fcf-b1bd-af2be326b7bc tempest-TestStampPattern-495104060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 06:01:25 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-6ae6ade3-5e6c-4fcf-b1bd-af2be326b7bc tempest-TestStampPattern-495104060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 06:01:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-6ae6ade3-5e6c-4fcf-b1bd-af2be326b7bc tempest-TestStampPattern-495104060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:01:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6ae6ade3-5e6c-4fcf-b1bd-af2be326b7bc tempest-TestStampPattern-495104060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:01:25 devstack sudo[110328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 06:01:25 devstack sudo[110328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:01:26 devstack sudo[110328]: pam_unix(sudo:session): session closed for user root Jun 17 06:01:26 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6ae6ade3-5e6c-4fcf-b1bd-af2be326b7bc tempest-TestStampPattern-495104060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.577s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:01:26 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-6ae6ade3-5e6c-4fcf-b1bd-af2be326b7bc tempest-TestStampPattern-495104060 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 06:01:26 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-6ae6ade3-5e6c-4fcf-b1bd-af2be326b7bc tempest-TestStampPattern-495104060 None] Deleted volume successfully. Jun 17 06:01:26 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-6ae6ade3-5e6c-4fcf-b1bd-af2be326b7bc tempest-TestStampPattern-495104060 None] Lock "cinder-120c54ff-c149-49ee-b3a2-3eeb68cd23b6-delete_volume" released by "delete_volume" :: held 2.094s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:01:26 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-52ea1d75-5c94-4925-b1b4-46b080b62c5b tempest-TestStampPattern-495104060 None] Acquiring lock "cinder-ce2d3aed-2d41-4643-b3fc-b260f4101914-delete_snapshot" by "delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:01:26 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-52ea1d75-5c94-4925-b1b4-46b080b62c5b tempest-TestStampPattern-495104060 None] Lock "cinder-ce2d3aed-2d41-4643-b3fc-b260f4101914-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:01:26 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-52ea1d75-5c94-4925-b1b4-46b080b62c5b tempest-TestStampPattern-495104060 None] Acquiring lock "cinder-quobyte-6ec21353-8765-48b4-9804-1aec1f6a3ea3" by "delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:01:26 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-52ea1d75-5c94-4925-b1b4-46b080b62c5b tempest-TestStampPattern-495104060 None] Lock "cinder-quobyte-6ec21353-8765-48b4-9804-1aec1f6a3ea3" acquired by "delete_snapshot" :: waited 0.015s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:01:26 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-52ea1d75-5c94-4925-b1b4-46b080b62c5b tempest-TestStampPattern-495104060 None] Acquiring lock "cinder-quobyte-ce2d3aed-2d41-4643-b3fc-b260f4101914" by "_delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:01:26 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-52ea1d75-5c94-4925-b1b4-46b080b62c5b tempest-TestStampPattern-495104060 None] Lock "cinder-quobyte-ce2d3aed-2d41-4643-b3fc-b260f4101914" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:01:26 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-52ea1d75-5c94-4925-b1b4-46b080b62c5b tempest-TestStampPattern-495104060 None] Deleting offline snapshot ce2d3aed-2d41-4643-b3fc-b260f4101914 of volume 6ec21353-8765-48b4-9804-1aec1f6a3ea3 {{(pid=92083) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 17 06:01:26 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-52ea1d75-5c94-4925-b1b4-46b080b62c5b tempest-TestStampPattern-495104060 None] snapshot_file for this snap is: volume-6ec21353-8765-48b4-9804-1aec1f6a3ea3.ce2d3aed-2d41-4643-b3fc-b260f4101914 {{(pid=92083) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 17 06:01:26 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e3e1138-6611-43af-b41e-4aa03ff26559]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 06:01:26 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-52ea1d75-5c94-4925-b1b4-46b080b62c5b tempest-TestStampPattern-495104060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ec21353-8765-48b4-9804-1aec1f6a3ea3.ce2d3aed-2d41-4643-b3fc-b260f4101914 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:01:26 devstack sudo[110331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ec21353-8765-48b4-9804-1aec1f6a3ea3.ce2d3aed-2d41-4643-b3fc-b260f4101914 Jun 17 06:01:26 devstack sudo[110331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:01:27 devstack sudo[110331]: pam_unix(sudo:session): session closed for user root Jun 17 06:01:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-52ea1d75-5c94-4925-b1b4-46b080b62c5b tempest-TestStampPattern-495104060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ec21353-8765-48b4-9804-1aec1f6a3ea3.ce2d3aed-2d41-4643-b3fc-b260f4101914" returned: 0 in 0.682s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:01:27 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-52ea1d75-5c94-4925-b1b4-46b080b62c5b tempest-TestStampPattern-495104060 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ec21353-8765-48b4-9804-1aec1f6a3ea3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92083) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 06:01:27 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[48812d6c-e7e1-4efb-8f68-b0df32abc43f]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 06:01:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-52ea1d75-5c94-4925-b1b4-46b080b62c5b tempest-TestStampPattern-495104060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ec21353-8765-48b4-9804-1aec1f6a3ea3 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:01:27 devstack sudo[110336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ec21353-8765-48b4-9804-1aec1f6a3ea3 Jun 17 06:01:27 devstack sudo[110336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:01:27 devstack cinder-volume[92083]: DEBUG oslo_service.periodic_task [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92083) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 06:01:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:01:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:01:27 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 06:01:27 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 06:01:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:01:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:01:27 devstack sudo[110338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 06:01:27 devstack sudo[110338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:01:28 devstack sudo[110336]: pam_unix(sudo:session): session closed for user root Jun 17 06:01:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-52ea1d75-5c94-4925-b1b4-46b080b62c5b tempest-TestStampPattern-495104060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ec21353-8765-48b4-9804-1aec1f6a3ea3" returned: 0 in 0.711s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:01:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-52ea1d75-5c94-4925-b1b4-46b080b62c5b tempest-TestStampPattern-495104060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ec21353-8765-48b4-9804-1aec1f6a3ea3.ce2d3aed-2d41-4643-b3fc-b260f4101914 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:01:28 devstack sudo[110343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ec21353-8765-48b4-9804-1aec1f6a3ea3.ce2d3aed-2d41-4643-b3fc-b260f4101914 Jun 17 06:01:28 devstack sudo[110343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:01:28 devstack sudo[110338]: pam_unix(sudo:session): session closed for user root Jun 17 06:01:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.603s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:01:28 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 06:01:28 devstack cinder-volume[92083]: DEBUG oslo_service.periodic_task [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running periodic task VolumeManager._thread_info {{(pid=92083) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 06:01:28 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] thread count: 28 {{(pid=92083) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 17 06:01:28 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] thread info: [<_MainThread(MainThread, started 133483869905024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92083) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 17 06:01:28 devstack sudo[110343]: pam_unix(sudo:session): session closed for user root Jun 17 06:01:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-52ea1d75-5c94-4925-b1b4-46b080b62c5b tempest-TestStampPattern-495104060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ec21353-8765-48b4-9804-1aec1f6a3ea3.ce2d3aed-2d41-4643-b3fc-b260f4101914" returned: 0 in 0.665s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:01:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-52ea1d75-5c94-4925-b1b4-46b080b62c5b tempest-TestStampPattern-495104060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ec21353-8765-48b4-9804-1aec1f6a3ea3.ce2d3aed-2d41-4643-b3fc-b260f4101914 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:01:28 devstack sudo[110350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ec21353-8765-48b4-9804-1aec1f6a3ea3.ce2d3aed-2d41-4643-b3fc-b260f4101914 Jun 17 06:01:28 devstack sudo[110350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:01:29 devstack sudo[110350]: pam_unix(sudo:session): session closed for user root Jun 17 06:01:29 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-52ea1d75-5c94-4925-b1b4-46b080b62c5b tempest-TestStampPattern-495104060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ec21353-8765-48b4-9804-1aec1f6a3ea3.ce2d3aed-2d41-4643-b3fc-b260f4101914" returned: 0 in 0.571s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:01:29 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-52ea1d75-5c94-4925-b1b4-46b080b62c5b tempest-TestStampPattern-495104060 None] Lock "cinder-quobyte-ce2d3aed-2d41-4643-b3fc-b260f4101914" released by "_delete_snapshot" :: held 2.717s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:01:29 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-52ea1d75-5c94-4925-b1b4-46b080b62c5b tempest-TestStampPattern-495104060 None] Lock "cinder-quobyte-6ec21353-8765-48b4-9804-1aec1f6a3ea3" released by "delete_snapshot" :: held 2.740s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:01:29 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-52ea1d75-5c94-4925-b1b4-46b080b62c5b tempest-TestStampPattern-495104060 None] Created reservations ['062174de-de5e-47db-a2f7-250b66005484', '02830d56-997a-4bec-88db-bcb420fe2675', '5ba54898-fb12-47ea-9a17-fb75e7e8be6e', '37cc8d08-d819-4b1a-ba8f-7d482cfe0881'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 06:01:29 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-52ea1d75-5c94-4925-b1b4-46b080b62c5b tempest-TestStampPattern-495104060 None] Delete snapshot completed successfully. Jun 17 06:01:29 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-52ea1d75-5c94-4925-b1b4-46b080b62c5b tempest-TestStampPattern-495104060 None] Lock "cinder-ce2d3aed-2d41-4643-b3fc-b260f4101914-delete_snapshot" released by "delete_snapshot" :: held 2.857s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:01:37 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-6ae8a254-a425-4d5b-aa58-85edceff3276 tempest-TestStampPattern-495104060 None] Acquiring lock "cinder-6ec21353-8765-48b4-9804-1aec1f6a3ea3-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:01:37 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-6ae8a254-a425-4d5b-aa58-85edceff3276 tempest-TestStampPattern-495104060 None] Lock "cinder-6ec21353-8765-48b4-9804-1aec1f6a3ea3-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:01:37 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-6ae8a254-a425-4d5b-aa58-85edceff3276 tempest-TestStampPattern-495104060 None] Acquiring lock "cinder-quobyte-6ec21353-8765-48b4-9804-1aec1f6a3ea3" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:01:37 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-6ae8a254-a425-4d5b-aa58-85edceff3276 tempest-TestStampPattern-495104060 None] Lock "cinder-quobyte-6ec21353-8765-48b4-9804-1aec1f6a3ea3" acquired by "delete_volume" :: waited 0.017s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:01:37 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[c483ce75-22a6-4d2f-972a-b35a0c8d7a93]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 06:01:37 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6ae8a254-a425-4d5b-aa58-85edceff3276 tempest-TestStampPattern-495104060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ec21353-8765-48b4-9804-1aec1f6a3ea3 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:01:37 devstack sudo[110435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ec21353-8765-48b4-9804-1aec1f6a3ea3 Jun 17 06:01:37 devstack sudo[110435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:01:38 devstack sudo[110435]: pam_unix(sudo:session): session closed for user root Jun 17 06:01:38 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6ae8a254-a425-4d5b-aa58-85edceff3276 tempest-TestStampPattern-495104060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ec21353-8765-48b4-9804-1aec1f6a3ea3" returned: 0 in 0.684s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:01:38 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6ae8a254-a425-4d5b-aa58-85edceff3276 tempest-TestStampPattern-495104060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ec21353-8765-48b4-9804-1aec1f6a3ea3 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:01:38 devstack sudo[110440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ec21353-8765-48b4-9804-1aec1f6a3ea3 Jun 17 06:01:38 devstack sudo[110440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:01:38 devstack sudo[110440]: pam_unix(sudo:session): session closed for user root Jun 17 06:01:38 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6ae8a254-a425-4d5b-aa58-85edceff3276 tempest-TestStampPattern-495104060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ec21353-8765-48b4-9804-1aec1f6a3ea3" returned: 0 in 0.575s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:01:38 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-6ae8a254-a425-4d5b-aa58-85edceff3276 tempest-TestStampPattern-495104060 None] Lock "cinder-quobyte-6ec21353-8765-48b4-9804-1aec1f6a3ea3" released by "delete_volume" :: held 1.313s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:01:38 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-6ae8a254-a425-4d5b-aa58-85edceff3276 tempest-TestStampPattern-495104060 None] Created reservations ['3c17dc9f-9eb4-4b08-8ef2-f46219bcb939', '9b152194-03e3-44ac-b22f-b89f17ad5b81', 'ba96b6a2-373d-419c-8aa7-90b31b3f38bc', 'e5d1fb41-deaa-48bf-b64d-35e482a72cd6'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 06:01:38 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-6ae8a254-a425-4d5b-aa58-85edceff3276 tempest-TestStampPattern-495104060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:01:38 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-6ae8a254-a425-4d5b-aa58-85edceff3276 tempest-TestStampPattern-495104060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:01:38 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-6ae8a254-a425-4d5b-aa58-85edceff3276 tempest-TestStampPattern-495104060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 06:01:38 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-6ae8a254-a425-4d5b-aa58-85edceff3276 tempest-TestStampPattern-495104060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 06:01:38 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-6ae8a254-a425-4d5b-aa58-85edceff3276 tempest-TestStampPattern-495104060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:01:38 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6ae8a254-a425-4d5b-aa58-85edceff3276 tempest-TestStampPattern-495104060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:01:38 devstack sudo[110443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 06:01:38 devstack sudo[110443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:01:39 devstack sudo[110443]: pam_unix(sudo:session): session closed for user root Jun 17 06:01:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6ae8a254-a425-4d5b-aa58-85edceff3276 tempest-TestStampPattern-495104060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.574s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:01:39 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-6ae8a254-a425-4d5b-aa58-85edceff3276 tempest-TestStampPattern-495104060 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 06:01:39 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-6ae8a254-a425-4d5b-aa58-85edceff3276 tempest-TestStampPattern-495104060 None] Deleted volume successfully. Jun 17 06:01:39 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-6ae8a254-a425-4d5b-aa58-85edceff3276 tempest-TestStampPattern-495104060 None] Lock "cinder-6ec21353-8765-48b4-9804-1aec1f6a3ea3-delete_volume" released by "delete_volume" :: held 2.071s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:01:48 devstack cinder-volume[92083]: DEBUG dbcounter [-] [92083] Writing DB stats cinder:SELECT=23,cinder:UPDATE=23,cinder:INSERT=7,cinder:DELETE=1 {{(pid=92083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 06:01:48 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6609502-4330-404a-a66a-d7a01f3da514 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 06:01:48 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-f6609502-4330-404a-a66a-d7a01f3da514 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Flow 'volume_create_manager' (837565d8-c9b7-4eeb-995d-cd21127e46ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 06:01:48 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-f6609502-4330-404a-a66a-d7a01f3da514 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1b32c61-7f75-4e96-8a1e-87ad247b80f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:01:48 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-f6609502-4330-404a-a66a-d7a01f3da514 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1b32c61-7f75-4e96-8a1e-87ad247b80f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T04:01:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1548063011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2965d76b-c631-426d-8d1b-1e48b3ae5cbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6c14ac549fd47c280a6e2a4f1f2020b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T04:01:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T04:01:49Z,use_quota=True,user_id='a206c2a746574cb4af250564292497b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:01:48 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-f6609502-4330-404a-a66a-d7a01f3da514 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ddacd74-65a0-43cc-87c9-33079f9e5cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:01:48 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-f6609502-4330-404a-a66a-d7a01f3da514 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ddacd74-65a0-43cc-87c9-33079f9e5cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:01:48 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-f6609502-4330-404a-a66a-d7a01f3da514 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d20ad3c-a89d-4c82-85f5-935d5e07deb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:01:48 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-f6609502-4330-404a-a66a-d7a01f3da514 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d20ad3c-a89d-4c82-85f5-935d5e07deb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2965d76b-c631-426d-8d1b-1e48b3ae5cbb', 'volume_name': 'volume-2965d76b-c631-426d-8d1b-1e48b3ae5cbb', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:01:48 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-f6609502-4330-404a-a66a-d7a01f3da514 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb1d8790-013c-4c0f-bab1-fff401de6e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:01:48 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-f6609502-4330-404a-a66a-d7a01f3da514 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb1d8790-013c-4c0f-bab1-fff401de6e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:01:48 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-f6609502-4330-404a-a66a-d7a01f3da514 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec122dcc-7aae-4cf2-8ce6-b3eac0629475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:01:48 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-f6609502-4330-404a-a66a-d7a01f3da514 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Volume 2965d76b-c631-426d-8d1b-1e48b3ae5cbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2965d76b-c631-426d-8d1b-1e48b3ae5cbb', 'volume_size': 1} Jun 17 06:01:48 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-f6609502-4330-404a-a66a-d7a01f3da514 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:01:48 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-f6609502-4330-404a-a66a-d7a01f3da514 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:01:48 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-f6609502-4330-404a-a66a-d7a01f3da514 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T04:01:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1548063011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2965d76b-c631-426d-8d1b-1e48b3ae5cbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6c14ac549fd47c280a6e2a4f1f2020b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T04:01:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T04:01:49Z,use_quota=True,user_id='a206c2a746574cb4af250564292497b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 06:01:48 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-f6609502-4330-404a-a66a-d7a01f3da514 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Creating volume 2965d76b-c631-426d-8d1b-1e48b3ae5cbb {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 06:01:48 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-f6609502-4330-404a-a66a-d7a01f3da514 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:01:48 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-f6609502-4330-404a-a66a-d7a01f3da514 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:01:48 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-f6609502-4330-404a-a66a-d7a01f3da514 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 06:01:48 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-f6609502-4330-404a-a66a-d7a01f3da514 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 06:01:48 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-f6609502-4330-404a-a66a-d7a01f3da514 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:01:48 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-f6609502-4330-404a-a66a-d7a01f3da514 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 06:01:48 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-f6609502-4330-404a-a66a-d7a01f3da514 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 06:01:48 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f6609502-4330-404a-a66a-d7a01f3da514 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2965d76b-c631-426d-8d1b-1e48b3ae5cbb 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:01:48 devstack sudo[110452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2965d76b-c631-426d-8d1b-1e48b3ae5cbb 1073741824 Jun 17 06:01:48 devstack sudo[110452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:01:49 devstack sudo[110452]: pam_unix(sudo:session): session closed for user root Jun 17 06:01:49 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f6609502-4330-404a-a66a-d7a01f3da514 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2965d76b-c631-426d-8d1b-1e48b3ae5cbb 1073741824" returned: 0 in 0.734s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:01:49 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f6609502-4330-404a-a66a-d7a01f3da514 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2965d76b-c631-426d-8d1b-1e48b3ae5cbb {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:01:49 devstack sudo[110458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2965d76b-c631-426d-8d1b-1e48b3ae5cbb Jun 17 06:01:49 devstack sudo[110458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:01:50 devstack sudo[110458]: pam_unix(sudo:session): session closed for user root Jun 17 06:01:50 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f6609502-4330-404a-a66a-d7a01f3da514 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2965d76b-c631-426d-8d1b-1e48b3ae5cbb" returned: 0 in 0.598s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:01:50 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-f6609502-4330-404a-a66a-d7a01f3da514 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] <== create_volume: return (1370ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 06:01:50 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-f6609502-4330-404a-a66a-d7a01f3da514 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.372s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:01:50 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-f6609502-4330-404a-a66a-d7a01f3da514 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec122dcc-7aae-4cf2-8ce6-b3eac0629475) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2965d76b-c631-426d-8d1b-1e48b3ae5cbb', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:01:50 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-f6609502-4330-404a-a66a-d7a01f3da514 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7fc268f-d28d-4067-8b50-b4c21199f3d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:01:50 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-f6609502-4330-404a-a66a-d7a01f3da514 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Volume volume-2965d76b-c631-426d-8d1b-1e48b3ae5cbb (2965d76b-c631-426d-8d1b-1e48b3ae5cbb): created successfully Jun 17 06:01:50 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-f6609502-4330-404a-a66a-d7a01f3da514 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7fc268f-d28d-4067-8b50-b4c21199f3d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:01:50 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-f6609502-4330-404a-a66a-d7a01f3da514 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Flow 'volume_create_manager' (837565d8-c9b7-4eeb-995d-cd21127e46ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 06:01:50 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-f6609502-4330-404a-a66a-d7a01f3da514 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Created volume successfully. Jun 17 06:01:51 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-67b77bd8-8bf7-4596-b6ae-eced1c0e6bfe tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 06:01:51 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-67b77bd8-8bf7-4596-b6ae-eced1c0e6bfe tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Flow 'volume_create_manager' (871c3915-0c31-47c8-8f7d-625fecb511e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 06:01:51 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-67b77bd8-8bf7-4596-b6ae-eced1c0e6bfe tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c295e4d-27a4-435f-a8d9-3fa69698d7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:01:51 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-67b77bd8-8bf7-4596-b6ae-eced1c0e6bfe tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c295e4d-27a4-435f-a8d9-3fa69698d7e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T04:01:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-910962377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcdfd6fa-f57a-4f2c-b401-98e0e200a0e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6c14ac549fd47c280a6e2a4f1f2020b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T04:01:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T04:01:51Z,use_quota=True,user_id='a206c2a746574cb4af250564292497b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:01:51 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-67b77bd8-8bf7-4596-b6ae-eced1c0e6bfe tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ddb88e2-fd9b-4475-98c4-517f8d8b139d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:01:51 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-67b77bd8-8bf7-4596-b6ae-eced1c0e6bfe tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ddb88e2-fd9b-4475-98c4-517f8d8b139d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:01:51 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-67b77bd8-8bf7-4596-b6ae-eced1c0e6bfe tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72cf01fe-6966-4115-be9f-2c204661e679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:01:51 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-67b77bd8-8bf7-4596-b6ae-eced1c0e6bfe tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72cf01fe-6966-4115-be9f-2c204661e679) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcdfd6fa-f57a-4f2c-b401-98e0e200a0e9', 'volume_name': 'volume-fcdfd6fa-f57a-4f2c-b401-98e0e200a0e9', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:01:51 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-67b77bd8-8bf7-4596-b6ae-eced1c0e6bfe tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ae0851b-094c-4aa2-953f-420b8e09b841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:01:51 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-67b77bd8-8bf7-4596-b6ae-eced1c0e6bfe tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ae0851b-094c-4aa2-953f-420b8e09b841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:01:51 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-67b77bd8-8bf7-4596-b6ae-eced1c0e6bfe tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c723ce9a-d158-4652-882d-32307d8b4627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:01:51 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-67b77bd8-8bf7-4596-b6ae-eced1c0e6bfe tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Volume fcdfd6fa-f57a-4f2c-b401-98e0e200a0e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcdfd6fa-f57a-4f2c-b401-98e0e200a0e9', 'volume_size': 1} Jun 17 06:01:51 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-67b77bd8-8bf7-4596-b6ae-eced1c0e6bfe tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:01:51 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-67b77bd8-8bf7-4596-b6ae-eced1c0e6bfe tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:01:51 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-67b77bd8-8bf7-4596-b6ae-eced1c0e6bfe tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T04:01:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-910962377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcdfd6fa-f57a-4f2c-b401-98e0e200a0e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6c14ac549fd47c280a6e2a4f1f2020b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T04:01:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T04:01:51Z,use_quota=True,user_id='a206c2a746574cb4af250564292497b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 06:01:51 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-67b77bd8-8bf7-4596-b6ae-eced1c0e6bfe tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Creating volume fcdfd6fa-f57a-4f2c-b401-98e0e200a0e9 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 06:01:51 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-67b77bd8-8bf7-4596-b6ae-eced1c0e6bfe tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:01:51 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-67b77bd8-8bf7-4596-b6ae-eced1c0e6bfe tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:01:51 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-67b77bd8-8bf7-4596-b6ae-eced1c0e6bfe tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 06:01:51 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-67b77bd8-8bf7-4596-b6ae-eced1c0e6bfe tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 06:01:51 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-67b77bd8-8bf7-4596-b6ae-eced1c0e6bfe tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:01:51 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-67b77bd8-8bf7-4596-b6ae-eced1c0e6bfe tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 06:01:51 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-67b77bd8-8bf7-4596-b6ae-eced1c0e6bfe tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 06:01:51 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-67b77bd8-8bf7-4596-b6ae-eced1c0e6bfe tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-fcdfd6fa-f57a-4f2c-b401-98e0e200a0e9 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:01:51 devstack sudo[110461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-fcdfd6fa-f57a-4f2c-b401-98e0e200a0e9 1073741824 Jun 17 06:01:51 devstack sudo[110461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:01:51 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8cde059-109c-471b-9398-4d5caed84105 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 06:01:51 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a8cde059-109c-471b-9398-4d5caed84105 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Flow 'volume_create_manager' (bf17d79a-215f-4ec2-bca2-37d7fb44a43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 06:01:51 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a8cde059-109c-471b-9398-4d5caed84105 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0889d7ce-a59b-48e2-a500-a6abe8ff08c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:01:51 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a8cde059-109c-471b-9398-4d5caed84105 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0889d7ce-a59b-48e2-a500-a6abe8ff08c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T04:01:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1823564690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88b49b05-693c-47b0-97a0-b889964a5ada,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6c14ac549fd47c280a6e2a4f1f2020b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T04:01:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T04:01:52Z,use_quota=True,user_id='a206c2a746574cb4af250564292497b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:01:51 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a8cde059-109c-471b-9398-4d5caed84105 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dad9c72f-fc94-4e7d-a773-165a1a260a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:01:51 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a8cde059-109c-471b-9398-4d5caed84105 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dad9c72f-fc94-4e7d-a773-165a1a260a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:01:51 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a8cde059-109c-471b-9398-4d5caed84105 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d586f031-3966-4fc2-8b7e-86ecd44743be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:01:51 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a8cde059-109c-471b-9398-4d5caed84105 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d586f031-3966-4fc2-8b7e-86ecd44743be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88b49b05-693c-47b0-97a0-b889964a5ada', 'volume_name': 'volume-88b49b05-693c-47b0-97a0-b889964a5ada', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:01:51 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a8cde059-109c-471b-9398-4d5caed84105 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4742716-17a0-4cd4-8d5e-268a701b5c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:01:51 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a8cde059-109c-471b-9398-4d5caed84105 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4742716-17a0-4cd4-8d5e-268a701b5c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:01:51 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a8cde059-109c-471b-9398-4d5caed84105 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2e7c70e-e4bf-4538-8d26-7d94c0eb183a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:01:51 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-a8cde059-109c-471b-9398-4d5caed84105 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Volume 88b49b05-693c-47b0-97a0-b889964a5ada: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88b49b05-693c-47b0-97a0-b889964a5ada', 'volume_size': 1} Jun 17 06:01:51 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-a8cde059-109c-471b-9398-4d5caed84105 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:01:52 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-350ad5e9-7ede-4926-83a5-935f8f2ce444 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 06:01:52 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-350ad5e9-7ede-4926-83a5-935f8f2ce444 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Flow 'volume_create_manager' (f0ae03d5-7154-4165-b5ba-c6ad571666ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 06:01:52 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-350ad5e9-7ede-4926-83a5-935f8f2ce444 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0df5c7fe-2738-4c2c-b065-fd2ccf17f05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:01:52 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-350ad5e9-7ede-4926-83a5-935f8f2ce444 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0df5c7fe-2738-4c2c-b065-fd2ccf17f05a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T04:01:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1632216974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71a8a5f5-c0b5-4bc3-85d4-9654a5689205,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6c14ac549fd47c280a6e2a4f1f2020b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T04:01:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T04:01:52Z,use_quota=True,user_id='a206c2a746574cb4af250564292497b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:01:52 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-350ad5e9-7ede-4926-83a5-935f8f2ce444 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b708290e-1d7c-4230-adef-003d8af2e72a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:01:52 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-350ad5e9-7ede-4926-83a5-935f8f2ce444 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b708290e-1d7c-4230-adef-003d8af2e72a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:01:52 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-350ad5e9-7ede-4926-83a5-935f8f2ce444 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e0b92f9-66c0-41b8-a965-e719b277323f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:01:52 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-350ad5e9-7ede-4926-83a5-935f8f2ce444 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e0b92f9-66c0-41b8-a965-e719b277323f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71a8a5f5-c0b5-4bc3-85d4-9654a5689205', 'volume_name': 'volume-71a8a5f5-c0b5-4bc3-85d4-9654a5689205', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:01:52 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-350ad5e9-7ede-4926-83a5-935f8f2ce444 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98f6fe65-0f7f-4798-ab4d-bed3b28cad83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:01:52 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-350ad5e9-7ede-4926-83a5-935f8f2ce444 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98f6fe65-0f7f-4798-ab4d-bed3b28cad83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:01:52 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-350ad5e9-7ede-4926-83a5-935f8f2ce444 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5674039-62dc-49a7-9f48-c62e31fb8c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:01:52 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-350ad5e9-7ede-4926-83a5-935f8f2ce444 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Volume 71a8a5f5-c0b5-4bc3-85d4-9654a5689205: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71a8a5f5-c0b5-4bc3-85d4-9654a5689205', 'volume_size': 1} Jun 17 06:01:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-350ad5e9-7ede-4926-83a5-935f8f2ce444 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:01:52 devstack sudo[110461]: pam_unix(sudo:session): session closed for user root Jun 17 06:01:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-67b77bd8-8bf7-4596-b6ae-eced1c0e6bfe tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-fcdfd6fa-f57a-4f2c-b401-98e0e200a0e9 1073741824" returned: 0 in 0.836s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:01:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-67b77bd8-8bf7-4596-b6ae-eced1c0e6bfe tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-fcdfd6fa-f57a-4f2c-b401-98e0e200a0e9 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:01:52 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-c12d8960-26a5-4f03-aecd-ca2a83e0db27 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 06:01:52 devstack sudo[110466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-fcdfd6fa-f57a-4f2c-b401-98e0e200a0e9 Jun 17 06:01:52 devstack sudo[110466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:01:52 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c12d8960-26a5-4f03-aecd-ca2a83e0db27 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Flow 'volume_create_manager' (78c05289-5bbc-418d-8146-06c33cc58ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 06:01:52 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c12d8960-26a5-4f03-aecd-ca2a83e0db27 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (627ed90e-1c59-495e-9319-9d6235b53de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:01:52 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c12d8960-26a5-4f03-aecd-ca2a83e0db27 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (627ed90e-1c59-495e-9319-9d6235b53de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T04:01:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1334022775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab2147fa-5dec-4681-baae-0f916e211e0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6c14ac549fd47c280a6e2a4f1f2020b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T04:01:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T04:01:52Z,use_quota=True,user_id='a206c2a746574cb4af250564292497b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:01:52 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c12d8960-26a5-4f03-aecd-ca2a83e0db27 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5006774-7294-4b9d-896b-d085fd392f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:01:52 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c12d8960-26a5-4f03-aecd-ca2a83e0db27 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5006774-7294-4b9d-896b-d085fd392f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:01:52 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c12d8960-26a5-4f03-aecd-ca2a83e0db27 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c08f642-ec08-4891-8e64-e5bd0dd4baf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:01:52 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c12d8960-26a5-4f03-aecd-ca2a83e0db27 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c08f642-ec08-4891-8e64-e5bd0dd4baf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab2147fa-5dec-4681-baae-0f916e211e0a', 'volume_name': 'volume-ab2147fa-5dec-4681-baae-0f916e211e0a', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:01:52 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c12d8960-26a5-4f03-aecd-ca2a83e0db27 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ed08503-3bab-48d0-8278-123b83acf29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:01:52 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c12d8960-26a5-4f03-aecd-ca2a83e0db27 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ed08503-3bab-48d0-8278-123b83acf29d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:01:52 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c12d8960-26a5-4f03-aecd-ca2a83e0db27 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6339486-3175-4f2c-aa8f-4e159df260ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:01:52 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-c12d8960-26a5-4f03-aecd-ca2a83e0db27 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Volume ab2147fa-5dec-4681-baae-0f916e211e0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab2147fa-5dec-4681-baae-0f916e211e0a', 'volume_size': 1} Jun 17 06:01:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-c12d8960-26a5-4f03-aecd-ca2a83e0db27 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:01:52 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-5492fdee-2ec6-4f08-99fc-93c82b697902 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 06:01:52 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-5492fdee-2ec6-4f08-99fc-93c82b697902 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Flow 'volume_create_manager' (5efb63c7-25df-49ff-a93e-ad526a82a423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 06:01:52 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-5492fdee-2ec6-4f08-99fc-93c82b697902 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a01cf9d8-507f-4842-910e-b1e13eea7649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:01:52 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-5492fdee-2ec6-4f08-99fc-93c82b697902 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a01cf9d8-507f-4842-910e-b1e13eea7649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T04:01:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-44651666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ce9043f-0de2-45e8-8d16-8780441fb5c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6c14ac549fd47c280a6e2a4f1f2020b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T04:01:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T04:01:53Z,use_quota=True,user_id='a206c2a746574cb4af250564292497b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:01:52 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-5492fdee-2ec6-4f08-99fc-93c82b697902 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf0a8ffd-0741-4547-a549-a2085f41f979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:01:52 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-5492fdee-2ec6-4f08-99fc-93c82b697902 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf0a8ffd-0741-4547-a549-a2085f41f979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:01:52 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-5492fdee-2ec6-4f08-99fc-93c82b697902 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1582e12-8919-404d-a2ac-a6971beb7349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:01:52 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-5492fdee-2ec6-4f08-99fc-93c82b697902 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1582e12-8919-404d-a2ac-a6971beb7349) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ce9043f-0de2-45e8-8d16-8780441fb5c2', 'volume_name': 'volume-5ce9043f-0de2-45e8-8d16-8780441fb5c2', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:01:52 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-5492fdee-2ec6-4f08-99fc-93c82b697902 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe63049f-e271-4041-9120-5cb0d06795b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:01:52 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-5492fdee-2ec6-4f08-99fc-93c82b697902 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe63049f-e271-4041-9120-5cb0d06795b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:01:52 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-5492fdee-2ec6-4f08-99fc-93c82b697902 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc5ec003-323b-46e1-a25a-7bc916ed7bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:01:52 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-5492fdee-2ec6-4f08-99fc-93c82b697902 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Volume 5ce9043f-0de2-45e8-8d16-8780441fb5c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ce9043f-0de2-45e8-8d16-8780441fb5c2', 'volume_size': 1} Jun 17 06:01:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-5492fdee-2ec6-4f08-99fc-93c82b697902 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:01:52 devstack sudo[110466]: pam_unix(sudo:session): session closed for user root Jun 17 06:01:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-67b77bd8-8bf7-4596-b6ae-eced1c0e6bfe tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-fcdfd6fa-f57a-4f2c-b401-98e0e200a0e9" returned: 0 in 0.596s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:01:52 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-67b77bd8-8bf7-4596-b6ae-eced1c0e6bfe tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] <== create_volume: return (1482ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 06:01:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-67b77bd8-8bf7-4596-b6ae-eced1c0e6bfe tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.485s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:01:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-a8cde059-109c-471b-9398-4d5caed84105 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.147s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:01:52 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-a8cde059-109c-471b-9398-4d5caed84105 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T04:01:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1823564690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88b49b05-693c-47b0-97a0-b889964a5ada,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6c14ac549fd47c280a6e2a4f1f2020b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T04:01:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T04:01:52Z,use_quota=True,user_id='a206c2a746574cb4af250564292497b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 06:01:52 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-a8cde059-109c-471b-9398-4d5caed84105 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Creating volume 88b49b05-693c-47b0-97a0-b889964a5ada {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 06:01:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-a8cde059-109c-471b-9398-4d5caed84105 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:01:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-a8cde059-109c-471b-9398-4d5caed84105 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:01:52 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-a8cde059-109c-471b-9398-4d5caed84105 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 06:01:52 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-a8cde059-109c-471b-9398-4d5caed84105 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 06:01:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-a8cde059-109c-471b-9398-4d5caed84105 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:01:52 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-a8cde059-109c-471b-9398-4d5caed84105 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 06:01:52 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-a8cde059-109c-471b-9398-4d5caed84105 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 06:01:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a8cde059-109c-471b-9398-4d5caed84105 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-88b49b05-693c-47b0-97a0-b889964a5ada 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:01:52 devstack sudo[110469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-88b49b05-693c-47b0-97a0-b889964a5ada 1073741824 Jun 17 06:01:52 devstack sudo[110469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:01:52 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-67b77bd8-8bf7-4596-b6ae-eced1c0e6bfe tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c723ce9a-d158-4652-882d-32307d8b4627) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcdfd6fa-f57a-4f2c-b401-98e0e200a0e9', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:01:52 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-67b77bd8-8bf7-4596-b6ae-eced1c0e6bfe tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efc25ea9-4cb7-427f-bd75-cc7e630ab9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:01:52 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-67b77bd8-8bf7-4596-b6ae-eced1c0e6bfe tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Volume volume-fcdfd6fa-f57a-4f2c-b401-98e0e200a0e9 (fcdfd6fa-f57a-4f2c-b401-98e0e200a0e9): created successfully Jun 17 06:01:52 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-67b77bd8-8bf7-4596-b6ae-eced1c0e6bfe tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efc25ea9-4cb7-427f-bd75-cc7e630ab9b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:01:52 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-67b77bd8-8bf7-4596-b6ae-eced1c0e6bfe tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Flow 'volume_create_manager' (871c3915-0c31-47c8-8f7d-625fecb511e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 06:01:52 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-67b77bd8-8bf7-4596-b6ae-eced1c0e6bfe tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Created volume successfully. Jun 17 06:01:53 devstack sudo[110469]: pam_unix(sudo:session): session closed for user root Jun 17 06:01:53 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a8cde059-109c-471b-9398-4d5caed84105 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-88b49b05-693c-47b0-97a0-b889964a5ada 1073741824" returned: 0 in 0.729s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:01:53 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a8cde059-109c-471b-9398-4d5caed84105 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-88b49b05-693c-47b0-97a0-b889964a5ada {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:01:53 devstack sudo[110474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-88b49b05-693c-47b0-97a0-b889964a5ada Jun 17 06:01:53 devstack sudo[110474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:01:54 devstack sudo[110474]: pam_unix(sudo:session): session closed for user root Jun 17 06:01:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a8cde059-109c-471b-9398-4d5caed84105 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-88b49b05-693c-47b0-97a0-b889964a5ada" returned: 0 in 0.571s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:01:54 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-a8cde059-109c-471b-9398-4d5caed84105 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] <== create_volume: return (1340ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 06:01:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-a8cde059-109c-471b-9398-4d5caed84105 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.343s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:01:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-350ad5e9-7ede-4926-83a5-935f8f2ce444 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.150s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:01:54 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-350ad5e9-7ede-4926-83a5-935f8f2ce444 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T04:01:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1632216974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71a8a5f5-c0b5-4bc3-85d4-9654a5689205,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6c14ac549fd47c280a6e2a4f1f2020b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T04:01:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T04:01:52Z,use_quota=True,user_id='a206c2a746574cb4af250564292497b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 06:01:54 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-350ad5e9-7ede-4926-83a5-935f8f2ce444 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Creating volume 71a8a5f5-c0b5-4bc3-85d4-9654a5689205 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 06:01:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-350ad5e9-7ede-4926-83a5-935f8f2ce444 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:01:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-350ad5e9-7ede-4926-83a5-935f8f2ce444 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:01:54 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-350ad5e9-7ede-4926-83a5-935f8f2ce444 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 06:01:54 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-350ad5e9-7ede-4926-83a5-935f8f2ce444 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 06:01:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-350ad5e9-7ede-4926-83a5-935f8f2ce444 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:01:54 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-350ad5e9-7ede-4926-83a5-935f8f2ce444 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 06:01:54 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-350ad5e9-7ede-4926-83a5-935f8f2ce444 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 06:01:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-350ad5e9-7ede-4926-83a5-935f8f2ce444 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-71a8a5f5-c0b5-4bc3-85d4-9654a5689205 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:01:54 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a8cde059-109c-471b-9398-4d5caed84105 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2e7c70e-e4bf-4538-8d26-7d94c0eb183a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88b49b05-693c-47b0-97a0-b889964a5ada', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:01:54 devstack sudo[110477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-71a8a5f5-c0b5-4bc3-85d4-9654a5689205 1073741824 Jun 17 06:01:54 devstack sudo[110477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:01:54 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a8cde059-109c-471b-9398-4d5caed84105 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f32a816-6c83-4435-99b5-4a9efd6c7625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:01:54 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-a8cde059-109c-471b-9398-4d5caed84105 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Volume volume-88b49b05-693c-47b0-97a0-b889964a5ada (88b49b05-693c-47b0-97a0-b889964a5ada): created successfully Jun 17 06:01:54 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a8cde059-109c-471b-9398-4d5caed84105 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f32a816-6c83-4435-99b5-4a9efd6c7625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:01:54 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a8cde059-109c-471b-9398-4d5caed84105 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Flow 'volume_create_manager' (bf17d79a-215f-4ec2-bca2-37d7fb44a43f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 06:01:54 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-a8cde059-109c-471b-9398-4d5caed84105 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Created volume successfully. Jun 17 06:01:55 devstack sudo[110477]: pam_unix(sudo:session): session closed for user root Jun 17 06:01:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-350ad5e9-7ede-4926-83a5-935f8f2ce444 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-71a8a5f5-c0b5-4bc3-85d4-9654a5689205 1073741824" returned: 0 in 0.745s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:01:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-350ad5e9-7ede-4926-83a5-935f8f2ce444 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-71a8a5f5-c0b5-4bc3-85d4-9654a5689205 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:01:55 devstack sudo[110483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-71a8a5f5-c0b5-4bc3-85d4-9654a5689205 Jun 17 06:01:55 devstack sudo[110483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:01:55 devstack sudo[110483]: pam_unix(sudo:session): session closed for user root Jun 17 06:01:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-350ad5e9-7ede-4926-83a5-935f8f2ce444 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-71a8a5f5-c0b5-4bc3-85d4-9654a5689205" returned: 0 in 0.572s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:01:55 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-350ad5e9-7ede-4926-83a5-935f8f2ce444 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] <== create_volume: return (1351ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 06:01:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-350ad5e9-7ede-4926-83a5-935f8f2ce444 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.354s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:01:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-c12d8960-26a5-4f03-aecd-ca2a83e0db27 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.192s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:01:55 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-c12d8960-26a5-4f03-aecd-ca2a83e0db27 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T04:01:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1334022775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab2147fa-5dec-4681-baae-0f916e211e0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6c14ac549fd47c280a6e2a4f1f2020b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T04:01:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T04:01:52Z,use_quota=True,user_id='a206c2a746574cb4af250564292497b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 06:01:55 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-c12d8960-26a5-4f03-aecd-ca2a83e0db27 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Creating volume ab2147fa-5dec-4681-baae-0f916e211e0a {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 06:01:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-c12d8960-26a5-4f03-aecd-ca2a83e0db27 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:01:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-c12d8960-26a5-4f03-aecd-ca2a83e0db27 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:01:55 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-c12d8960-26a5-4f03-aecd-ca2a83e0db27 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 06:01:55 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-c12d8960-26a5-4f03-aecd-ca2a83e0db27 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 06:01:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-c12d8960-26a5-4f03-aecd-ca2a83e0db27 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:01:55 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-c12d8960-26a5-4f03-aecd-ca2a83e0db27 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 06:01:55 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-c12d8960-26a5-4f03-aecd-ca2a83e0db27 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 06:01:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c12d8960-26a5-4f03-aecd-ca2a83e0db27 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ab2147fa-5dec-4681-baae-0f916e211e0a 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:01:55 devstack sudo[110486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ab2147fa-5dec-4681-baae-0f916e211e0a 1073741824 Jun 17 06:01:55 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-350ad5e9-7ede-4926-83a5-935f8f2ce444 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5674039-62dc-49a7-9f48-c62e31fb8c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71a8a5f5-c0b5-4bc3-85d4-9654a5689205', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:01:55 devstack sudo[110486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:01:55 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-350ad5e9-7ede-4926-83a5-935f8f2ce444 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fde9690b-34da-4e76-9ae8-b848ac229df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:01:55 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-350ad5e9-7ede-4926-83a5-935f8f2ce444 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Volume volume-71a8a5f5-c0b5-4bc3-85d4-9654a5689205 (71a8a5f5-c0b5-4bc3-85d4-9654a5689205): created successfully Jun 17 06:01:55 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-350ad5e9-7ede-4926-83a5-935f8f2ce444 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fde9690b-34da-4e76-9ae8-b848ac229df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:01:55 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-350ad5e9-7ede-4926-83a5-935f8f2ce444 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Flow 'volume_create_manager' (f0ae03d5-7154-4165-b5ba-c6ad571666ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 06:01:55 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-350ad5e9-7ede-4926-83a5-935f8f2ce444 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Created volume successfully. Jun 17 06:01:56 devstack sudo[110486]: pam_unix(sudo:session): session closed for user root Jun 17 06:01:56 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c12d8960-26a5-4f03-aecd-ca2a83e0db27 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ab2147fa-5dec-4681-baae-0f916e211e0a 1073741824" returned: 0 in 0.745s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:01:56 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c12d8960-26a5-4f03-aecd-ca2a83e0db27 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ab2147fa-5dec-4681-baae-0f916e211e0a {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:01:56 devstack sudo[110491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ab2147fa-5dec-4681-baae-0f916e211e0a Jun 17 06:01:56 devstack sudo[110491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:01:56 devstack sudo[110491]: pam_unix(sudo:session): session closed for user root Jun 17 06:01:56 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c12d8960-26a5-4f03-aecd-ca2a83e0db27 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ab2147fa-5dec-4681-baae-0f916e211e0a" returned: 0 in 0.585s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:01:56 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-c12d8960-26a5-4f03-aecd-ca2a83e0db27 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] <== create_volume: return (1365ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 06:01:56 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-c12d8960-26a5-4f03-aecd-ca2a83e0db27 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.367s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:01:56 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-5492fdee-2ec6-4f08-99fc-93c82b697902 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.249s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:01:56 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-5492fdee-2ec6-4f08-99fc-93c82b697902 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T04:01:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-44651666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ce9043f-0de2-45e8-8d16-8780441fb5c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6c14ac549fd47c280a6e2a4f1f2020b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T04:01:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T04:01:53Z,use_quota=True,user_id='a206c2a746574cb4af250564292497b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 06:01:56 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-5492fdee-2ec6-4f08-99fc-93c82b697902 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Creating volume 5ce9043f-0de2-45e8-8d16-8780441fb5c2 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 06:01:56 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-5492fdee-2ec6-4f08-99fc-93c82b697902 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:01:56 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-5492fdee-2ec6-4f08-99fc-93c82b697902 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:01:56 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-5492fdee-2ec6-4f08-99fc-93c82b697902 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 06:01:56 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-5492fdee-2ec6-4f08-99fc-93c82b697902 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 06:01:56 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-5492fdee-2ec6-4f08-99fc-93c82b697902 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:01:56 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-5492fdee-2ec6-4f08-99fc-93c82b697902 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 06:01:56 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-5492fdee-2ec6-4f08-99fc-93c82b697902 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 06:01:56 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-5492fdee-2ec6-4f08-99fc-93c82b697902 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-5ce9043f-0de2-45e8-8d16-8780441fb5c2 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:01:57 devstack sudo[110494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-5ce9043f-0de2-45e8-8d16-8780441fb5c2 1073741824 Jun 17 06:01:57 devstack sudo[110494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:01:57 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c12d8960-26a5-4f03-aecd-ca2a83e0db27 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6339486-3175-4f2c-aa8f-4e159df260ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab2147fa-5dec-4681-baae-0f916e211e0a', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:01:57 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c12d8960-26a5-4f03-aecd-ca2a83e0db27 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7898c420-337f-4f51-8d97-d616155b0995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:01:57 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-c12d8960-26a5-4f03-aecd-ca2a83e0db27 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Volume volume-ab2147fa-5dec-4681-baae-0f916e211e0a (ab2147fa-5dec-4681-baae-0f916e211e0a): created successfully Jun 17 06:01:57 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c12d8960-26a5-4f03-aecd-ca2a83e0db27 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7898c420-337f-4f51-8d97-d616155b0995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:01:57 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c12d8960-26a5-4f03-aecd-ca2a83e0db27 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Flow 'volume_create_manager' (78c05289-5bbc-418d-8146-06c33cc58ecc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 06:01:57 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-c12d8960-26a5-4f03-aecd-ca2a83e0db27 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Created volume successfully. Jun 17 06:01:57 devstack sudo[110494]: pam_unix(sudo:session): session closed for user root Jun 17 06:01:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-5492fdee-2ec6-4f08-99fc-93c82b697902 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-5ce9043f-0de2-45e8-8d16-8780441fb5c2 1073741824" returned: 0 in 0.745s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:01:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-5492fdee-2ec6-4f08-99fc-93c82b697902 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-5ce9043f-0de2-45e8-8d16-8780441fb5c2 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:01:57 devstack sudo[110500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-5ce9043f-0de2-45e8-8d16-8780441fb5c2 Jun 17 06:01:57 devstack sudo[110500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:01:58 devstack sudo[110500]: pam_unix(sudo:session): session closed for user root Jun 17 06:01:58 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-5492fdee-2ec6-4f08-99fc-93c82b697902 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-5ce9043f-0de2-45e8-8d16-8780441fb5c2" returned: 0 in 0.582s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:01:58 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-5492fdee-2ec6-4f08-99fc-93c82b697902 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] <== create_volume: return (1365ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 06:01:58 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-5492fdee-2ec6-4f08-99fc-93c82b697902 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.368s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:01:58 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-5492fdee-2ec6-4f08-99fc-93c82b697902 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc5ec003-323b-46e1-a25a-7bc916ed7bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ce9043f-0de2-45e8-8d16-8780441fb5c2', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:01:58 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-5492fdee-2ec6-4f08-99fc-93c82b697902 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (097e8d67-6c52-4c57-bb92-adf0601e34e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:01:58 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-5492fdee-2ec6-4f08-99fc-93c82b697902 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Volume volume-5ce9043f-0de2-45e8-8d16-8780441fb5c2 (5ce9043f-0de2-45e8-8d16-8780441fb5c2): created successfully Jun 17 06:01:58 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-5492fdee-2ec6-4f08-99fc-93c82b697902 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (097e8d67-6c52-4c57-bb92-adf0601e34e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:01:58 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-5492fdee-2ec6-4f08-99fc-93c82b697902 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Flow 'volume_create_manager' (5efb63c7-25df-49ff-a93e-ad526a82a423) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 06:01:58 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-5492fdee-2ec6-4f08-99fc-93c82b697902 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Created volume successfully. Jun 17 06:01:59 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-6bc89255-fa14-4ed4-99a0-421ec47ad763 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Acquiring lock "cinder-5ce9043f-0de2-45e8-8d16-8780441fb5c2-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:01:59 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-6bc89255-fa14-4ed4-99a0-421ec47ad763 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Lock "cinder-5ce9043f-0de2-45e8-8d16-8780441fb5c2-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:01:59 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-6bc89255-fa14-4ed4-99a0-421ec47ad763 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Acquiring lock "cinder-quobyte-5ce9043f-0de2-45e8-8d16-8780441fb5c2" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:01:59 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-6bc89255-fa14-4ed4-99a0-421ec47ad763 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Lock "cinder-quobyte-5ce9043f-0de2-45e8-8d16-8780441fb5c2" acquired by "delete_volume" :: waited 0.018s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:01:59 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed448cb-559d-49d5-ade4-9e15645e7627]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 06:01:59 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6bc89255-fa14-4ed4-99a0-421ec47ad763 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-5ce9043f-0de2-45e8-8d16-8780441fb5c2 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:01:59 devstack sudo[110505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-5ce9043f-0de2-45e8-8d16-8780441fb5c2 Jun 17 06:01:59 devstack sudo[110505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:00 devstack sudo[110505]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:00 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6bc89255-fa14-4ed4-99a0-421ec47ad763 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-5ce9043f-0de2-45e8-8d16-8780441fb5c2" returned: 0 in 0.710s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:00 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6bc89255-fa14-4ed4-99a0-421ec47ad763 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-5ce9043f-0de2-45e8-8d16-8780441fb5c2 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:00 devstack sudo[110511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-5ce9043f-0de2-45e8-8d16-8780441fb5c2 Jun 17 06:02:00 devstack sudo[110511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:00 devstack sudo[110511]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:00 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6bc89255-fa14-4ed4-99a0-421ec47ad763 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-5ce9043f-0de2-45e8-8d16-8780441fb5c2" returned: 0 in 0.581s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:00 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-6bc89255-fa14-4ed4-99a0-421ec47ad763 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Lock "cinder-quobyte-5ce9043f-0de2-45e8-8d16-8780441fb5c2" released by "delete_volume" :: held 1.332s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:02:00 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-6bc89255-fa14-4ed4-99a0-421ec47ad763 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Created reservations ['ff86b403-2ec7-40f8-8a7a-15393c889735', '09b79544-60a6-4b3c-91e1-d86520aab636', '06230639-c353-4ec2-b1f1-7781470fb8e4', 'dad6d86f-fbd0-460b-9591-f548f5287a1b'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 06:02:00 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-6bc89255-fa14-4ed4-99a0-421ec47ad763 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:02:00 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-6bc89255-fa14-4ed4-99a0-421ec47ad763 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:02:00 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-6bc89255-fa14-4ed4-99a0-421ec47ad763 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 06:02:00 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-6bc89255-fa14-4ed4-99a0-421ec47ad763 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 06:02:00 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-6bc89255-fa14-4ed4-99a0-421ec47ad763 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:02:00 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6bc89255-fa14-4ed4-99a0-421ec47ad763 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:00 devstack sudo[110514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 06:02:00 devstack sudo[110514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:01 devstack sudo[110514]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:01 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6bc89255-fa14-4ed4-99a0-421ec47ad763 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.576s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:01 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-6bc89255-fa14-4ed4-99a0-421ec47ad763 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 06:02:01 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-6bc89255-fa14-4ed4-99a0-421ec47ad763 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Deleted volume successfully. Jun 17 06:02:01 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-6bc89255-fa14-4ed4-99a0-421ec47ad763 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Lock "cinder-5ce9043f-0de2-45e8-8d16-8780441fb5c2-delete_volume" released by "delete_volume" :: held 2.094s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:02:01 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-6cc609b8-5a85-4193-9bfd-f7375f4737a1 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Acquiring lock "cinder-ab2147fa-5dec-4681-baae-0f916e211e0a-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:02:01 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-6cc609b8-5a85-4193-9bfd-f7375f4737a1 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Lock "cinder-ab2147fa-5dec-4681-baae-0f916e211e0a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:02:01 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-6cc609b8-5a85-4193-9bfd-f7375f4737a1 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Acquiring lock "cinder-quobyte-ab2147fa-5dec-4681-baae-0f916e211e0a" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:02:01 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-6cc609b8-5a85-4193-9bfd-f7375f4737a1 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Lock "cinder-quobyte-ab2147fa-5dec-4681-baae-0f916e211e0a" acquired by "delete_volume" :: waited 0.014s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:02:01 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf7aae8-f99b-4021-a518-48d3fb5a9ffe]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 06:02:01 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6cc609b8-5a85-4193-9bfd-f7375f4737a1 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ab2147fa-5dec-4681-baae-0f916e211e0a {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:01 devstack sudo[110517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ab2147fa-5dec-4681-baae-0f916e211e0a Jun 17 06:02:01 devstack sudo[110517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:02 devstack sudo[110517]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:02 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6cc609b8-5a85-4193-9bfd-f7375f4737a1 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ab2147fa-5dec-4681-baae-0f916e211e0a" returned: 0 in 0.689s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:02 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6cc609b8-5a85-4193-9bfd-f7375f4737a1 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ab2147fa-5dec-4681-baae-0f916e211e0a {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:02 devstack sudo[110522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ab2147fa-5dec-4681-baae-0f916e211e0a Jun 17 06:02:02 devstack sudo[110522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:02 devstack sudo[110522]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:02 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6cc609b8-5a85-4193-9bfd-f7375f4737a1 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-ab2147fa-5dec-4681-baae-0f916e211e0a" returned: 0 in 0.577s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:02 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-6cc609b8-5a85-4193-9bfd-f7375f4737a1 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Lock "cinder-quobyte-ab2147fa-5dec-4681-baae-0f916e211e0a" released by "delete_volume" :: held 1.304s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:02:02 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-6cc609b8-5a85-4193-9bfd-f7375f4737a1 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Created reservations ['51c0d887-3c25-4965-872e-fa69b1d83156', 'c6efe635-21d0-4a6b-a138-2f86a8fab2ff', 'da69f68c-a2ca-4e58-abe4-0f2353645334', '97c1eacc-e023-4689-b6d5-165cd2b7622c'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 06:02:02 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-6cc609b8-5a85-4193-9bfd-f7375f4737a1 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:02:02 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-6cc609b8-5a85-4193-9bfd-f7375f4737a1 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:02:02 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-6cc609b8-5a85-4193-9bfd-f7375f4737a1 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 06:02:02 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-6cc609b8-5a85-4193-9bfd-f7375f4737a1 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 06:02:02 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-6cc609b8-5a85-4193-9bfd-f7375f4737a1 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:02:02 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6cc609b8-5a85-4193-9bfd-f7375f4737a1 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:02 devstack sudo[110525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 06:02:02 devstack sudo[110525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:03 devstack sudo[110525]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:03 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6cc609b8-5a85-4193-9bfd-f7375f4737a1 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.568s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:03 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-6cc609b8-5a85-4193-9bfd-f7375f4737a1 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 06:02:03 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-6cc609b8-5a85-4193-9bfd-f7375f4737a1 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Deleted volume successfully. Jun 17 06:02:03 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-6cc609b8-5a85-4193-9bfd-f7375f4737a1 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Lock "cinder-ab2147fa-5dec-4681-baae-0f916e211e0a-delete_volume" released by "delete_volume" :: held 2.050s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:02:03 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-2b7c4f21-c374-4f38-9053-ccf7a37e8143 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Acquiring lock "cinder-71a8a5f5-c0b5-4bc3-85d4-9654a5689205-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:02:03 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-2b7c4f21-c374-4f38-9053-ccf7a37e8143 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Lock "cinder-71a8a5f5-c0b5-4bc3-85d4-9654a5689205-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:02:03 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-2b7c4f21-c374-4f38-9053-ccf7a37e8143 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Acquiring lock "cinder-quobyte-71a8a5f5-c0b5-4bc3-85d4-9654a5689205" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:02:03 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-2b7c4f21-c374-4f38-9053-ccf7a37e8143 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Lock "cinder-quobyte-71a8a5f5-c0b5-4bc3-85d4-9654a5689205" acquired by "delete_volume" :: waited 0.015s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:02:03 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd31e1e-b30b-403c-8193-506ef5ad8fc7]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 06:02:03 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-2b7c4f21-c374-4f38-9053-ccf7a37e8143 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-71a8a5f5-c0b5-4bc3-85d4-9654a5689205 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:03 devstack sudo[110528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-71a8a5f5-c0b5-4bc3-85d4-9654a5689205 Jun 17 06:02:03 devstack sudo[110528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:04 devstack sudo[110528]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:04 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-2b7c4f21-c374-4f38-9053-ccf7a37e8143 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-71a8a5f5-c0b5-4bc3-85d4-9654a5689205" returned: 0 in 0.674s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:04 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-2b7c4f21-c374-4f38-9053-ccf7a37e8143 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-71a8a5f5-c0b5-4bc3-85d4-9654a5689205 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:04 devstack sudo[110533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-71a8a5f5-c0b5-4bc3-85d4-9654a5689205 Jun 17 06:02:04 devstack sudo[110533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:04 devstack sudo[110533]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:04 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-2b7c4f21-c374-4f38-9053-ccf7a37e8143 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-71a8a5f5-c0b5-4bc3-85d4-9654a5689205" returned: 0 in 0.571s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:04 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-2b7c4f21-c374-4f38-9053-ccf7a37e8143 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Lock "cinder-quobyte-71a8a5f5-c0b5-4bc3-85d4-9654a5689205" released by "delete_volume" :: held 1.281s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:02:05 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-2b7c4f21-c374-4f38-9053-ccf7a37e8143 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Created reservations ['b60bd411-a6c6-41f6-a15f-45f0815eb62d', 'a5776a5d-71d9-4a55-88e3-e054a78e0e6f', 'ddc0c59b-9d41-4026-9fa0-4e7a7e4cd444', 'e616b2ab-da3c-4e30-a1be-b115d07eb08c'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 06:02:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-2b7c4f21-c374-4f38-9053-ccf7a37e8143 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:02:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-2b7c4f21-c374-4f38-9053-ccf7a37e8143 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:02:05 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-2b7c4f21-c374-4f38-9053-ccf7a37e8143 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 06:02:05 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-2b7c4f21-c374-4f38-9053-ccf7a37e8143 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 06:02:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-2b7c4f21-c374-4f38-9053-ccf7a37e8143 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:02:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-2b7c4f21-c374-4f38-9053-ccf7a37e8143 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:05 devstack sudo[110536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 06:02:05 devstack sudo[110536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:05 devstack sudo[110536]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-2b7c4f21-c374-4f38-9053-ccf7a37e8143 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.577s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:05 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-2b7c4f21-c374-4f38-9053-ccf7a37e8143 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 06:02:05 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-2b7c4f21-c374-4f38-9053-ccf7a37e8143 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Deleted volume successfully. Jun 17 06:02:05 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-2b7c4f21-c374-4f38-9053-ccf7a37e8143 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Lock "cinder-71a8a5f5-c0b5-4bc3-85d4-9654a5689205-delete_volume" released by "delete_volume" :: held 2.039s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:02:05 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-1e658c13-5d72-4f59-b7b5-f8a2fe5b3b8e tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Acquiring lock "cinder-88b49b05-693c-47b0-97a0-b889964a5ada-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:02:05 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-1e658c13-5d72-4f59-b7b5-f8a2fe5b3b8e tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Lock "cinder-88b49b05-693c-47b0-97a0-b889964a5ada-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:02:05 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-1e658c13-5d72-4f59-b7b5-f8a2fe5b3b8e tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Acquiring lock "cinder-quobyte-88b49b05-693c-47b0-97a0-b889964a5ada" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:02:05 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-1e658c13-5d72-4f59-b7b5-f8a2fe5b3b8e tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Lock "cinder-quobyte-88b49b05-693c-47b0-97a0-b889964a5ada" acquired by "delete_volume" :: waited 0.014s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:02:05 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[092d61e0-6962-4a28-9b62-7609f55dc514]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 06:02:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1e658c13-5d72-4f59-b7b5-f8a2fe5b3b8e tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-88b49b05-693c-47b0-97a0-b889964a5ada {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:06 devstack sudo[110539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-88b49b05-693c-47b0-97a0-b889964a5ada Jun 17 06:02:06 devstack sudo[110539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:06 devstack sudo[110539]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1e658c13-5d72-4f59-b7b5-f8a2fe5b3b8e tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-88b49b05-693c-47b0-97a0-b889964a5ada" returned: 0 in 0.671s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1e658c13-5d72-4f59-b7b5-f8a2fe5b3b8e tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-88b49b05-693c-47b0-97a0-b889964a5ada {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:06 devstack sudo[110544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-88b49b05-693c-47b0-97a0-b889964a5ada Jun 17 06:02:06 devstack sudo[110544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:07 devstack sudo[110544]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1e658c13-5d72-4f59-b7b5-f8a2fe5b3b8e tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-88b49b05-693c-47b0-97a0-b889964a5ada" returned: 0 in 0.585s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:07 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-1e658c13-5d72-4f59-b7b5-f8a2fe5b3b8e tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Lock "cinder-quobyte-88b49b05-693c-47b0-97a0-b889964a5ada" released by "delete_volume" :: held 1.294s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:02:07 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-1e658c13-5d72-4f59-b7b5-f8a2fe5b3b8e tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Created reservations ['b372074d-e124-4743-be62-70020c7c7f14', '681e9328-b263-49e3-b898-45ef96410fb7', '7ff4eca3-0e32-41a0-a319-06a8f49ee932', '621ff0c8-e53b-4099-a537-607e32e81b27'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 06:02:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-1e658c13-5d72-4f59-b7b5-f8a2fe5b3b8e tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:02:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-1e658c13-5d72-4f59-b7b5-f8a2fe5b3b8e tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:02:07 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-1e658c13-5d72-4f59-b7b5-f8a2fe5b3b8e tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 06:02:07 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-1e658c13-5d72-4f59-b7b5-f8a2fe5b3b8e tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 06:02:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-1e658c13-5d72-4f59-b7b5-f8a2fe5b3b8e tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:02:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1e658c13-5d72-4f59-b7b5-f8a2fe5b3b8e tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:07 devstack sudo[110547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 06:02:07 devstack sudo[110547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:07 devstack sudo[110547]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1e658c13-5d72-4f59-b7b5-f8a2fe5b3b8e tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.577s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:07 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-1e658c13-5d72-4f59-b7b5-f8a2fe5b3b8e tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 06:02:07 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-1e658c13-5d72-4f59-b7b5-f8a2fe5b3b8e tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Deleted volume successfully. Jun 17 06:02:07 devstack cinder-volume[92083]: DEBUG dbcounter [-] [92083] Writing DB stats cinder:SELECT=51,cinder:UPDATE=73,cinder:INSERT=21,cinder:DELETE=6 {{(pid=92083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 06:02:07 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-1e658c13-5d72-4f59-b7b5-f8a2fe5b3b8e tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Lock "cinder-88b49b05-693c-47b0-97a0-b889964a5ada-delete_volume" released by "delete_volume" :: held 2.044s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:02:08 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-f3d3b2a5-d3c1-455b-9dd4-59a2da29ade0 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Acquiring lock "cinder-fcdfd6fa-f57a-4f2c-b401-98e0e200a0e9-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:02:08 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-f3d3b2a5-d3c1-455b-9dd4-59a2da29ade0 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Lock "cinder-fcdfd6fa-f57a-4f2c-b401-98e0e200a0e9-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:02:08 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-f3d3b2a5-d3c1-455b-9dd4-59a2da29ade0 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Acquiring lock "cinder-quobyte-fcdfd6fa-f57a-4f2c-b401-98e0e200a0e9" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:02:08 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-f3d3b2a5-d3c1-455b-9dd4-59a2da29ade0 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Lock "cinder-quobyte-fcdfd6fa-f57a-4f2c-b401-98e0e200a0e9" acquired by "delete_volume" :: waited 0.014s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:02:08 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f35fa5-1cbb-4491-a3dd-136ee822fdbc]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 06:02:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f3d3b2a5-d3c1-455b-9dd4-59a2da29ade0 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-fcdfd6fa-f57a-4f2c-b401-98e0e200a0e9 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:08 devstack sudo[110550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-fcdfd6fa-f57a-4f2c-b401-98e0e200a0e9 Jun 17 06:02:08 devstack sudo[110550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:08 devstack sudo[110550]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f3d3b2a5-d3c1-455b-9dd4-59a2da29ade0 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-fcdfd6fa-f57a-4f2c-b401-98e0e200a0e9" returned: 0 in 0.696s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f3d3b2a5-d3c1-455b-9dd4-59a2da29ade0 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-fcdfd6fa-f57a-4f2c-b401-98e0e200a0e9 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:08 devstack sudo[110555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-fcdfd6fa-f57a-4f2c-b401-98e0e200a0e9 Jun 17 06:02:08 devstack sudo[110555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:09 devstack sudo[110555]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f3d3b2a5-d3c1-455b-9dd4-59a2da29ade0 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-fcdfd6fa-f57a-4f2c-b401-98e0e200a0e9" returned: 0 in 0.571s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:09 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-f3d3b2a5-d3c1-455b-9dd4-59a2da29ade0 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Lock "cinder-quobyte-fcdfd6fa-f57a-4f2c-b401-98e0e200a0e9" released by "delete_volume" :: held 1.307s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:02:09 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-f3d3b2a5-d3c1-455b-9dd4-59a2da29ade0 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Created reservations ['9f847423-46ad-4048-a4ae-fa59a9e4b09b', 'fcef4270-2c71-443f-8072-ed9cec14afef', 'a513b6e4-317b-4146-be8b-611a77e8df03', '296b17f3-9b5e-4e9d-a8e4-f698b37bf5cc'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 06:02:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-f3d3b2a5-d3c1-455b-9dd4-59a2da29ade0 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:02:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-f3d3b2a5-d3c1-455b-9dd4-59a2da29ade0 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:02:09 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-f3d3b2a5-d3c1-455b-9dd4-59a2da29ade0 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 06:02:09 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-f3d3b2a5-d3c1-455b-9dd4-59a2da29ade0 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 06:02:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-f3d3b2a5-d3c1-455b-9dd4-59a2da29ade0 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:02:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f3d3b2a5-d3c1-455b-9dd4-59a2da29ade0 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:09 devstack sudo[110559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 06:02:09 devstack sudo[110559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:10 devstack sudo[110559]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f3d3b2a5-d3c1-455b-9dd4-59a2da29ade0 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.576s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:10 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-f3d3b2a5-d3c1-455b-9dd4-59a2da29ade0 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 06:02:10 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-f3d3b2a5-d3c1-455b-9dd4-59a2da29ade0 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Deleted volume successfully. Jun 17 06:02:10 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-f3d3b2a5-d3c1-455b-9dd4-59a2da29ade0 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Lock "cinder-fcdfd6fa-f57a-4f2c-b401-98e0e200a0e9-delete_volume" released by "delete_volume" :: held 2.049s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:02:10 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-ab17e522-0692-4e22-ad19-535e5f62c340 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Acquiring lock "cinder-2965d76b-c631-426d-8d1b-1e48b3ae5cbb-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:02:10 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-ab17e522-0692-4e22-ad19-535e5f62c340 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Lock "cinder-2965d76b-c631-426d-8d1b-1e48b3ae5cbb-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:02:10 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-ab17e522-0692-4e22-ad19-535e5f62c340 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Acquiring lock "cinder-quobyte-2965d76b-c631-426d-8d1b-1e48b3ae5cbb" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:02:10 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-ab17e522-0692-4e22-ad19-535e5f62c340 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Lock "cinder-quobyte-2965d76b-c631-426d-8d1b-1e48b3ae5cbb" acquired by "delete_volume" :: waited 0.017s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:02:10 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[883fdcc1-25a0-430a-bbfb-ac7de2b8b985]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 06:02:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ab17e522-0692-4e22-ad19-535e5f62c340 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2965d76b-c631-426d-8d1b-1e48b3ae5cbb {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:10 devstack sudo[110562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2965d76b-c631-426d-8d1b-1e48b3ae5cbb Jun 17 06:02:10 devstack sudo[110562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:11 devstack sudo[110562]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ab17e522-0692-4e22-ad19-535e5f62c340 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2965d76b-c631-426d-8d1b-1e48b3ae5cbb" returned: 0 in 0.688s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ab17e522-0692-4e22-ad19-535e5f62c340 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2965d76b-c631-426d-8d1b-1e48b3ae5cbb {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:11 devstack sudo[110567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2965d76b-c631-426d-8d1b-1e48b3ae5cbb Jun 17 06:02:11 devstack sudo[110567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:11 devstack sudo[110567]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ab17e522-0692-4e22-ad19-535e5f62c340 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-2965d76b-c631-426d-8d1b-1e48b3ae5cbb" returned: 0 in 0.597s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:11 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-ab17e522-0692-4e22-ad19-535e5f62c340 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Lock "cinder-quobyte-2965d76b-c631-426d-8d1b-1e48b3ae5cbb" released by "delete_volume" :: held 1.323s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:02:11 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-ab17e522-0692-4e22-ad19-535e5f62c340 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Created reservations ['e40d652b-7b43-4b98-81e2-89da46accbd8', '50d9e32f-db85-45e0-a4fb-cac9d9fabfe4', '59648a9f-d887-4844-8a9a-78c2379e8e1b', 'bfb7eb63-37ad-43ce-97c2-28a257986e57'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 06:02:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ab17e522-0692-4e22-ad19-535e5f62c340 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:02:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ab17e522-0692-4e22-ad19-535e5f62c340 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:02:11 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ab17e522-0692-4e22-ad19-535e5f62c340 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 06:02:11 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ab17e522-0692-4e22-ad19-535e5f62c340 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 06:02:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ab17e522-0692-4e22-ad19-535e5f62c340 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:02:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ab17e522-0692-4e22-ad19-535e5f62c340 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:11 devstack sudo[110570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 06:02:11 devstack sudo[110570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:12 devstack sudo[110570]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ab17e522-0692-4e22-ad19-535e5f62c340 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.582s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:12 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-ab17e522-0692-4e22-ad19-535e5f62c340 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 06:02:12 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-ab17e522-0692-4e22-ad19-535e5f62c340 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Deleted volume successfully. Jun 17 06:02:12 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-ab17e522-0692-4e22-ad19-535e5f62c340 tempest-CreateVolumesFromSourceVolumeTest-1616447079 None] Lock "cinder-2965d76b-c631-426d-8d1b-1e48b3ae5cbb-delete_volume" released by "delete_volume" :: held 2.081s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:02:16 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 06:02:16 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] Flow 'volume_create_manager' (2c429f2d-5dfc-4149-a9ed-4ca31dc2fc9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 06:02:16 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1eae268-d5d3-4272-96be-b69ab70ad050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:02:16 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1eae268-d5d3-4272-96be-b69ab70ad050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T04:02:17Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cc959da-2c0d-4ecd-8710-0ced450c24b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='311bd4b79b7c4796a46849beea3e4c97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T04:02:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T04:02:17Z,use_quota=True,user_id='5515ecde05fd4cd689479d1659c4eee4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:02:16 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c22b4124-94ae-4112-9a28-bbd746bc38ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:02:16 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c22b4124-94ae-4112-9a28-bbd746bc38ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:02:17 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a46e30b-95d8-4db9-9e4e-9c8b008ef461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:02:17 devstack cinder-volume[92083]: DEBUG cinder.image.glance [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] Creating Keystone auth plugin from conf {{(pid=92083) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 17 06:02:17 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a46e30b-95d8-4db9-9e4e-9c8b008ef461) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5cc959da-2c0d-4ecd-8710-0ced450c24b0', 'volume_name': 'volume-5cc959da-2c0d-4ecd-8710-0ced450c24b0', 'volume_size': 1, 'image_id': 'b8101c92-8992-4e1a-8457-f8fd61e8570b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b8101c92-8992-4e1a-8457-f8fd61e8570b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1ec2e06ff8a37929fadedb23769c0c7b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '311bd4b79b7c4796a46849beea3e4c97', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '259c82f5d165b0716cf5f78cfddc8a05244392eb4f613cc21ead662eab3669195adcd702db0b26814808729e33fad66b7f2dcca5f1181cee5aa688e2b716c061', 'id': 'b8101c92-8992-4e1a-8457-f8fd61e8570b', 'created_at': datetime.datetime(2026, 6, 17, 4, 2, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 4, 2, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b8101c92-8992-4e1a-8457-f8fd61e8570b/file', 'properties': {}}, 'image_service': }' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:02:17 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94ad5330-6289-417a-96cd-ad2816728918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:02:17 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94ad5330-6289-417a-96cd-ad2816728918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:02:17 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2920d72-49f7-45ac-bb1f-9d694b7be595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:02:17 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] Volume 5cc959da-2c0d-4ecd-8710-0ced450c24b0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5cc959da-2c0d-4ecd-8710-0ced450c24b0', 'volume_size': 1, 'image_id': 'b8101c92-8992-4e1a-8457-f8fd61e8570b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b8101c92-8992-4e1a-8457-f8fd61e8570b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1ec2e06ff8a37929fadedb23769c0c7b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '311bd4b79b7c4796a46849beea3e4c97', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '259c82f5d165b0716cf5f78cfddc8a05244392eb4f613cc21ead662eab3669195adcd702db0b26814808729e33fad66b7f2dcca5f1181cee5aa688e2b716c061', 'id': 'b8101c92-8992-4e1a-8457-f8fd61e8570b', 'created_at': datetime.datetime(2026, 6, 17, 4, 2, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 4, 2, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b8101c92-8992-4e1a-8457-f8fd61e8570b/file', 'properties': {}}, 'image_service': } Jun 17 06:02:17 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] Trying to clone 5cc959da-2c0d-4ecd-8710-0ced450c24b0 from image b8101c92-8992-4e1a-8457-f8fd61e8570b at location (None, [{'url': 'file:///opt/stack/data/glance/images/b8101c92-8992-4e1a-8457-f8fd61e8570b', 'metadata': {}}]). {{(pid=92083) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 17 06:02:17 devstack cinder-volume[92083]: DEBUG cinder.image.image_utils [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b8101c92-8992-4e1a-8457-f8fd61e8570b_o93afy74devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=92083) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 17 06:02:17 devstack cinder-volume[92083]: INFO cinder.image.image_utils [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] Image download 0.00 MB at 0.00 MB/s Jun 17 06:02:17 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[993c72d1-e04f-4c75-a1da-06568ade6f30]: (4, 'raw') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 06:02:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b8101c92-8992-4e1a-8457-f8fd61e8570b_o93afy74devstack@QuobyteHD {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:17 devstack sudo[110579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b8101c92-8992-4e1a-8457-f8fd61e8570b_o93afy74devstack@QuobyteHD Jun 17 06:02:17 devstack sudo[110579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:18 devstack sudo[110579]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:18 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b8101c92-8992-4e1a-8457-f8fd61e8570b_o93afy74devstack@QuobyteHD" returned: 0 in 0.650s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:18 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b8101c92-8992-4e1a-8457-f8fd61e8570b_o93afy74devstack@QuobyteHD {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:18 devstack sudo[110583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b8101c92-8992-4e1a-8457-f8fd61e8570b_o93afy74devstack@QuobyteHD Jun 17 06:02:18 devstack sudo[110583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:18 devstack sudo[110583]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:18 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b8101c92-8992-4e1a-8457-f8fd61e8570b_o93afy74devstack@QuobyteHD" returned: 1 in 0.640s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:18 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b8101c92-8992-4e1a-8457-f8fd61e8570b_o93afy74devstack@QuobyteHD' failed. Not Retrying. {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 06:02:18 devstack cinder-volume[92083]: DEBUG cinder.image.image_utils [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] Temporary image b8101c92-8992-4e1a-8457-f8fd61e8570b is fetched for user 5515ecde05fd4cd689479d1659c4eee4. {{(pid=92083) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 17 06:02:18 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94bbfea-f707-4724-8657-7be6b2025275]: (4, 'raw') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 06:02:18 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b8101c92-8992-4e1a-8457-f8fd61e8570b_o93afy74devstack@QuobyteHD {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:18 devstack sudo[110588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b8101c92-8992-4e1a-8457-f8fd61e8570b_o93afy74devstack@QuobyteHD Jun 17 06:02:18 devstack sudo[110588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:19 devstack sudo[110588]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:19 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b8101c92-8992-4e1a-8457-f8fd61e8570b_o93afy74devstack@QuobyteHD" returned: 0 in 0.649s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:19 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b8101c92-8992-4e1a-8457-f8fd61e8570b_o93afy74devstack@QuobyteHD {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:19 devstack sudo[110592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b8101c92-8992-4e1a-8457-f8fd61e8570b_o93afy74devstack@QuobyteHD Jun 17 06:02:19 devstack sudo[110592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:20 devstack sudo[110592]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:20 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b8101c92-8992-4e1a-8457-f8fd61e8570b_o93afy74devstack@QuobyteHD" returned: 1 in 0.639s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:20 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b8101c92-8992-4e1a-8457-f8fd61e8570b_o93afy74devstack@QuobyteHD' failed. Not Retrying. {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 06:02:20 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:02:20 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:02:20 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T04:02:17Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cc959da-2c0d-4ecd-8710-0ced450c24b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='311bd4b79b7c4796a46849beea3e4c97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T04:02:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T04:02:17Z,use_quota=True,user_id='5515ecde05fd4cd689479d1659c4eee4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 06:02:20 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] Creating volume 5cc959da-2c0d-4ecd-8710-0ced450c24b0 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 06:02:20 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:02:20 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:02:20 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 06:02:20 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 06:02:20 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:02:20 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 06:02:20 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 06:02:20 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-5cc959da-2c0d-4ecd-8710-0ced450c24b0 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:20 devstack sudo[110598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-5cc959da-2c0d-4ecd-8710-0ced450c24b0 1073741824 Jun 17 06:02:20 devstack sudo[110598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:20 devstack sudo[110598]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:20 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-5cc959da-2c0d-4ecd-8710-0ced450c24b0 1073741824" returned: 0 in 0.721s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:20 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-5cc959da-2c0d-4ecd-8710-0ced450c24b0 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:20 devstack sudo[110603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-5cc959da-2c0d-4ecd-8710-0ced450c24b0 Jun 17 06:02:20 devstack sudo[110603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:21 devstack sudo[110603]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:21 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-5cc959da-2c0d-4ecd-8710-0ced450c24b0" returned: 0 in 0.576s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:21 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] <== create_volume: return (1335ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 06:02:21 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.339s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:02:21 devstack cinder-volume[92083]: DEBUG cinder.volume.volume_utils [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] Attempting download of b8101c92-8992-4e1a-8457-f8fd61e8570b ((None, [{'url': 'file:///opt/stack/data/glance/images/b8101c92-8992-4e1a-8457-f8fd61e8570b', 'metadata': {}}])) to volume 5cc959da-2c0d-4ecd-8710-0ced450c24b0. {{(pid=92083) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 17 06:02:21 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50a8b75-8156-45ed-b92e-89fd9984ddff]: (4, 'raw') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 06:02:21 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b8101c92-8992-4e1a-8457-f8fd61e8570b_ismarb9q {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:21 devstack sudo[110606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b8101c92-8992-4e1a-8457-f8fd61e8570b_ismarb9q Jun 17 06:02:21 devstack sudo[110606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:22 devstack sudo[110606]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:22 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b8101c92-8992-4e1a-8457-f8fd61e8570b_ismarb9q" returned: 0 in 0.671s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:22 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b8101c92-8992-4e1a-8457-f8fd61e8570b_ismarb9q {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:22 devstack sudo[110610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b8101c92-8992-4e1a-8457-f8fd61e8570b_ismarb9q Jun 17 06:02:22 devstack sudo[110610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:22 devstack sudo[110610]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:22 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b8101c92-8992-4e1a-8457-f8fd61e8570b_ismarb9q" returned: 1 in 0.647s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:22 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b8101c92-8992-4e1a-8457-f8fd61e8570b_ismarb9q' failed. Not Retrying. {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 06:02:22 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c232fe-233c-4736-aacb-d64bb2e6360d]: (4, 'raw') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 06:02:22 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b8101c92-8992-4e1a-8457-f8fd61e8570b_o93afy74devstack@QuobyteHD {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:22 devstack sudo[110614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b8101c92-8992-4e1a-8457-f8fd61e8570b_o93afy74devstack@QuobyteHD Jun 17 06:02:22 devstack sudo[110614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:23 devstack sudo[110614]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:23 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b8101c92-8992-4e1a-8457-f8fd61e8570b_o93afy74devstack@QuobyteHD" returned: 0 in 0.659s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:23 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b8101c92-8992-4e1a-8457-f8fd61e8570b_o93afy74devstack@QuobyteHD {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:23 devstack sudo[110618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b8101c92-8992-4e1a-8457-f8fd61e8570b_o93afy74devstack@QuobyteHD Jun 17 06:02:23 devstack sudo[110618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:24 devstack sudo[110618]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b8101c92-8992-4e1a-8457-f8fd61e8570b_o93afy74devstack@QuobyteHD" returned: 1 in 0.641s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b8101c92-8992-4e1a-8457-f8fd61e8570b_o93afy74devstack@QuobyteHD' failed. Not Retrying. {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 06:02:24 devstack cinder-volume[92083]: DEBUG cinder.image.image_utils [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] b8101c92-8992-4e1a-8457-f8fd61e8570b was raw, converting to raw {{(pid=92083) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 17 06:02:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b8101c92-8992-4e1a-8457-f8fd61e8570b_o93afy74devstack@QuobyteHD /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-5cc959da-2c0d-4ecd-8710-0ced450c24b0 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:24 devstack sudo[110623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b8101c92-8992-4e1a-8457-f8fd61e8570b_o93afy74devstack@QuobyteHD /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-5cc959da-2c0d-4ecd-8710-0ced450c24b0 Jun 17 06:02:24 devstack sudo[110623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:24 devstack sudo[110623]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b8101c92-8992-4e1a-8457-f8fd61e8570b_o93afy74devstack@QuobyteHD /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-5cc959da-2c0d-4ecd-8710-0ced450c24b0" returned: 0 in 0.652s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:24 devstack cinder-volume[92083]: DEBUG cinder.image.image_utils [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b8101c92-8992-4e1a-8457-f8fd61e8570b_o93afy74devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-5cc959da-2c0d-4ecd-8710-0ced450c24b0 {{(pid=92083) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 17 06:02:24 devstack cinder-volume[92083]: INFO cinder.image.image_utils [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] Converted 0.00 MB image at 0.00 MB/s Jun 17 06:02:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-5cc959da-2c0d-4ecd-8710-0ced450c24b0 1G {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:24 devstack sudo[110628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-5cc959da-2c0d-4ecd-8710-0ced450c24b0 1G Jun 17 06:02:24 devstack sudo[110628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:25 devstack sudo[110628]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-5cc959da-2c0d-4ecd-8710-0ced450c24b0 1G" returned: 0 in 0.598s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:25 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a1349b-5ba3-4362-a6c2-4125b74cbc93]: (4, 'raw') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 06:02:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-5cc959da-2c0d-4ecd-8710-0ced450c24b0 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:25 devstack sudo[110633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-5cc959da-2c0d-4ecd-8710-0ced450c24b0 Jun 17 06:02:25 devstack sudo[110633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:26 devstack sudo[110633]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:26 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-5cc959da-2c0d-4ecd-8710-0ced450c24b0" returned: 0 in 0.667s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:26 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-5cc959da-2c0d-4ecd-8710-0ced450c24b0 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:26 devstack sudo[110637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-5cc959da-2c0d-4ecd-8710-0ced450c24b0 Jun 17 06:02:26 devstack sudo[110637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:26 devstack sudo[110637]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:26 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-5cc959da-2c0d-4ecd-8710-0ced450c24b0" returned: 1 in 0.675s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:26 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-5cc959da-2c0d-4ecd-8710-0ced450c24b0' failed. Not Retrying. {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 06:02:26 devstack cinder-volume[92083]: DEBUG cinder.volume.volume_utils [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] Downloaded image b8101c92-8992-4e1a-8457-f8fd61e8570b ((None, [{'url': 'file:///opt/stack/data/glance/images/b8101c92-8992-4e1a-8457-f8fd61e8570b', 'metadata': {}}])) to volume 5cc959da-2c0d-4ecd-8710-0ced450c24b0 successfully. {{(pid=92083) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 17 06:02:26 devstack cinder-volume[92083]: DEBUG cinder.image.image_utils [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] Temporary image b8101c92-8992-4e1a-8457-f8fd61e8570b for user 5515ecde05fd4cd689479d1659c4eee4 is deleted. {{(pid=92083) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 17 06:02:26 devstack cinder-volume[92083]: DEBUG cinder.volume.volume_utils [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] Marking volume 5cc959da-2c0d-4ecd-8710-0ced450c24b0 as bootable. {{(pid=92083) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 17 06:02:26 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] Copying metadata from image b8101c92-8992-4e1a-8457-f8fd61e8570b to 5cc959da-2c0d-4ecd-8710-0ced450c24b0. {{(pid=92083) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 17 06:02:26 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] Creating volume glance metadata for volume 5cc959da-2c0d-4ecd-8710-0ced450c24b0 backed by image b8101c92-8992-4e1a-8457-f8fd61e8570b with: {'image_id': 'b8101c92-8992-4e1a-8457-f8fd61e8570b', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '1ec2e06ff8a37929fadedb23769c0c7b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=92083) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 17 06:02:26 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2920d72-49f7-45ac-bb1f-9d694b7be595) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cc959da-2c0d-4ecd-8710-0ced450c24b0', 'volume_size': 1, 'image_id': 'b8101c92-8992-4e1a-8457-f8fd61e8570b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b8101c92-8992-4e1a-8457-f8fd61e8570b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1ec2e06ff8a37929fadedb23769c0c7b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '311bd4b79b7c4796a46849beea3e4c97', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '259c82f5d165b0716cf5f78cfddc8a05244392eb4f613cc21ead662eab3669195adcd702db0b26814808729e33fad66b7f2dcca5f1181cee5aa688e2b716c061', 'id': 'b8101c92-8992-4e1a-8457-f8fd61e8570b', 'created_at': datetime.datetime(2026, 6, 17, 4, 2, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 4, 2, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b8101c92-8992-4e1a-8457-f8fd61e8570b/file', 'properties': {}}, 'image_service': }' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:02:26 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a368ffcf-8ed0-47ec-8b3f-97b90938a6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:02:26 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] Volume volume-5cc959da-2c0d-4ecd-8710-0ced450c24b0 (5cc959da-2c0d-4ecd-8710-0ced450c24b0): created successfully Jun 17 06:02:26 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a368ffcf-8ed0-47ec-8b3f-97b90938a6ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:02:26 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] Flow 'volume_create_manager' (2c429f2d-5dfc-4149-a9ed-4ca31dc2fc9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 06:02:26 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-4f0add2c-5aef-4754-a07a-bff1e982cc64 tempest-VolumeImageDependencyTests-1695198113 None] Created volume successfully. Jun 17 06:02:27 devstack cinder-volume[92083]: DEBUG oslo_service.periodic_task [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92083) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 06:02:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:02:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:02:27 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 06:02:27 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 06:02:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:02:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:27 devstack sudo[110642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 06:02:27 devstack sudo[110642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:27 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-af34ccfb-33cc-4213-88ff-eb43971287d4 tempest-VolumeImageDependencyTests-1695198113 None] Acquiring lock "cinder-5cc959da-2c0d-4ecd-8710-0ced450c24b0-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:02:27 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-af34ccfb-33cc-4213-88ff-eb43971287d4 tempest-VolumeImageDependencyTests-1695198113 None] Lock "cinder-5cc959da-2c0d-4ecd-8710-0ced450c24b0-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:02:27 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-af34ccfb-33cc-4213-88ff-eb43971287d4 tempest-VolumeImageDependencyTests-1695198113 None] Acquiring lock "cinder-quobyte-5cc959da-2c0d-4ecd-8710-0ced450c24b0" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:02:27 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-af34ccfb-33cc-4213-88ff-eb43971287d4 tempest-VolumeImageDependencyTests-1695198113 None] Lock "cinder-quobyte-5cc959da-2c0d-4ecd-8710-0ced450c24b0" acquired by "delete_volume" :: waited 0.013s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:02:27 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2d5ca7-f64d-4834-b5db-59e8071f04fb]: (4, 'raw') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 06:02:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-af34ccfb-33cc-4213-88ff-eb43971287d4 tempest-VolumeImageDependencyTests-1695198113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-5cc959da-2c0d-4ecd-8710-0ced450c24b0 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:28 devstack sudo[110644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-5cc959da-2c0d-4ecd-8710-0ced450c24b0 Jun 17 06:02:28 devstack sudo[110644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:28 devstack sudo[110642]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.623s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:28 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 06:02:28 devstack cinder-volume[92083]: DEBUG oslo_service.periodic_task [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running periodic task VolumeManager._thread_info {{(pid=92083) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 06:02:28 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] thread count: 28 {{(pid=92083) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 17 06:02:28 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] thread info: [<_MainThread(MainThread, started 133483869905024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92083) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 17 06:02:28 devstack sudo[110644]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-af34ccfb-33cc-4213-88ff-eb43971287d4 tempest-VolumeImageDependencyTests-1695198113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-5cc959da-2c0d-4ecd-8710-0ced450c24b0" returned: 0 in 0.689s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-af34ccfb-33cc-4213-88ff-eb43971287d4 tempest-VolumeImageDependencyTests-1695198113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-5cc959da-2c0d-4ecd-8710-0ced450c24b0 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:28 devstack sudo[110650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-5cc959da-2c0d-4ecd-8710-0ced450c24b0 Jun 17 06:02:28 devstack sudo[110650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:29 devstack sudo[110650]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:29 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-af34ccfb-33cc-4213-88ff-eb43971287d4 tempest-VolumeImageDependencyTests-1695198113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-5cc959da-2c0d-4ecd-8710-0ced450c24b0" returned: 1 in 0.682s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:29 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-af34ccfb-33cc-4213-88ff-eb43971287d4 tempest-VolumeImageDependencyTests-1695198113 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-5cc959da-2c0d-4ecd-8710-0ced450c24b0' failed. Not Retrying. {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 06:02:29 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-af34ccfb-33cc-4213-88ff-eb43971287d4 tempest-VolumeImageDependencyTests-1695198113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-5cc959da-2c0d-4ecd-8710-0ced450c24b0 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:29 devstack sudo[110655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-5cc959da-2c0d-4ecd-8710-0ced450c24b0 Jun 17 06:02:29 devstack sudo[110655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:29 devstack sudo[110655]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:29 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-af34ccfb-33cc-4213-88ff-eb43971287d4 tempest-VolumeImageDependencyTests-1695198113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-5cc959da-2c0d-4ecd-8710-0ced450c24b0" returned: 0 in 0.570s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:29 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-af34ccfb-33cc-4213-88ff-eb43971287d4 tempest-VolumeImageDependencyTests-1695198113 None] Lock "cinder-quobyte-5cc959da-2c0d-4ecd-8710-0ced450c24b0" released by "delete_volume" :: held 2.004s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:02:29 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-af34ccfb-33cc-4213-88ff-eb43971287d4 tempest-VolumeImageDependencyTests-1695198113 None] Created reservations ['e0c8894b-4662-45a2-aca7-54e50610e5e4', '7c5033d3-ec19-4bc7-9ebd-5ce64fcf6952', '202eeb17-6abc-4df6-967a-3f5a245e9eb3', '681745e1-564e-420c-be08-5218881be463'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 06:02:29 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-af34ccfb-33cc-4213-88ff-eb43971287d4 tempest-VolumeImageDependencyTests-1695198113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:02:29 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-af34ccfb-33cc-4213-88ff-eb43971287d4 tempest-VolumeImageDependencyTests-1695198113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:02:29 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-af34ccfb-33cc-4213-88ff-eb43971287d4 tempest-VolumeImageDependencyTests-1695198113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 06:02:29 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-af34ccfb-33cc-4213-88ff-eb43971287d4 tempest-VolumeImageDependencyTests-1695198113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 06:02:29 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-af34ccfb-33cc-4213-88ff-eb43971287d4 tempest-VolumeImageDependencyTests-1695198113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:02:29 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-af34ccfb-33cc-4213-88ff-eb43971287d4 tempest-VolumeImageDependencyTests-1695198113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:30 devstack sudo[110659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 06:02:30 devstack sudo[110659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:30 devstack sudo[110659]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:30 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-af34ccfb-33cc-4213-88ff-eb43971287d4 tempest-VolumeImageDependencyTests-1695198113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.619s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:30 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-af34ccfb-33cc-4213-88ff-eb43971287d4 tempest-VolumeImageDependencyTests-1695198113 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 06:02:30 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-af34ccfb-33cc-4213-88ff-eb43971287d4 tempest-VolumeImageDependencyTests-1695198113 None] Deleted volume successfully. Jun 17 06:02:30 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-af34ccfb-33cc-4213-88ff-eb43971287d4 tempest-VolumeImageDependencyTests-1695198113 None] Lock "cinder-5cc959da-2c0d-4ecd-8710-0ced450c24b0-delete_volume" released by "delete_volume" :: held 2.810s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:02:39 devstack cinder-volume[92083]: DEBUG dbcounter [-] [92083] Writing DB stats cinder:SELECT=25,cinder:INSERT=15,cinder:UPDATE=33 {{(pid=92083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 06:02:40 devstack cinder-volume[92083]: DEBUG dbcounter [-] [92083] Writing DB stats cinder:SELECT=54,cinder:UPDATE=74,cinder:INSERT=13,cinder:DELETE=9 {{(pid=92083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 06:02:41 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c143b2b-c982-492d-9cdc-0d3fe412b53e tempest-CinderUnicodeTest-1598248645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 06:02:41 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1c143b2b-c982-492d-9cdc-0d3fe412b53e tempest-CinderUnicodeTest-1598248645 None] Flow 'volume_create_manager' (f9037f29-ef0c-460b-9b3b-e6f57b704055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 06:02:41 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1c143b2b-c982-492d-9cdc-0d3fe412b53e tempest-CinderUnicodeTest-1598248645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7ff93e0-64ad-4fb9-b12b-bcc66c328ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:02:41 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1c143b2b-c982-492d-9cdc-0d3fe412b53e tempest-CinderUnicodeTest-1598248645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7ff93e0-64ad-4fb9-b12b-bcc66c328ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T04:02:41Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1254f3f-ef13-41e5-bf81-012ec7fc515b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc021ae6be424da1bf35af275363547c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T04:02:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T04:02:42Z,use_quota=True,user_id='409662ee335b4a0db434c806c6fbfbbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:02:41 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1c143b2b-c982-492d-9cdc-0d3fe412b53e tempest-CinderUnicodeTest-1598248645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d320aa5-f691-4628-a30f-55c895cedae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:02:41 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1c143b2b-c982-492d-9cdc-0d3fe412b53e tempest-CinderUnicodeTest-1598248645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d320aa5-f691-4628-a30f-55c895cedae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:02:41 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1c143b2b-c982-492d-9cdc-0d3fe412b53e tempest-CinderUnicodeTest-1598248645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c22e28c5-bc67-46aa-9d58-b89c7c99b39d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:02:41 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1c143b2b-c982-492d-9cdc-0d3fe412b53e tempest-CinderUnicodeTest-1598248645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c22e28c5-bc67-46aa-9d58-b89c7c99b39d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1254f3f-ef13-41e5-bf81-012ec7fc515b', 'volume_name': 'volume-c1254f3f-ef13-41e5-bf81-012ec7fc515b', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:02:41 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1c143b2b-c982-492d-9cdc-0d3fe412b53e tempest-CinderUnicodeTest-1598248645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32815c27-630b-497a-88df-d8d3527e3dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:02:41 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1c143b2b-c982-492d-9cdc-0d3fe412b53e tempest-CinderUnicodeTest-1598248645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32815c27-630b-497a-88df-d8d3527e3dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:02:41 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1c143b2b-c982-492d-9cdc-0d3fe412b53e tempest-CinderUnicodeTest-1598248645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39501ea5-6c30-45c3-ab8c-80226c018e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:02:41 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-1c143b2b-c982-492d-9cdc-0d3fe412b53e tempest-CinderUnicodeTest-1598248645 None] Volume c1254f3f-ef13-41e5-bf81-012ec7fc515b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1254f3f-ef13-41e5-bf81-012ec7fc515b', 'volume_size': 1} Jun 17 06:02:41 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-1c143b2b-c982-492d-9cdc-0d3fe412b53e tempest-CinderUnicodeTest-1598248645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:02:41 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-1c143b2b-c982-492d-9cdc-0d3fe412b53e tempest-CinderUnicodeTest-1598248645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:02:41 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-1c143b2b-c982-492d-9cdc-0d3fe412b53e tempest-CinderUnicodeTest-1598248645 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T04:02:41Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1254f3f-ef13-41e5-bf81-012ec7fc515b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc021ae6be424da1bf35af275363547c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T04:02:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T04:02:42Z,use_quota=True,user_id='409662ee335b4a0db434c806c6fbfbbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 06:02:41 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-1c143b2b-c982-492d-9cdc-0d3fe412b53e tempest-CinderUnicodeTest-1598248645 None] Creating volume c1254f3f-ef13-41e5-bf81-012ec7fc515b {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 06:02:41 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-1c143b2b-c982-492d-9cdc-0d3fe412b53e tempest-CinderUnicodeTest-1598248645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:02:41 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-1c143b2b-c982-492d-9cdc-0d3fe412b53e tempest-CinderUnicodeTest-1598248645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:02:41 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-1c143b2b-c982-492d-9cdc-0d3fe412b53e tempest-CinderUnicodeTest-1598248645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 06:02:41 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-1c143b2b-c982-492d-9cdc-0d3fe412b53e tempest-CinderUnicodeTest-1598248645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 06:02:41 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-1c143b2b-c982-492d-9cdc-0d3fe412b53e tempest-CinderUnicodeTest-1598248645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:02:41 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-1c143b2b-c982-492d-9cdc-0d3fe412b53e tempest-CinderUnicodeTest-1598248645 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 06:02:41 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-1c143b2b-c982-492d-9cdc-0d3fe412b53e tempest-CinderUnicodeTest-1598248645 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 06:02:41 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1c143b2b-c982-492d-9cdc-0d3fe412b53e tempest-CinderUnicodeTest-1598248645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c1254f3f-ef13-41e5-bf81-012ec7fc515b 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:41 devstack sudo[110740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c1254f3f-ef13-41e5-bf81-012ec7fc515b 1073741824 Jun 17 06:02:41 devstack sudo[110740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:41 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fe11078-9b5e-4206-b7ae-c1f381c38a13 tempest-CreateVolumesFromImageTest-831885656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 06:02:41 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1fe11078-9b5e-4206-b7ae-c1f381c38a13 tempest-CreateVolumesFromImageTest-831885656 None] Flow 'volume_create_manager' (81526917-713d-4db8-837f-7eacbc5010cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 06:02:42 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1fe11078-9b5e-4206-b7ae-c1f381c38a13 tempest-CreateVolumesFromImageTest-831885656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62c28eae-bbb0-4662-98fd-d143fb794507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:02:42 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1fe11078-9b5e-4206-b7ae-c1f381c38a13 tempest-CreateVolumesFromImageTest-831885656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62c28eae-bbb0-4662-98fd-d143fb794507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T04:02:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-577005219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ab6b0fc-7c1d-4714-9d5f-789834badb66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2473f72568fe46b082c1b09c11b2139e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T04:02:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T04:02:42Z,use_quota=True,user_id='ec43e8dc7ff041a08f42c908297808e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:02:42 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1fe11078-9b5e-4206-b7ae-c1f381c38a13 tempest-CreateVolumesFromImageTest-831885656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83c224a3-c2f7-4661-b539-038f8af5b1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:02:42 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1fe11078-9b5e-4206-b7ae-c1f381c38a13 tempest-CreateVolumesFromImageTest-831885656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83c224a3-c2f7-4661-b539-038f8af5b1cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:02:42 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1fe11078-9b5e-4206-b7ae-c1f381c38a13 tempest-CreateVolumesFromImageTest-831885656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64df937c-d10f-4904-9d14-1412ee1f9ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:02:42 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1fe11078-9b5e-4206-b7ae-c1f381c38a13 tempest-CreateVolumesFromImageTest-831885656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64df937c-d10f-4904-9d14-1412ee1f9ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ab6b0fc-7c1d-4714-9d5f-789834badb66', 'volume_name': 'volume-6ab6b0fc-7c1d-4714-9d5f-789834badb66', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:02:42 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1fe11078-9b5e-4206-b7ae-c1f381c38a13 tempest-CreateVolumesFromImageTest-831885656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4abca0f8-7001-422a-815e-7f42fab3b77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:02:42 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1fe11078-9b5e-4206-b7ae-c1f381c38a13 tempest-CreateVolumesFromImageTest-831885656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4abca0f8-7001-422a-815e-7f42fab3b77a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:02:42 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1fe11078-9b5e-4206-b7ae-c1f381c38a13 tempest-CreateVolumesFromImageTest-831885656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d52e798c-cdfe-44e8-ad52-071956025336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:02:42 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-1fe11078-9b5e-4206-b7ae-c1f381c38a13 tempest-CreateVolumesFromImageTest-831885656 None] Volume 6ab6b0fc-7c1d-4714-9d5f-789834badb66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ab6b0fc-7c1d-4714-9d5f-789834badb66', 'volume_size': 1} Jun 17 06:02:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-1fe11078-9b5e-4206-b7ae-c1f381c38a13 tempest-CreateVolumesFromImageTest-831885656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:02:42 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2f4ba1c-5a52-4b4b-a849-da9a1dbbfaf8 tempest-CreateVolumesFromImageTest-831885656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 06:02:42 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a2f4ba1c-5a52-4b4b-a849-da9a1dbbfaf8 tempest-CreateVolumesFromImageTest-831885656 None] Flow 'volume_create_manager' (5d45996c-edd7-49a8-910d-c7eb7e934c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 06:02:42 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a2f4ba1c-5a52-4b4b-a849-da9a1dbbfaf8 tempest-CreateVolumesFromImageTest-831885656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bd1ca9e-0728-42e5-a0cd-88616bdb2824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:02:42 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a2f4ba1c-5a52-4b4b-a849-da9a1dbbfaf8 tempest-CreateVolumesFromImageTest-831885656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bd1ca9e-0728-42e5-a0cd-88616bdb2824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T04:02:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-562893054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=471f2815-c7e9-4e2f-aa17-49b943112e03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2473f72568fe46b082c1b09c11b2139e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T04:02:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T04:02:42Z,use_quota=True,user_id='ec43e8dc7ff041a08f42c908297808e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:02:42 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a2f4ba1c-5a52-4b4b-a849-da9a1dbbfaf8 tempest-CreateVolumesFromImageTest-831885656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa4b88c3-e5d9-42dd-9402-5aa3772dda2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:02:42 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a2f4ba1c-5a52-4b4b-a849-da9a1dbbfaf8 tempest-CreateVolumesFromImageTest-831885656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa4b88c3-e5d9-42dd-9402-5aa3772dda2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:02:42 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a2f4ba1c-5a52-4b4b-a849-da9a1dbbfaf8 tempest-CreateVolumesFromImageTest-831885656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a467606-8730-4f93-9fab-a6cc2d3bdafa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:02:42 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a2f4ba1c-5a52-4b4b-a849-da9a1dbbfaf8 tempest-CreateVolumesFromImageTest-831885656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a467606-8730-4f93-9fab-a6cc2d3bdafa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '471f2815-c7e9-4e2f-aa17-49b943112e03', 'volume_name': 'volume-471f2815-c7e9-4e2f-aa17-49b943112e03', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:02:42 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a2f4ba1c-5a52-4b4b-a849-da9a1dbbfaf8 tempest-CreateVolumesFromImageTest-831885656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41bf2f18-315b-4b7f-85e5-a7d411d8d202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:02:42 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a2f4ba1c-5a52-4b4b-a849-da9a1dbbfaf8 tempest-CreateVolumesFromImageTest-831885656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41bf2f18-315b-4b7f-85e5-a7d411d8d202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:02:42 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a2f4ba1c-5a52-4b4b-a849-da9a1dbbfaf8 tempest-CreateVolumesFromImageTest-831885656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05ce59db-8441-4825-af62-f0bc425ee7f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:02:42 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-a2f4ba1c-5a52-4b4b-a849-da9a1dbbfaf8 tempest-CreateVolumesFromImageTest-831885656 None] Volume 471f2815-c7e9-4e2f-aa17-49b943112e03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-471f2815-c7e9-4e2f-aa17-49b943112e03', 'volume_size': 1} Jun 17 06:02:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-a2f4ba1c-5a52-4b4b-a849-da9a1dbbfaf8 tempest-CreateVolumesFromImageTest-831885656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:02:42 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d21b23a-e2b7-4ddf-a1e1-2138090fc592 tempest-CreateVolumesFromSnapshotTest-309904984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 06:02:42 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-3d21b23a-e2b7-4ddf-a1e1-2138090fc592 tempest-CreateVolumesFromSnapshotTest-309904984 None] Flow 'volume_create_manager' (c75a588f-e31b-451b-b3ed-c2368259a1ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 06:02:42 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-3d21b23a-e2b7-4ddf-a1e1-2138090fc592 tempest-CreateVolumesFromSnapshotTest-309904984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07bff14a-aed2-4b88-ad63-29433b050d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:02:42 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-3d21b23a-e2b7-4ddf-a1e1-2138090fc592 tempest-CreateVolumesFromSnapshotTest-309904984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07bff14a-aed2-4b88-ad63-29433b050d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T04:02:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-287501817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be813a23-b798-4f1d-9217-614239ea1735,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec2a339a1c5349309d139acd7586d036',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T04:02:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T04:02:43Z,use_quota=True,user_id='59f6ed0a529b4a3fa4f275ebe7bbb708',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:02:42 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-3d21b23a-e2b7-4ddf-a1e1-2138090fc592 tempest-CreateVolumesFromSnapshotTest-309904984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eb1d598-0a57-4e51-b861-cb4e6318bced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:02:42 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-3d21b23a-e2b7-4ddf-a1e1-2138090fc592 tempest-CreateVolumesFromSnapshotTest-309904984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eb1d598-0a57-4e51-b861-cb4e6318bced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:02:42 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-3d21b23a-e2b7-4ddf-a1e1-2138090fc592 tempest-CreateVolumesFromSnapshotTest-309904984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (017eaca1-f571-417d-8ae1-7ce4a67e14b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:02:42 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-3d21b23a-e2b7-4ddf-a1e1-2138090fc592 tempest-CreateVolumesFromSnapshotTest-309904984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (017eaca1-f571-417d-8ae1-7ce4a67e14b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be813a23-b798-4f1d-9217-614239ea1735', 'volume_name': 'volume-be813a23-b798-4f1d-9217-614239ea1735', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:02:42 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-3d21b23a-e2b7-4ddf-a1e1-2138090fc592 tempest-CreateVolumesFromSnapshotTest-309904984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfdb1f19-b249-4ee7-97ae-69bf7c124147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:02:42 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-3d21b23a-e2b7-4ddf-a1e1-2138090fc592 tempest-CreateVolumesFromSnapshotTest-309904984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfdb1f19-b249-4ee7-97ae-69bf7c124147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:02:42 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-3d21b23a-e2b7-4ddf-a1e1-2138090fc592 tempest-CreateVolumesFromSnapshotTest-309904984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b736669-848a-4ccc-844c-70ea3458dd75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:02:42 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-3d21b23a-e2b7-4ddf-a1e1-2138090fc592 tempest-CreateVolumesFromSnapshotTest-309904984 None] Volume be813a23-b798-4f1d-9217-614239ea1735: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be813a23-b798-4f1d-9217-614239ea1735', 'volume_size': 1} Jun 17 06:02:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-3d21b23a-e2b7-4ddf-a1e1-2138090fc592 tempest-CreateVolumesFromSnapshotTest-309904984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:02:42 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5c98fba-d191-4fca-98bd-46829d59d047 tempest-CreateVolumesFromImageTest-831885656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 06:02:42 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b5c98fba-d191-4fca-98bd-46829d59d047 tempest-CreateVolumesFromImageTest-831885656 None] Flow 'volume_create_manager' (9e6c2f1d-ec03-40ac-a6ac-30c6ef51b9c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 06:02:42 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b5c98fba-d191-4fca-98bd-46829d59d047 tempest-CreateVolumesFromImageTest-831885656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd126d5b-802b-46f4-877e-23653d9c66e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:02:42 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b5c98fba-d191-4fca-98bd-46829d59d047 tempest-CreateVolumesFromImageTest-831885656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd126d5b-802b-46f4-877e-23653d9c66e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T04:02:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1879556079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ac09bfa-2a4b-4bfe-9213-dd9e871c8898,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2473f72568fe46b082c1b09c11b2139e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T04:02:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T04:02:43Z,use_quota=True,user_id='ec43e8dc7ff041a08f42c908297808e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:02:42 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b5c98fba-d191-4fca-98bd-46829d59d047 tempest-CreateVolumesFromImageTest-831885656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (016891ef-b2b2-4283-bcfc-a5b5e93f67c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:02:42 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b5c98fba-d191-4fca-98bd-46829d59d047 tempest-CreateVolumesFromImageTest-831885656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (016891ef-b2b2-4283-bcfc-a5b5e93f67c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:02:42 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b5c98fba-d191-4fca-98bd-46829d59d047 tempest-CreateVolumesFromImageTest-831885656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (736e2892-c6de-4581-ae70-3d323ae67009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:02:42 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b5c98fba-d191-4fca-98bd-46829d59d047 tempest-CreateVolumesFromImageTest-831885656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (736e2892-c6de-4581-ae70-3d323ae67009) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ac09bfa-2a4b-4bfe-9213-dd9e871c8898', 'volume_name': 'volume-0ac09bfa-2a4b-4bfe-9213-dd9e871c8898', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:02:42 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b5c98fba-d191-4fca-98bd-46829d59d047 tempest-CreateVolumesFromImageTest-831885656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6de3906a-6a82-44c4-a351-8c0aa7167523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:02:42 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b5c98fba-d191-4fca-98bd-46829d59d047 tempest-CreateVolumesFromImageTest-831885656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6de3906a-6a82-44c4-a351-8c0aa7167523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:02:42 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b5c98fba-d191-4fca-98bd-46829d59d047 tempest-CreateVolumesFromImageTest-831885656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da6434e8-5434-48d0-82a3-feb03e058e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:02:42 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-b5c98fba-d191-4fca-98bd-46829d59d047 tempest-CreateVolumesFromImageTest-831885656 None] Volume 0ac09bfa-2a4b-4bfe-9213-dd9e871c8898: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ac09bfa-2a4b-4bfe-9213-dd9e871c8898', 'volume_size': 1} Jun 17 06:02:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-b5c98fba-d191-4fca-98bd-46829d59d047 tempest-CreateVolumesFromImageTest-831885656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:02:43 devstack sudo[110740]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:43 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1c143b2b-c982-492d-9cdc-0d3fe412b53e tempest-CinderUnicodeTest-1598248645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c1254f3f-ef13-41e5-bf81-012ec7fc515b 1073741824" returned: 0 in 1.300s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:43 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1c143b2b-c982-492d-9cdc-0d3fe412b53e tempest-CinderUnicodeTest-1598248645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c1254f3f-ef13-41e5-bf81-012ec7fc515b {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:43 devstack sudo[110745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c1254f3f-ef13-41e5-bf81-012ec7fc515b Jun 17 06:02:43 devstack sudo[110745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:43 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-7403ab9e-04db-49fc-a0fa-757c056b0da9 tempest-CreateVolumesFromImageTest-831885656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 06:02:43 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-7403ab9e-04db-49fc-a0fa-757c056b0da9 tempest-CreateVolumesFromImageTest-831885656 None] Flow 'volume_create_manager' (56fb5259-1709-4d62-ab07-c6060cee13a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 06:02:43 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-7403ab9e-04db-49fc-a0fa-757c056b0da9 tempest-CreateVolumesFromImageTest-831885656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6142b5c8-cd19-4882-b8d8-5f74d010bdd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:02:43 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-7403ab9e-04db-49fc-a0fa-757c056b0da9 tempest-CreateVolumesFromImageTest-831885656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6142b5c8-cd19-4882-b8d8-5f74d010bdd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T04:02:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2076321054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=051fa7d8-d607-454c-9270-4cc2b78ed1c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2473f72568fe46b082c1b09c11b2139e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T04:02:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T04:02:43Z,use_quota=True,user_id='ec43e8dc7ff041a08f42c908297808e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:02:43 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-7403ab9e-04db-49fc-a0fa-757c056b0da9 tempest-CreateVolumesFromImageTest-831885656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fb9d2d9-b77d-4fcd-9df8-3a89adbc8201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:02:43 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-7403ab9e-04db-49fc-a0fa-757c056b0da9 tempest-CreateVolumesFromImageTest-831885656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fb9d2d9-b77d-4fcd-9df8-3a89adbc8201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:02:43 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-7403ab9e-04db-49fc-a0fa-757c056b0da9 tempest-CreateVolumesFromImageTest-831885656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd96f215-5b31-4ca0-b733-6df899c45323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:02:43 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-7403ab9e-04db-49fc-a0fa-757c056b0da9 tempest-CreateVolumesFromImageTest-831885656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd96f215-5b31-4ca0-b733-6df899c45323) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '051fa7d8-d607-454c-9270-4cc2b78ed1c6', 'volume_name': 'volume-051fa7d8-d607-454c-9270-4cc2b78ed1c6', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:02:43 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-7403ab9e-04db-49fc-a0fa-757c056b0da9 tempest-CreateVolumesFromImageTest-831885656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b816673c-c5c0-455c-894a-36f8f893a580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:02:43 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-7403ab9e-04db-49fc-a0fa-757c056b0da9 tempest-CreateVolumesFromImageTest-831885656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b816673c-c5c0-455c-894a-36f8f893a580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:02:43 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-7403ab9e-04db-49fc-a0fa-757c056b0da9 tempest-CreateVolumesFromImageTest-831885656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b493f0b-6639-4966-bb07-484b1ab347b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:02:43 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-7403ab9e-04db-49fc-a0fa-757c056b0da9 tempest-CreateVolumesFromImageTest-831885656 None] Volume 051fa7d8-d607-454c-9270-4cc2b78ed1c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-051fa7d8-d607-454c-9270-4cc2b78ed1c6', 'volume_size': 1} Jun 17 06:02:43 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-7403ab9e-04db-49fc-a0fa-757c056b0da9 tempest-CreateVolumesFromImageTest-831885656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:02:43 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9c350c6-3fb0-464e-865d-2970e18b044d tempest-CreateVolumesFromImageTest-831885656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 06:02:43 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c9c350c6-3fb0-464e-865d-2970e18b044d tempest-CreateVolumesFromImageTest-831885656 None] Flow 'volume_create_manager' (3f9ac2c9-0ed9-4a2b-9017-3b5111477ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 06:02:43 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c9c350c6-3fb0-464e-865d-2970e18b044d tempest-CreateVolumesFromImageTest-831885656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4682c6a-6a7f-42b7-89ad-3f6d6ee93b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:02:43 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c9c350c6-3fb0-464e-865d-2970e18b044d tempest-CreateVolumesFromImageTest-831885656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4682c6a-6a7f-42b7-89ad-3f6d6ee93b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T04:02:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-883249499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50aff0e0-c7ef-494a-9a75-f2b52ec0d407,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2473f72568fe46b082c1b09c11b2139e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T04:02:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T04:02:44Z,use_quota=True,user_id='ec43e8dc7ff041a08f42c908297808e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:02:43 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c9c350c6-3fb0-464e-865d-2970e18b044d tempest-CreateVolumesFromImageTest-831885656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea0ec679-6588-487c-b807-299a4a22861b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:02:43 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c9c350c6-3fb0-464e-865d-2970e18b044d tempest-CreateVolumesFromImageTest-831885656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea0ec679-6588-487c-b807-299a4a22861b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:02:43 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c9c350c6-3fb0-464e-865d-2970e18b044d tempest-CreateVolumesFromImageTest-831885656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eec1d2b4-d912-4a77-a0bd-98a3dbd83e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:02:43 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c9c350c6-3fb0-464e-865d-2970e18b044d tempest-CreateVolumesFromImageTest-831885656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eec1d2b4-d912-4a77-a0bd-98a3dbd83e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50aff0e0-c7ef-494a-9a75-f2b52ec0d407', 'volume_name': 'volume-50aff0e0-c7ef-494a-9a75-f2b52ec0d407', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:02:43 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c9c350c6-3fb0-464e-865d-2970e18b044d tempest-CreateVolumesFromImageTest-831885656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0ea05a4-b53b-4f84-8d2a-bb815ccbfd58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:02:43 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c9c350c6-3fb0-464e-865d-2970e18b044d tempest-CreateVolumesFromImageTest-831885656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0ea05a4-b53b-4f84-8d2a-bb815ccbfd58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:02:43 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c9c350c6-3fb0-464e-865d-2970e18b044d tempest-CreateVolumesFromImageTest-831885656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9123b0bb-2b01-462d-8e6f-6b9f35caa1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:02:43 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-c9c350c6-3fb0-464e-865d-2970e18b044d tempest-CreateVolumesFromImageTest-831885656 None] Volume 50aff0e0-c7ef-494a-9a75-f2b52ec0d407: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50aff0e0-c7ef-494a-9a75-f2b52ec0d407', 'volume_size': 1} Jun 17 06:02:43 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-c9c350c6-3fb0-464e-865d-2970e18b044d tempest-CreateVolumesFromImageTest-831885656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:02:43 devstack sudo[110745]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:43 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1c143b2b-c982-492d-9cdc-0d3fe412b53e tempest-CinderUnicodeTest-1598248645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c1254f3f-ef13-41e5-bf81-012ec7fc515b" returned: 0 in 0.732s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:43 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-1c143b2b-c982-492d-9cdc-0d3fe412b53e tempest-CinderUnicodeTest-1598248645 None] <== create_volume: return (2116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 06:02:43 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-1c143b2b-c982-492d-9cdc-0d3fe412b53e tempest-CinderUnicodeTest-1598248645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.119s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:02:43 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-1fe11078-9b5e-4206-b7ae-c1f381c38a13 tempest-CreateVolumesFromImageTest-831885656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.790s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:02:43 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-1fe11078-9b5e-4206-b7ae-c1f381c38a13 tempest-CreateVolumesFromImageTest-831885656 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T04:02:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-577005219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ab6b0fc-7c1d-4714-9d5f-789834badb66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2473f72568fe46b082c1b09c11b2139e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T04:02:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T04:02:42Z,use_quota=True,user_id='ec43e8dc7ff041a08f42c908297808e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 06:02:43 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-1fe11078-9b5e-4206-b7ae-c1f381c38a13 tempest-CreateVolumesFromImageTest-831885656 None] Creating volume 6ab6b0fc-7c1d-4714-9d5f-789834badb66 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 06:02:43 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-1fe11078-9b5e-4206-b7ae-c1f381c38a13 tempest-CreateVolumesFromImageTest-831885656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:02:43 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-1fe11078-9b5e-4206-b7ae-c1f381c38a13 tempest-CreateVolumesFromImageTest-831885656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:02:43 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-1fe11078-9b5e-4206-b7ae-c1f381c38a13 tempest-CreateVolumesFromImageTest-831885656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 06:02:43 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-1fe11078-9b5e-4206-b7ae-c1f381c38a13 tempest-CreateVolumesFromImageTest-831885656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 06:02:43 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-1fe11078-9b5e-4206-b7ae-c1f381c38a13 tempest-CreateVolumesFromImageTest-831885656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:02:43 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-1fe11078-9b5e-4206-b7ae-c1f381c38a13 tempest-CreateVolumesFromImageTest-831885656 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 06:02:43 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-1fe11078-9b5e-4206-b7ae-c1f381c38a13 tempest-CreateVolumesFromImageTest-831885656 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 06:02:43 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1fe11078-9b5e-4206-b7ae-c1f381c38a13 tempest-CreateVolumesFromImageTest-831885656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ab6b0fc-7c1d-4714-9d5f-789834badb66 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:43 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1c143b2b-c982-492d-9cdc-0d3fe412b53e tempest-CinderUnicodeTest-1598248645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39501ea5-6c30-45c3-ab8c-80226c018e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1254f3f-ef13-41e5-bf81-012ec7fc515b', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:02:43 devstack sudo[110748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ab6b0fc-7c1d-4714-9d5f-789834badb66 1073741824 Jun 17 06:02:43 devstack sudo[110748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:43 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1c143b2b-c982-492d-9cdc-0d3fe412b53e tempest-CinderUnicodeTest-1598248645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81ca4e27-1a03-4f84-b8a0-ff28fa4388db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:02:43 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-1c143b2b-c982-492d-9cdc-0d3fe412b53e tempest-CinderUnicodeTest-1598248645 None] Volume volume-c1254f3f-ef13-41e5-bf81-012ec7fc515b (c1254f3f-ef13-41e5-bf81-012ec7fc515b): created successfully Jun 17 06:02:43 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1c143b2b-c982-492d-9cdc-0d3fe412b53e tempest-CinderUnicodeTest-1598248645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81ca4e27-1a03-4f84-b8a0-ff28fa4388db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:02:43 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1c143b2b-c982-492d-9cdc-0d3fe412b53e tempest-CinderUnicodeTest-1598248645 None] Flow 'volume_create_manager' (f9037f29-ef0c-460b-9b3b-e6f57b704055) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 06:02:43 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-1c143b2b-c982-492d-9cdc-0d3fe412b53e tempest-CinderUnicodeTest-1598248645 None] Created volume successfully. Jun 17 06:02:44 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-1906e250-8cd7-4553-b40f-93f27aaf5c66 tempest-CinderUnicodeTest-1598248645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 06:02:44 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1906e250-8cd7-4553-b40f-93f27aaf5c66 tempest-CinderUnicodeTest-1598248645 None] Flow 'volume_create_manager' (de1ebb35-bdf6-4e23-ad0a-8e2800b7aa5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 06:02:44 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1906e250-8cd7-4553-b40f-93f27aaf5c66 tempest-CinderUnicodeTest-1598248645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5171d159-2129-493f-a987-eed56854fdd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:02:44 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1906e250-8cd7-4553-b40f-93f27aaf5c66 tempest-CinderUnicodeTest-1598248645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5171d159-2129-493f-a987-eed56854fdd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T04:02:44Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2137116138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ee2740c-e933-4c89-8489-5fb0297e2917,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc021ae6be424da1bf35af275363547c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T04:02:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T04:02:44Z,use_quota=True,user_id='409662ee335b4a0db434c806c6fbfbbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:02:44 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1906e250-8cd7-4553-b40f-93f27aaf5c66 tempest-CinderUnicodeTest-1598248645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe5d7657-eb22-4afb-a33f-9b61d6c7dc4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:02:44 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1906e250-8cd7-4553-b40f-93f27aaf5c66 tempest-CinderUnicodeTest-1598248645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe5d7657-eb22-4afb-a33f-9b61d6c7dc4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:02:44 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1906e250-8cd7-4553-b40f-93f27aaf5c66 tempest-CinderUnicodeTest-1598248645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88a6d891-8f3e-4ea2-9779-c05f44a895cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:02:44 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1906e250-8cd7-4553-b40f-93f27aaf5c66 tempest-CinderUnicodeTest-1598248645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88a6d891-8f3e-4ea2-9779-c05f44a895cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ee2740c-e933-4c89-8489-5fb0297e2917', 'volume_name': 'volume-8ee2740c-e933-4c89-8489-5fb0297e2917', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:02:44 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1906e250-8cd7-4553-b40f-93f27aaf5c66 tempest-CinderUnicodeTest-1598248645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (563fb2d6-f958-49c2-9714-64088fec89c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:02:44 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1906e250-8cd7-4553-b40f-93f27aaf5c66 tempest-CinderUnicodeTest-1598248645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (563fb2d6-f958-49c2-9714-64088fec89c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:02:44 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1906e250-8cd7-4553-b40f-93f27aaf5c66 tempest-CinderUnicodeTest-1598248645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b8d4c46-72e7-4a79-aa13-8cde593004ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:02:44 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-1906e250-8cd7-4553-b40f-93f27aaf5c66 tempest-CinderUnicodeTest-1598248645 None] Volume 8ee2740c-e933-4c89-8489-5fb0297e2917: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ee2740c-e933-4c89-8489-5fb0297e2917', 'volume_size': 1} Jun 17 06:02:44 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-1906e250-8cd7-4553-b40f-93f27aaf5c66 tempest-CinderUnicodeTest-1598248645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:02:44 devstack sudo[110748]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:44 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1fe11078-9b5e-4206-b7ae-c1f381c38a13 tempest-CreateVolumesFromImageTest-831885656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ab6b0fc-7c1d-4714-9d5f-789834badb66 1073741824" returned: 0 in 0.862s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:44 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1fe11078-9b5e-4206-b7ae-c1f381c38a13 tempest-CreateVolumesFromImageTest-831885656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ab6b0fc-7c1d-4714-9d5f-789834badb66 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:44 devstack sudo[110755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ab6b0fc-7c1d-4714-9d5f-789834badb66 Jun 17 06:02:44 devstack sudo[110755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:45 devstack sudo[110755]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:45 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1fe11078-9b5e-4206-b7ae-c1f381c38a13 tempest-CreateVolumesFromImageTest-831885656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ab6b0fc-7c1d-4714-9d5f-789834badb66" returned: 0 in 0.623s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:45 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-1fe11078-9b5e-4206-b7ae-c1f381c38a13 tempest-CreateVolumesFromImageTest-831885656 None] <== create_volume: return (1536ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 06:02:45 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-1fe11078-9b5e-4206-b7ae-c1f381c38a13 tempest-CreateVolumesFromImageTest-831885656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.539s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:02:45 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-a2f4ba1c-5a52-4b4b-a849-da9a1dbbfaf8 tempest-CreateVolumesFromImageTest-831885656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.857s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:02:45 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-a2f4ba1c-5a52-4b4b-a849-da9a1dbbfaf8 tempest-CreateVolumesFromImageTest-831885656 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T04:02:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-562893054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=471f2815-c7e9-4e2f-aa17-49b943112e03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2473f72568fe46b082c1b09c11b2139e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T04:02:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T04:02:42Z,use_quota=True,user_id='ec43e8dc7ff041a08f42c908297808e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 06:02:45 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-a2f4ba1c-5a52-4b4b-a849-da9a1dbbfaf8 tempest-CreateVolumesFromImageTest-831885656 None] Creating volume 471f2815-c7e9-4e2f-aa17-49b943112e03 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 06:02:45 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-a2f4ba1c-5a52-4b4b-a849-da9a1dbbfaf8 tempest-CreateVolumesFromImageTest-831885656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:02:45 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-a2f4ba1c-5a52-4b4b-a849-da9a1dbbfaf8 tempest-CreateVolumesFromImageTest-831885656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:02:45 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-a2f4ba1c-5a52-4b4b-a849-da9a1dbbfaf8 tempest-CreateVolumesFromImageTest-831885656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 06:02:45 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-a2f4ba1c-5a52-4b4b-a849-da9a1dbbfaf8 tempest-CreateVolumesFromImageTest-831885656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 06:02:45 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-a2f4ba1c-5a52-4b4b-a849-da9a1dbbfaf8 tempest-CreateVolumesFromImageTest-831885656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:02:45 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-a2f4ba1c-5a52-4b4b-a849-da9a1dbbfaf8 tempest-CreateVolumesFromImageTest-831885656 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 06:02:45 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-a2f4ba1c-5a52-4b4b-a849-da9a1dbbfaf8 tempest-CreateVolumesFromImageTest-831885656 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 06:02:45 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a2f4ba1c-5a52-4b4b-a849-da9a1dbbfaf8 tempest-CreateVolumesFromImageTest-831885656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-471f2815-c7e9-4e2f-aa17-49b943112e03 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:45 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1fe11078-9b5e-4206-b7ae-c1f381c38a13 tempest-CreateVolumesFromImageTest-831885656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d52e798c-cdfe-44e8-ad52-071956025336) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ab6b0fc-7c1d-4714-9d5f-789834badb66', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:02:45 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1fe11078-9b5e-4206-b7ae-c1f381c38a13 tempest-CreateVolumesFromImageTest-831885656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a12d402-c8c9-4c2b-890f-2ca5912e4161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:02:45 devstack sudo[110758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-471f2815-c7e9-4e2f-aa17-49b943112e03 1073741824 Jun 17 06:02:45 devstack sudo[110758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:45 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-1fe11078-9b5e-4206-b7ae-c1f381c38a13 tempest-CreateVolumesFromImageTest-831885656 None] Volume volume-6ab6b0fc-7c1d-4714-9d5f-789834badb66 (6ab6b0fc-7c1d-4714-9d5f-789834badb66): created successfully Jun 17 06:02:45 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1fe11078-9b5e-4206-b7ae-c1f381c38a13 tempest-CreateVolumesFromImageTest-831885656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a12d402-c8c9-4c2b-890f-2ca5912e4161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:02:45 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1fe11078-9b5e-4206-b7ae-c1f381c38a13 tempest-CreateVolumesFromImageTest-831885656 None] Flow 'volume_create_manager' (81526917-713d-4db8-837f-7eacbc5010cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 06:02:45 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-1fe11078-9b5e-4206-b7ae-c1f381c38a13 tempest-CreateVolumesFromImageTest-831885656 None] Created volume successfully. Jun 17 06:02:45 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 06:02:45 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] Flow 'volume_create_manager' (f6a188e5-f34c-46b1-9d49-3b388ef20b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 06:02:45 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bd2ec7b-09e5-422d-b561-b05e35d09c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:02:45 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bd2ec7b-09e5-422d-b561-b05e35d09c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T04:02:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71f3e450-78c5-4fa7-be84-3f4b1f472b3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb9d38dca22e4fa39297c75165d7ec28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T04:02:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T04:02:46Z,use_quota=True,user_id='e9c22439b7a344c580228ad555ea0872',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4171b08c-ba86-4510-87e2-7b5b175744a2),volume_type_id=4171b08c-ba86-4510-87e2-7b5b175744a2)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:02:45 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adabd2b8-2ec9-49d2-9f9f-8196a42ae412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:02:45 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adabd2b8-2ec9-49d2-9f9f-8196a42ae412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:02:45 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e58285a-4cd7-43d6-a277-36900359c384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:02:45 devstack cinder-volume[92083]: DEBUG cinder.image.glance [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] Creating Keystone auth plugin from conf {{(pid=92083) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 17 06:02:46 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e58285a-4cd7-43d6-a277-36900359c384) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '71f3e450-78c5-4fa7-be84-3f4b1f472b3b', 'volume_name': 'volume-71f3e450-78c5-4fa7-be84-3f4b1f472b3b', 'volume_size': 1, 'image_id': '520a9f8f-658e-433e-a05a-85de6d34572d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/520a9f8f-658e-433e-a05a-85de6d34572d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '01bd44dbbb069c06fcaf2622b92888a4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'eb9d38dca22e4fa39297c75165d7ec28', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b21da800a170b010316fec64a86fb680fdcf370a940bf828d9435df5c782b8d13fef268b87bebdcf5ea5a07aff115017593f1faf902720c8122f01f1c53f7ac6', 'id': '520a9f8f-658e-433e-a05a-85de6d34572d', 'created_at': datetime.datetime(2026, 6, 17, 4, 2, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 4, 2, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/520a9f8f-658e-433e-a05a-85de6d34572d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:02:46 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (306b411d-36ac-4909-9595-fd58e165d679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:02:46 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (306b411d-36ac-4909-9595-fd58e165d679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:02:46 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40acbe70-24b2-45bd-a484-618f5a9c47d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:02:46 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] Volume 71f3e450-78c5-4fa7-be84-3f4b1f472b3b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-71f3e450-78c5-4fa7-be84-3f4b1f472b3b', 'volume_size': 1, 'image_id': '520a9f8f-658e-433e-a05a-85de6d34572d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/520a9f8f-658e-433e-a05a-85de6d34572d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '01bd44dbbb069c06fcaf2622b92888a4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'eb9d38dca22e4fa39297c75165d7ec28', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b21da800a170b010316fec64a86fb680fdcf370a940bf828d9435df5c782b8d13fef268b87bebdcf5ea5a07aff115017593f1faf902720c8122f01f1c53f7ac6', 'id': '520a9f8f-658e-433e-a05a-85de6d34572d', 'created_at': datetime.datetime(2026, 6, 17, 4, 2, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 4, 2, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/520a9f8f-658e-433e-a05a-85de6d34572d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 17 06:02:46 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] Trying to clone 71f3e450-78c5-4fa7-be84-3f4b1f472b3b from image 520a9f8f-658e-433e-a05a-85de6d34572d at location (None, [{'url': 'file:///opt/stack/data/glance/images/520a9f8f-658e-433e-a05a-85de6d34572d', 'metadata': {}}]). {{(pid=92083) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 17 06:02:46 devstack sudo[110758]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a2f4ba1c-5a52-4b4b-a849-da9a1dbbfaf8 tempest-CreateVolumesFromImageTest-831885656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-471f2815-c7e9-4e2f-aa17-49b943112e03 1073741824" returned: 0 in 0.868s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:46 devstack cinder-volume[92083]: DEBUG cinder.image.image_utils [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_520a9f8f-658e-433e-a05a-85de6d34572d_6tawwx6kdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=92083) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 17 06:02:46 devstack cinder-volume[92083]: INFO cinder.image.image_utils [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] Image download 0.00 MB at 0.00 MB/s Jun 17 06:02:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a2f4ba1c-5a52-4b4b-a849-da9a1dbbfaf8 tempest-CreateVolumesFromImageTest-831885656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-471f2815-c7e9-4e2f-aa17-49b943112e03 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:46 devstack sudo[110764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-471f2815-c7e9-4e2f-aa17-49b943112e03 Jun 17 06:02:46 devstack sudo[110764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:46 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ed844a-bf90-450d-89a8-ba9467efb4a6]: (4, 'raw') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 06:02:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_520a9f8f-658e-433e-a05a-85de6d34572d_6tawwx6kdevstack@QuobyteHD {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:46 devstack sudo[110766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_520a9f8f-658e-433e-a05a-85de6d34572d_6tawwx6kdevstack@QuobyteHD Jun 17 06:02:46 devstack sudo[110766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:46 devstack sudo[110764]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a2f4ba1c-5a52-4b4b-a849-da9a1dbbfaf8 tempest-CreateVolumesFromImageTest-831885656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-471f2815-c7e9-4e2f-aa17-49b943112e03" returned: 0 in 0.587s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:46 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-a2f4ba1c-5a52-4b4b-a849-da9a1dbbfaf8 tempest-CreateVolumesFromImageTest-831885656 None] <== create_volume: return (1498ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 06:02:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-a2f4ba1c-5a52-4b4b-a849-da9a1dbbfaf8 tempest-CreateVolumesFromImageTest-831885656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.501s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:02:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-3d21b23a-e2b7-4ddf-a1e1-2138090fc592 tempest-CreateVolumesFromSnapshotTest-309904984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.207s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:02:46 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-3d21b23a-e2b7-4ddf-a1e1-2138090fc592 tempest-CreateVolumesFromSnapshotTest-309904984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T04:02:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-287501817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be813a23-b798-4f1d-9217-614239ea1735,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec2a339a1c5349309d139acd7586d036',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T04:02:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T04:02:43Z,use_quota=True,user_id='59f6ed0a529b4a3fa4f275ebe7bbb708',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 06:02:46 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-3d21b23a-e2b7-4ddf-a1e1-2138090fc592 tempest-CreateVolumesFromSnapshotTest-309904984 None] Creating volume be813a23-b798-4f1d-9217-614239ea1735 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 06:02:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-3d21b23a-e2b7-4ddf-a1e1-2138090fc592 tempest-CreateVolumesFromSnapshotTest-309904984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:02:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-3d21b23a-e2b7-4ddf-a1e1-2138090fc592 tempest-CreateVolumesFromSnapshotTest-309904984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:02:46 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-3d21b23a-e2b7-4ddf-a1e1-2138090fc592 tempest-CreateVolumesFromSnapshotTest-309904984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 06:02:46 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-3d21b23a-e2b7-4ddf-a1e1-2138090fc592 tempest-CreateVolumesFromSnapshotTest-309904984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 06:02:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-3d21b23a-e2b7-4ddf-a1e1-2138090fc592 tempest-CreateVolumesFromSnapshotTest-309904984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:02:46 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-3d21b23a-e2b7-4ddf-a1e1-2138090fc592 tempest-CreateVolumesFromSnapshotTest-309904984 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 06:02:46 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-3d21b23a-e2b7-4ddf-a1e1-2138090fc592 tempest-CreateVolumesFromSnapshotTest-309904984 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 06:02:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-3d21b23a-e2b7-4ddf-a1e1-2138090fc592 tempest-CreateVolumesFromSnapshotTest-309904984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-be813a23-b798-4f1d-9217-614239ea1735 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:46 devstack sudo[110769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-be813a23-b798-4f1d-9217-614239ea1735 1073741824 Jun 17 06:02:46 devstack sudo[110769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:46 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a2f4ba1c-5a52-4b4b-a849-da9a1dbbfaf8 tempest-CreateVolumesFromImageTest-831885656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05ce59db-8441-4825-af62-f0bc425ee7f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-471f2815-c7e9-4e2f-aa17-49b943112e03', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:02:46 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a2f4ba1c-5a52-4b4b-a849-da9a1dbbfaf8 tempest-CreateVolumesFromImageTest-831885656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6a87cca-5992-4f5b-a0d8-5a4776a8d56b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:02:46 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-a2f4ba1c-5a52-4b4b-a849-da9a1dbbfaf8 tempest-CreateVolumesFromImageTest-831885656 None] Volume volume-471f2815-c7e9-4e2f-aa17-49b943112e03 (471f2815-c7e9-4e2f-aa17-49b943112e03): created successfully Jun 17 06:02:46 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a2f4ba1c-5a52-4b4b-a849-da9a1dbbfaf8 tempest-CreateVolumesFromImageTest-831885656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6a87cca-5992-4f5b-a0d8-5a4776a8d56b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:02:46 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a2f4ba1c-5a52-4b4b-a849-da9a1dbbfaf8 tempest-CreateVolumesFromImageTest-831885656 None] Flow 'volume_create_manager' (5d45996c-edd7-49a8-910d-c7eb7e934c40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 06:02:47 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-a2f4ba1c-5a52-4b4b-a849-da9a1dbbfaf8 tempest-CreateVolumesFromImageTest-831885656 None] Created volume successfully. Jun 17 06:02:47 devstack sudo[110766]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:47 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_520a9f8f-658e-433e-a05a-85de6d34572d_6tawwx6kdevstack@QuobyteHD" returned: 0 in 0.719s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:47 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_520a9f8f-658e-433e-a05a-85de6d34572d_6tawwx6kdevstack@QuobyteHD {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:47 devstack sudo[110773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_520a9f8f-658e-433e-a05a-85de6d34572d_6tawwx6kdevstack@QuobyteHD Jun 17 06:02:47 devstack sudo[110773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:47 devstack sudo[110769]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:47 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-3d21b23a-e2b7-4ddf-a1e1-2138090fc592 tempest-CreateVolumesFromSnapshotTest-309904984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-be813a23-b798-4f1d-9217-614239ea1735 1073741824" returned: 0 in 0.767s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:47 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-3d21b23a-e2b7-4ddf-a1e1-2138090fc592 tempest-CreateVolumesFromSnapshotTest-309904984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-be813a23-b798-4f1d-9217-614239ea1735 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:47 devstack sudo[110773]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:47 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_520a9f8f-658e-433e-a05a-85de6d34572d_6tawwx6kdevstack@QuobyteHD" returned: 1 in 0.679s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:47 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_520a9f8f-658e-433e-a05a-85de6d34572d_6tawwx6kdevstack@QuobyteHD' failed. Not Retrying. {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 06:02:47 devstack cinder-volume[92083]: DEBUG cinder.image.image_utils [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] Temporary image 520a9f8f-658e-433e-a05a-85de6d34572d is fetched for user e9c22439b7a344c580228ad555ea0872. {{(pid=92083) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 17 06:02:47 devstack sudo[110781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-be813a23-b798-4f1d-9217-614239ea1735 Jun 17 06:02:47 devstack sudo[110781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:47 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde7dc9e-40c5-4bbf-8a39-42ebc5cbc5ef]: (4, 'raw') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 06:02:47 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_520a9f8f-658e-433e-a05a-85de6d34572d_6tawwx6kdevstack@QuobyteHD {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:47 devstack sudo[110783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_520a9f8f-658e-433e-a05a-85de6d34572d_6tawwx6kdevstack@QuobyteHD Jun 17 06:02:47 devstack sudo[110783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:48 devstack sudo[110781]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:48 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-3d21b23a-e2b7-4ddf-a1e1-2138090fc592 tempest-CreateVolumesFromSnapshotTest-309904984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-be813a23-b798-4f1d-9217-614239ea1735" returned: 0 in 0.585s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:48 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-3d21b23a-e2b7-4ddf-a1e1-2138090fc592 tempest-CreateVolumesFromSnapshotTest-309904984 None] <== create_volume: return (1395ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 06:02:48 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-3d21b23a-e2b7-4ddf-a1e1-2138090fc592 tempest-CreateVolumesFromSnapshotTest-309904984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.403s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:02:48 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-b5c98fba-d191-4fca-98bd-46829d59d047 tempest-CreateVolumesFromImageTest-831885656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.407s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:02:48 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-b5c98fba-d191-4fca-98bd-46829d59d047 tempest-CreateVolumesFromImageTest-831885656 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T04:02:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1879556079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ac09bfa-2a4b-4bfe-9213-dd9e871c8898,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2473f72568fe46b082c1b09c11b2139e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T04:02:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T04:02:43Z,use_quota=True,user_id='ec43e8dc7ff041a08f42c908297808e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 06:02:48 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-b5c98fba-d191-4fca-98bd-46829d59d047 tempest-CreateVolumesFromImageTest-831885656 None] Creating volume 0ac09bfa-2a4b-4bfe-9213-dd9e871c8898 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 06:02:48 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-b5c98fba-d191-4fca-98bd-46829d59d047 tempest-CreateVolumesFromImageTest-831885656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:02:48 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-b5c98fba-d191-4fca-98bd-46829d59d047 tempest-CreateVolumesFromImageTest-831885656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:02:48 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-b5c98fba-d191-4fca-98bd-46829d59d047 tempest-CreateVolumesFromImageTest-831885656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 06:02:48 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-b5c98fba-d191-4fca-98bd-46829d59d047 tempest-CreateVolumesFromImageTest-831885656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 06:02:48 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-b5c98fba-d191-4fca-98bd-46829d59d047 tempest-CreateVolumesFromImageTest-831885656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:02:48 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-b5c98fba-d191-4fca-98bd-46829d59d047 tempest-CreateVolumesFromImageTest-831885656 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 06:02:48 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-b5c98fba-d191-4fca-98bd-46829d59d047 tempest-CreateVolumesFromImageTest-831885656 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 06:02:48 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b5c98fba-d191-4fca-98bd-46829d59d047 tempest-CreateVolumesFromImageTest-831885656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0ac09bfa-2a4b-4bfe-9213-dd9e871c8898 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:48 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-3d21b23a-e2b7-4ddf-a1e1-2138090fc592 tempest-CreateVolumesFromSnapshotTest-309904984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b736669-848a-4ccc-844c-70ea3458dd75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be813a23-b798-4f1d-9217-614239ea1735', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:02:48 devstack sudo[110786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0ac09bfa-2a4b-4bfe-9213-dd9e871c8898 1073741824 Jun 17 06:02:48 devstack sudo[110786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:48 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-3d21b23a-e2b7-4ddf-a1e1-2138090fc592 tempest-CreateVolumesFromSnapshotTest-309904984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a02c676-aa43-4b8c-a73b-233536d9ef07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:02:48 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-3d21b23a-e2b7-4ddf-a1e1-2138090fc592 tempest-CreateVolumesFromSnapshotTest-309904984 None] Volume volume-be813a23-b798-4f1d-9217-614239ea1735 (be813a23-b798-4f1d-9217-614239ea1735): created successfully Jun 17 06:02:48 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-3d21b23a-e2b7-4ddf-a1e1-2138090fc592 tempest-CreateVolumesFromSnapshotTest-309904984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a02c676-aa43-4b8c-a73b-233536d9ef07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:02:48 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-3d21b23a-e2b7-4ddf-a1e1-2138090fc592 tempest-CreateVolumesFromSnapshotTest-309904984 None] Flow 'volume_create_manager' (c75a588f-e31b-451b-b3ed-c2368259a1ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 06:02:48 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-3d21b23a-e2b7-4ddf-a1e1-2138090fc592 tempest-CreateVolumesFromSnapshotTest-309904984 None] Created volume successfully. Jun 17 06:02:48 devstack sudo[110783]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:48 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_520a9f8f-658e-433e-a05a-85de6d34572d_6tawwx6kdevstack@QuobyteHD" returned: 0 in 0.701s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:48 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_520a9f8f-658e-433e-a05a-85de6d34572d_6tawwx6kdevstack@QuobyteHD {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:48 devstack sudo[110790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_520a9f8f-658e-433e-a05a-85de6d34572d_6tawwx6kdevstack@QuobyteHD Jun 17 06:02:48 devstack sudo[110790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:49 devstack sudo[110786]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:49 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b5c98fba-d191-4fca-98bd-46829d59d047 tempest-CreateVolumesFromImageTest-831885656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0ac09bfa-2a4b-4bfe-9213-dd9e871c8898 1073741824" returned: 0 in 0.824s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:49 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b5c98fba-d191-4fca-98bd-46829d59d047 tempest-CreateVolumesFromImageTest-831885656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0ac09bfa-2a4b-4bfe-9213-dd9e871c8898 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:49 devstack sudo[110799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0ac09bfa-2a4b-4bfe-9213-dd9e871c8898 Jun 17 06:02:49 devstack sudo[110799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:49 devstack sudo[110790]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:49 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_520a9f8f-658e-433e-a05a-85de6d34572d_6tawwx6kdevstack@QuobyteHD" returned: 1 in 0.741s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:49 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_520a9f8f-658e-433e-a05a-85de6d34572d_6tawwx6kdevstack@QuobyteHD' failed. Not Retrying. {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 06:02:49 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:02:49 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-01161bcb-2233-4acf-99a6-0e0966d679d5 tempest-CreateVolumesFromSnapshotTest-309904984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:02:49 devstack sudo[110799]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:49 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b5c98fba-d191-4fca-98bd-46829d59d047 tempest-CreateVolumesFromImageTest-831885656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0ac09bfa-2a4b-4bfe-9213-dd9e871c8898" returned: 0 in 0.627s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:49 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-b5c98fba-d191-4fca-98bd-46829d59d047 tempest-CreateVolumesFromImageTest-831885656 None] <== create_volume: return (1536ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 06:02:49 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-b5c98fba-d191-4fca-98bd-46829d59d047 tempest-CreateVolumesFromImageTest-831885656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.540s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:02:49 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-7403ab9e-04db-49fc-a0fa-757c056b0da9 tempest-CreateVolumesFromImageTest-831885656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.393s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:02:49 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-7403ab9e-04db-49fc-a0fa-757c056b0da9 tempest-CreateVolumesFromImageTest-831885656 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T04:02:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2076321054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=051fa7d8-d607-454c-9270-4cc2b78ed1c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2473f72568fe46b082c1b09c11b2139e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T04:02:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T04:02:43Z,use_quota=True,user_id='ec43e8dc7ff041a08f42c908297808e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 06:02:49 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-7403ab9e-04db-49fc-a0fa-757c056b0da9 tempest-CreateVolumesFromImageTest-831885656 None] Creating volume 051fa7d8-d607-454c-9270-4cc2b78ed1c6 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 06:02:49 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-7403ab9e-04db-49fc-a0fa-757c056b0da9 tempest-CreateVolumesFromImageTest-831885656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:02:49 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-7403ab9e-04db-49fc-a0fa-757c056b0da9 tempest-CreateVolumesFromImageTest-831885656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:02:49 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-7403ab9e-04db-49fc-a0fa-757c056b0da9 tempest-CreateVolumesFromImageTest-831885656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 06:02:49 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-7403ab9e-04db-49fc-a0fa-757c056b0da9 tempest-CreateVolumesFromImageTest-831885656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 06:02:49 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-7403ab9e-04db-49fc-a0fa-757c056b0da9 tempest-CreateVolumesFromImageTest-831885656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:02:49 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-7403ab9e-04db-49fc-a0fa-757c056b0da9 tempest-CreateVolumesFromImageTest-831885656 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 06:02:49 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-7403ab9e-04db-49fc-a0fa-757c056b0da9 tempest-CreateVolumesFromImageTest-831885656 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 06:02:49 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-7403ab9e-04db-49fc-a0fa-757c056b0da9 tempest-CreateVolumesFromImageTest-831885656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-051fa7d8-d607-454c-9270-4cc2b78ed1c6 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:49 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b5c98fba-d191-4fca-98bd-46829d59d047 tempest-CreateVolumesFromImageTest-831885656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da6434e8-5434-48d0-82a3-feb03e058e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ac09bfa-2a4b-4bfe-9213-dd9e871c8898', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:02:49 devstack sudo[110803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-051fa7d8-d607-454c-9270-4cc2b78ed1c6 1073741824 Jun 17 06:02:49 devstack sudo[110803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:49 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b5c98fba-d191-4fca-98bd-46829d59d047 tempest-CreateVolumesFromImageTest-831885656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e64c049-d6fe-4ac4-a00a-f99d9a21a87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:02:49 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-b5c98fba-d191-4fca-98bd-46829d59d047 tempest-CreateVolumesFromImageTest-831885656 None] Volume volume-0ac09bfa-2a4b-4bfe-9213-dd9e871c8898 (0ac09bfa-2a4b-4bfe-9213-dd9e871c8898): created successfully Jun 17 06:02:49 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b5c98fba-d191-4fca-98bd-46829d59d047 tempest-CreateVolumesFromImageTest-831885656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e64c049-d6fe-4ac4-a00a-f99d9a21a87e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:02:49 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-b5c98fba-d191-4fca-98bd-46829d59d047 tempest-CreateVolumesFromImageTest-831885656 None] Flow 'volume_create_manager' (9e6c2f1d-ec03-40ac-a6ac-30c6ef51b9c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 06:02:49 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-b5c98fba-d191-4fca-98bd-46829d59d047 tempest-CreateVolumesFromImageTest-831885656 None] Created volume successfully. Jun 17 06:02:50 devstack sudo[110803]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:50 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-7403ab9e-04db-49fc-a0fa-757c056b0da9 tempest-CreateVolumesFromImageTest-831885656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-051fa7d8-d607-454c-9270-4cc2b78ed1c6 1073741824" returned: 0 in 0.756s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:50 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-7403ab9e-04db-49fc-a0fa-757c056b0da9 tempest-CreateVolumesFromImageTest-831885656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-051fa7d8-d607-454c-9270-4cc2b78ed1c6 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:50 devstack sudo[110808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-051fa7d8-d607-454c-9270-4cc2b78ed1c6 Jun 17 06:02:50 devstack sudo[110808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:51 devstack sudo[110808]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:51 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-7403ab9e-04db-49fc-a0fa-757c056b0da9 tempest-CreateVolumesFromImageTest-831885656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-051fa7d8-d607-454c-9270-4cc2b78ed1c6" returned: 0 in 0.597s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:51 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-7403ab9e-04db-49fc-a0fa-757c056b0da9 tempest-CreateVolumesFromImageTest-831885656 None] <== create_volume: return (1390ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 06:02:51 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-7403ab9e-04db-49fc-a0fa-757c056b0da9 tempest-CreateVolumesFromImageTest-831885656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.393s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:02:51 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-c9c350c6-3fb0-464e-865d-2970e18b044d tempest-CreateVolumesFromImageTest-831885656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.576s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:02:51 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-c9c350c6-3fb0-464e-865d-2970e18b044d tempest-CreateVolumesFromImageTest-831885656 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T04:02:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-883249499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50aff0e0-c7ef-494a-9a75-f2b52ec0d407,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2473f72568fe46b082c1b09c11b2139e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T04:02:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T04:02:44Z,use_quota=True,user_id='ec43e8dc7ff041a08f42c908297808e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 06:02:51 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-c9c350c6-3fb0-464e-865d-2970e18b044d tempest-CreateVolumesFromImageTest-831885656 None] Creating volume 50aff0e0-c7ef-494a-9a75-f2b52ec0d407 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 06:02:51 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-c9c350c6-3fb0-464e-865d-2970e18b044d tempest-CreateVolumesFromImageTest-831885656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:02:51 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-c9c350c6-3fb0-464e-865d-2970e18b044d tempest-CreateVolumesFromImageTest-831885656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:02:51 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-c9c350c6-3fb0-464e-865d-2970e18b044d tempest-CreateVolumesFromImageTest-831885656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 06:02:51 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-c9c350c6-3fb0-464e-865d-2970e18b044d tempest-CreateVolumesFromImageTest-831885656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 06:02:51 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-c9c350c6-3fb0-464e-865d-2970e18b044d tempest-CreateVolumesFromImageTest-831885656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:02:51 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-c9c350c6-3fb0-464e-865d-2970e18b044d tempest-CreateVolumesFromImageTest-831885656 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 06:02:51 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-c9c350c6-3fb0-464e-865d-2970e18b044d tempest-CreateVolumesFromImageTest-831885656 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 06:02:51 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c9c350c6-3fb0-464e-865d-2970e18b044d tempest-CreateVolumesFromImageTest-831885656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-50aff0e0-c7ef-494a-9a75-f2b52ec0d407 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:51 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-7403ab9e-04db-49fc-a0fa-757c056b0da9 tempest-CreateVolumesFromImageTest-831885656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b493f0b-6639-4966-bb07-484b1ab347b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-051fa7d8-d607-454c-9270-4cc2b78ed1c6', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:02:51 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-7403ab9e-04db-49fc-a0fa-757c056b0da9 tempest-CreateVolumesFromImageTest-831885656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88cfc41e-d307-45ed-baeb-cc68deb6f33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:02:51 devstack sudo[110811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-50aff0e0-c7ef-494a-9a75-f2b52ec0d407 1073741824 Jun 17 06:02:51 devstack sudo[110811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:51 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-7403ab9e-04db-49fc-a0fa-757c056b0da9 tempest-CreateVolumesFromImageTest-831885656 None] Volume volume-051fa7d8-d607-454c-9270-4cc2b78ed1c6 (051fa7d8-d607-454c-9270-4cc2b78ed1c6): created successfully Jun 17 06:02:51 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-7403ab9e-04db-49fc-a0fa-757c056b0da9 tempest-CreateVolumesFromImageTest-831885656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88cfc41e-d307-45ed-baeb-cc68deb6f33b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:02:51 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-7403ab9e-04db-49fc-a0fa-757c056b0da9 tempest-CreateVolumesFromImageTest-831885656 None] Flow 'volume_create_manager' (56fb5259-1709-4d62-ab07-c6060cee13a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 06:02:51 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-7403ab9e-04db-49fc-a0fa-757c056b0da9 tempest-CreateVolumesFromImageTest-831885656 None] Created volume successfully. Jun 17 06:02:52 devstack sudo[110811]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c9c350c6-3fb0-464e-865d-2970e18b044d tempest-CreateVolumesFromImageTest-831885656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-50aff0e0-c7ef-494a-9a75-f2b52ec0d407 1073741824" returned: 0 in 0.757s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c9c350c6-3fb0-464e-865d-2970e18b044d tempest-CreateVolumesFromImageTest-831885656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-50aff0e0-c7ef-494a-9a75-f2b52ec0d407 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:52 devstack sudo[110817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-50aff0e0-c7ef-494a-9a75-f2b52ec0d407 Jun 17 06:02:52 devstack sudo[110817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:52 devstack sudo[110817]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c9c350c6-3fb0-464e-865d-2970e18b044d tempest-CreateVolumesFromImageTest-831885656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-50aff0e0-c7ef-494a-9a75-f2b52ec0d407" returned: 0 in 0.597s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:52 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-c9c350c6-3fb0-464e-865d-2970e18b044d tempest-CreateVolumesFromImageTest-831885656 None] <== create_volume: return (1390ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 06:02:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-c9c350c6-3fb0-464e-865d-2970e18b044d tempest-CreateVolumesFromImageTest-831885656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.393s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:02:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-1906e250-8cd7-4553-b40f-93f27aaf5c66 tempest-CinderUnicodeTest-1598248645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.013s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:02:52 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-1906e250-8cd7-4553-b40f-93f27aaf5c66 tempest-CinderUnicodeTest-1598248645 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T04:02:44Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2137116138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ee2740c-e933-4c89-8489-5fb0297e2917,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc021ae6be424da1bf35af275363547c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T04:02:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T04:02:44Z,use_quota=True,user_id='409662ee335b4a0db434c806c6fbfbbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 06:02:52 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-1906e250-8cd7-4553-b40f-93f27aaf5c66 tempest-CinderUnicodeTest-1598248645 None] Creating volume 8ee2740c-e933-4c89-8489-5fb0297e2917 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 06:02:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-1906e250-8cd7-4553-b40f-93f27aaf5c66 tempest-CinderUnicodeTest-1598248645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:02:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-1906e250-8cd7-4553-b40f-93f27aaf5c66 tempest-CinderUnicodeTest-1598248645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:02:52 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-1906e250-8cd7-4553-b40f-93f27aaf5c66 tempest-CinderUnicodeTest-1598248645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 06:02:52 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-1906e250-8cd7-4553-b40f-93f27aaf5c66 tempest-CinderUnicodeTest-1598248645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 06:02:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-1906e250-8cd7-4553-b40f-93f27aaf5c66 tempest-CinderUnicodeTest-1598248645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:02:52 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-1906e250-8cd7-4553-b40f-93f27aaf5c66 tempest-CinderUnicodeTest-1598248645 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 06:02:52 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-1906e250-8cd7-4553-b40f-93f27aaf5c66 tempest-CinderUnicodeTest-1598248645 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 06:02:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1906e250-8cd7-4553-b40f-93f27aaf5c66 tempest-CinderUnicodeTest-1598248645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-8ee2740c-e933-4c89-8489-5fb0297e2917 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:52 devstack sudo[110820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-8ee2740c-e933-4c89-8489-5fb0297e2917 1073741824 Jun 17 06:02:52 devstack sudo[110820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:52 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c9c350c6-3fb0-464e-865d-2970e18b044d tempest-CreateVolumesFromImageTest-831885656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9123b0bb-2b01-462d-8e6f-6b9f35caa1e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50aff0e0-c7ef-494a-9a75-f2b52ec0d407', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:02:52 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c9c350c6-3fb0-464e-865d-2970e18b044d tempest-CreateVolumesFromImageTest-831885656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (757ee994-d4d8-46c7-a1ca-3def1f8c1f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:02:52 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-c9c350c6-3fb0-464e-865d-2970e18b044d tempest-CreateVolumesFromImageTest-831885656 None] Volume volume-50aff0e0-c7ef-494a-9a75-f2b52ec0d407 (50aff0e0-c7ef-494a-9a75-f2b52ec0d407): created successfully Jun 17 06:02:52 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c9c350c6-3fb0-464e-865d-2970e18b044d tempest-CreateVolumesFromImageTest-831885656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (757ee994-d4d8-46c7-a1ca-3def1f8c1f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:02:52 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c9c350c6-3fb0-464e-865d-2970e18b044d tempest-CreateVolumesFromImageTest-831885656 None] Flow 'volume_create_manager' (3f9ac2c9-0ed9-4a2b-9017-3b5111477ede) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 06:02:52 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-c9c350c6-3fb0-464e-865d-2970e18b044d tempest-CreateVolumesFromImageTest-831885656 None] Created volume successfully. Jun 17 06:02:53 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-a95a7acd-fb50-46e9-ab1c-e57c5b6a71af tempest-CreateVolumesFromImageTest-831885656 None] Acquiring lock "cinder-50aff0e0-c7ef-494a-9a75-f2b52ec0d407-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:02:53 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-a95a7acd-fb50-46e9-ab1c-e57c5b6a71af tempest-CreateVolumesFromImageTest-831885656 None] Lock "cinder-50aff0e0-c7ef-494a-9a75-f2b52ec0d407-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:02:53 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-a95a7acd-fb50-46e9-ab1c-e57c5b6a71af tempest-CreateVolumesFromImageTest-831885656 None] Acquiring lock "cinder-quobyte-50aff0e0-c7ef-494a-9a75-f2b52ec0d407" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:02:53 devstack sudo[110820]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:53 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1906e250-8cd7-4553-b40f-93f27aaf5c66 tempest-CinderUnicodeTest-1598248645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-8ee2740c-e933-4c89-8489-5fb0297e2917 1073741824" returned: 0 in 0.787s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:53 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-a95a7acd-fb50-46e9-ab1c-e57c5b6a71af tempest-CreateVolumesFromImageTest-831885656 None] Lock "cinder-quobyte-50aff0e0-c7ef-494a-9a75-f2b52ec0d407" acquired by "delete_volume" :: waited 0.032s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:02:53 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1906e250-8cd7-4553-b40f-93f27aaf5c66 tempest-CinderUnicodeTest-1598248645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-8ee2740c-e933-4c89-8489-5fb0297e2917 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:53 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[53612874-392a-4f72-9b5d-e4fd3da163cf]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 06:02:53 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a95a7acd-fb50-46e9-ab1c-e57c5b6a71af tempest-CreateVolumesFromImageTest-831885656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-50aff0e0-c7ef-494a-9a75-f2b52ec0d407 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:53 devstack sudo[110826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-8ee2740c-e933-4c89-8489-5fb0297e2917 Jun 17 06:02:53 devstack sudo[110826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:53 devstack sudo[110827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-50aff0e0-c7ef-494a-9a75-f2b52ec0d407 Jun 17 06:02:53 devstack sudo[110827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:54 devstack sudo[110826]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1906e250-8cd7-4553-b40f-93f27aaf5c66 tempest-CinderUnicodeTest-1598248645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-8ee2740c-e933-4c89-8489-5fb0297e2917" returned: 0 in 0.591s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:54 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-1906e250-8cd7-4553-b40f-93f27aaf5c66 tempest-CinderUnicodeTest-1598248645 None] <== create_volume: return (1435ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 06:02:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-1906e250-8cd7-4553-b40f-93f27aaf5c66 tempest-CinderUnicodeTest-1598248645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.439s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:02:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.820s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:02:54 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T04:02:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71f3e450-78c5-4fa7-be84-3f4b1f472b3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb9d38dca22e4fa39297c75165d7ec28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T04:02:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T04:02:46Z,use_quota=True,user_id='e9c22439b7a344c580228ad555ea0872',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4171b08c-ba86-4510-87e2-7b5b175744a2),volume_type_id=4171b08c-ba86-4510-87e2-7b5b175744a2)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 06:02:54 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] Creating volume 71f3e450-78c5-4fa7-be84-3f4b1f472b3b {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 06:02:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:02:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:02:54 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 06:02:54 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 06:02:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:02:54 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 06:02:54 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 06:02:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-71f3e450-78c5-4fa7-be84-3f4b1f472b3b 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:54 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1906e250-8cd7-4553-b40f-93f27aaf5c66 tempest-CinderUnicodeTest-1598248645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b8d4c46-72e7-4a79-aa13-8cde593004ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ee2740c-e933-4c89-8489-5fb0297e2917', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:02:54 devstack sudo[110833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-71f3e450-78c5-4fa7-be84-3f4b1f472b3b 1073741824 Jun 17 06:02:54 devstack sudo[110833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:54 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1906e250-8cd7-4553-b40f-93f27aaf5c66 tempest-CinderUnicodeTest-1598248645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3acc139-62fa-443b-b6ee-87bc73a3f8d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:02:54 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-1906e250-8cd7-4553-b40f-93f27aaf5c66 tempest-CinderUnicodeTest-1598248645 None] Volume volume-8ee2740c-e933-4c89-8489-5fb0297e2917 (8ee2740c-e933-4c89-8489-5fb0297e2917): created successfully Jun 17 06:02:54 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1906e250-8cd7-4553-b40f-93f27aaf5c66 tempest-CinderUnicodeTest-1598248645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3acc139-62fa-443b-b6ee-87bc73a3f8d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:02:54 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-1906e250-8cd7-4553-b40f-93f27aaf5c66 tempest-CinderUnicodeTest-1598248645 None] Flow 'volume_create_manager' (de1ebb35-bdf6-4e23-ad0a-8e2800b7aa5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 06:02:54 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-1906e250-8cd7-4553-b40f-93f27aaf5c66 tempest-CinderUnicodeTest-1598248645 None] Created volume successfully. Jun 17 06:02:54 devstack sudo[110827]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a95a7acd-fb50-46e9-ab1c-e57c5b6a71af tempest-CreateVolumesFromImageTest-831885656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-50aff0e0-c7ef-494a-9a75-f2b52ec0d407" returned: 0 in 0.752s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a95a7acd-fb50-46e9-ab1c-e57c5b6a71af tempest-CreateVolumesFromImageTest-831885656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-50aff0e0-c7ef-494a-9a75-f2b52ec0d407 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:54 devstack sudo[110836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-50aff0e0-c7ef-494a-9a75-f2b52ec0d407 Jun 17 06:02:54 devstack sudo[110836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:54 devstack sudo[110836]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a95a7acd-fb50-46e9-ab1c-e57c5b6a71af tempest-CreateVolumesFromImageTest-831885656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-50aff0e0-c7ef-494a-9a75-f2b52ec0d407" returned: 0 in 0.617s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:54 devstack sudo[110833]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:54 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-a95a7acd-fb50-46e9-ab1c-e57c5b6a71af tempest-CreateVolumesFromImageTest-831885656 None] Lock "cinder-quobyte-50aff0e0-c7ef-494a-9a75-f2b52ec0d407" released by "delete_volume" :: held 1.420s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:02:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-71f3e450-78c5-4fa7-be84-3f4b1f472b3b 1073741824" returned: 0 in 0.791s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:54 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-a95a7acd-fb50-46e9-ab1c-e57c5b6a71af tempest-CreateVolumesFromImageTest-831885656 None] Created reservations ['0fb9d202-5d74-40b4-a7e6-a24d73511c5e', 'd4ff8f40-3f72-4aff-bdb3-8b34db574df3', 'c93a4844-b3a6-4715-84ce-67aec203f82a', '87f3684e-8941-46b9-8724-ba52c804d287'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 06:02:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-71f3e450-78c5-4fa7-be84-3f4b1f472b3b {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:54 devstack sudo[110842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-71f3e450-78c5-4fa7-be84-3f4b1f472b3b Jun 17 06:02:54 devstack sudo[110842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-a95a7acd-fb50-46e9-ab1c-e57c5b6a71af tempest-CreateVolumesFromImageTest-831885656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:02:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-a95a7acd-fb50-46e9-ab1c-e57c5b6a71af tempest-CreateVolumesFromImageTest-831885656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:02:55 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-a95a7acd-fb50-46e9-ab1c-e57c5b6a71af tempest-CreateVolumesFromImageTest-831885656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 06:02:55 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-a95a7acd-fb50-46e9-ab1c-e57c5b6a71af tempest-CreateVolumesFromImageTest-831885656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 06:02:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-a95a7acd-fb50-46e9-ab1c-e57c5b6a71af tempest-CreateVolumesFromImageTest-831885656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:02:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a95a7acd-fb50-46e9-ab1c-e57c5b6a71af tempest-CreateVolumesFromImageTest-831885656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:55 devstack sudo[110844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 06:02:55 devstack sudo[110844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-51bcf60b-9778-4097-b995-2b055a1eff80 tempest-CinderUnicodeTest-1598248645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:02:55 devstack sudo[110842]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-71f3e450-78c5-4fa7-be84-3f4b1f472b3b" returned: 0 in 0.650s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:55 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] <== create_volume: return (1509ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 06:02:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.514s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:02:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-01161bcb-2233-4acf-99a6-0e0966d679d5 tempest-CreateVolumesFromSnapshotTest-309904984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.252s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:02:55 devstack sudo[110844]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a95a7acd-fb50-46e9-ab1c-e57c5b6a71af tempest-CreateVolumesFromImageTest-831885656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.613s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:55 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-a95a7acd-fb50-46e9-ab1c-e57c5b6a71af tempest-CreateVolumesFromImageTest-831885656 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 06:02:55 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-74d4a7cd-893f-4768-8f67-30404152e95b tempest-CreateVolumesFromImageTest-831885656 None] Acquiring lock "cinder-051fa7d8-d607-454c-9270-4cc2b78ed1c6-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:02:55 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-01161bcb-2233-4acf-99a6-0e0966d679d5 tempest-CreateVolumesFromSnapshotTest-309904984 None] Creating offline snapshot c9d96988-40df-4503-abd5-81b2bcaedf76 of volume be813a23-b798-4f1d-9217-614239ea1735 {{(pid=92083) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 17 06:02:55 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-a95a7acd-fb50-46e9-ab1c-e57c5b6a71af tempest-CreateVolumesFromImageTest-831885656 None] Deleted volume successfully. Jun 17 06:02:55 devstack cinder-volume[92083]: DEBUG cinder.volume.volume_utils [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] Attempting download of 520a9f8f-658e-433e-a05a-85de6d34572d ((None, [{'url': 'file:///opt/stack/data/glance/images/520a9f8f-658e-433e-a05a-85de6d34572d', 'metadata': {}}])) to volume 71f3e450-78c5-4fa7-be84-3f4b1f472b3b. {{(pid=92083) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 17 06:02:55 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa2a8c0-03d6-471e-b5c8-66c5fc28fc2e]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 06:02:55 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-74d4a7cd-893f-4768-8f67-30404152e95b tempest-CreateVolumesFromImageTest-831885656 None] Lock "cinder-051fa7d8-d607-454c-9270-4cc2b78ed1c6-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:02:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-01161bcb-2233-4acf-99a6-0e0966d679d5 tempest-CreateVolumesFromSnapshotTest-309904984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-be813a23-b798-4f1d-9217-614239ea1735 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:55 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-a95a7acd-fb50-46e9-ab1c-e57c5b6a71af tempest-CreateVolumesFromImageTest-831885656 None] Lock "cinder-50aff0e0-c7ef-494a-9a75-f2b52ec0d407-delete_volume" released by "delete_volume" :: held 2.331s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:02:55 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[400b29cf-4bd5-4c10-919d-b89e0a46f78f]: (4, 'raw') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 06:02:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_520a9f8f-658e-433e-a05a-85de6d34572d_nvw5x58u {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:55 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-74d4a7cd-893f-4768-8f67-30404152e95b tempest-CreateVolumesFromImageTest-831885656 None] Acquiring lock "cinder-quobyte-051fa7d8-d607-454c-9270-4cc2b78ed1c6" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:02:55 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-74d4a7cd-893f-4768-8f67-30404152e95b tempest-CreateVolumesFromImageTest-831885656 None] Lock "cinder-quobyte-051fa7d8-d607-454c-9270-4cc2b78ed1c6" acquired by "delete_volume" :: waited 0.020s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:02:55 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[446e6c95-fdaf-4b09-93ef-eb70551f0229]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 06:02:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-74d4a7cd-893f-4768-8f67-30404152e95b tempest-CreateVolumesFromImageTest-831885656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-051fa7d8-d607-454c-9270-4cc2b78ed1c6 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:55 devstack sudo[110848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-be813a23-b798-4f1d-9217-614239ea1735 Jun 17 06:02:55 devstack sudo[110848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:55 devstack sudo[110849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_520a9f8f-658e-433e-a05a-85de6d34572d_nvw5x58u Jun 17 06:02:55 devstack sudo[110849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:55 devstack sudo[110850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-051fa7d8-d607-454c-9270-4cc2b78ed1c6 Jun 17 06:02:55 devstack sudo[110850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:56 devstack sudo[110849]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:56 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_520a9f8f-658e-433e-a05a-85de6d34572d_nvw5x58u" returned: 0 in 0.714s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:56 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_520a9f8f-658e-433e-a05a-85de6d34572d_nvw5x58u {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:56 devstack sudo[110848]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:56 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-01161bcb-2233-4acf-99a6-0e0966d679d5 tempest-CreateVolumesFromSnapshotTest-309904984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-be813a23-b798-4f1d-9217-614239ea1735" returned: 0 in 0.806s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:56 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-01161bcb-2233-4acf-99a6-0e0966d679d5 tempest-CreateVolumesFromSnapshotTest-309904984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-be813a23-b798-4f1d-9217-614239ea1735,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-be813a23-b798-4f1d-9217-614239ea1735.c9d96988-40df-4503-abd5-81b2bcaedf76 1G {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:56 devstack sudo[110864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-be813a23-b798-4f1d-9217-614239ea1735,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-be813a23-b798-4f1d-9217-614239ea1735.c9d96988-40df-4503-abd5-81b2bcaedf76 1G Jun 17 06:02:56 devstack sudo[110864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:56 devstack sudo[110850]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:56 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-74d4a7cd-893f-4768-8f67-30404152e95b tempest-CreateVolumesFromImageTest-831885656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-051fa7d8-d607-454c-9270-4cc2b78ed1c6" returned: 0 in 0.732s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:56 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-74d4a7cd-893f-4768-8f67-30404152e95b tempest-CreateVolumesFromImageTest-831885656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-051fa7d8-d607-454c-9270-4cc2b78ed1c6 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:56 devstack sudo[110866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-051fa7d8-d607-454c-9270-4cc2b78ed1c6 Jun 17 06:02:56 devstack sudo[110866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:56 devstack sudo[110863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_520a9f8f-658e-433e-a05a-85de6d34572d_nvw5x58u Jun 17 06:02:56 devstack sudo[110863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:57 devstack sudo[110863]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:57 devstack sudo[110866]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_520a9f8f-658e-433e-a05a-85de6d34572d_nvw5x58u" returned: 1 in 0.720s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_520a9f8f-658e-433e-a05a-85de6d34572d_nvw5x58u' failed. Not Retrying. {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 06:02:57 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[045ca29e-8eb0-408a-930f-e0b78bfb61b9]: (4, 'raw') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 06:02:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_520a9f8f-658e-433e-a05a-85de6d34572d_6tawwx6kdevstack@QuobyteHD {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-74d4a7cd-893f-4768-8f67-30404152e95b tempest-CreateVolumesFromImageTest-831885656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-051fa7d8-d607-454c-9270-4cc2b78ed1c6" returned: 0 in 0.648s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:57 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-74d4a7cd-893f-4768-8f67-30404152e95b tempest-CreateVolumesFromImageTest-831885656 None] Lock "cinder-quobyte-051fa7d8-d607-454c-9270-4cc2b78ed1c6" released by "delete_volume" :: held 1.440s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:02:57 devstack sudo[110864]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-01161bcb-2233-4acf-99a6-0e0966d679d5 tempest-CreateVolumesFromSnapshotTest-309904984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-be813a23-b798-4f1d-9217-614239ea1735,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-be813a23-b798-4f1d-9217-614239ea1735.c9d96988-40df-4503-abd5-81b2bcaedf76 1G" returned: 0 in 0.774s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-01161bcb-2233-4acf-99a6-0e0966d679d5 tempest-CreateVolumesFromSnapshotTest-309904984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be813a23-b798-4f1d-9217-614239ea1735 -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-be813a23-b798-4f1d-9217-614239ea1735.c9d96988-40df-4503-abd5-81b2bcaedf76 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:57 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-74d4a7cd-893f-4768-8f67-30404152e95b tempest-CreateVolumesFromImageTest-831885656 None] Created reservations ['0b2931cf-472a-45d5-a527-56c352a26ed7', '54c006bd-2f2a-4eeb-830c-c74f15c79bf8', 'c69a9705-9b5e-4863-8adb-3075dc248329', '88e9e60b-ce36-4f32-a272-57b9a330bfc5'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 06:02:57 devstack sudo[110876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be813a23-b798-4f1d-9217-614239ea1735 -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-be813a23-b798-4f1d-9217-614239ea1735.c9d96988-40df-4503-abd5-81b2bcaedf76 Jun 17 06:02:57 devstack sudo[110876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:57 devstack sudo[110875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_520a9f8f-658e-433e-a05a-85de6d34572d_6tawwx6kdevstack@QuobyteHD Jun 17 06:02:57 devstack sudo[110875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-74d4a7cd-893f-4768-8f67-30404152e95b tempest-CreateVolumesFromImageTest-831885656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:02:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-74d4a7cd-893f-4768-8f67-30404152e95b tempest-CreateVolumesFromImageTest-831885656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:02:57 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-74d4a7cd-893f-4768-8f67-30404152e95b tempest-CreateVolumesFromImageTest-831885656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 06:02:57 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-74d4a7cd-893f-4768-8f67-30404152e95b tempest-CreateVolumesFromImageTest-831885656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 06:02:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-74d4a7cd-893f-4768-8f67-30404152e95b tempest-CreateVolumesFromImageTest-831885656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:02:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-74d4a7cd-893f-4768-8f67-30404152e95b tempest-CreateVolumesFromImageTest-831885656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:57 devstack sudo[110879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 06:02:57 devstack sudo[110879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:57 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-b6f9ca40-0274-4ac8-9bdc-02c76e364a26 tempest-CreateVolumesFromImageTest-831885656 None] Acquiring lock "cinder-0ac09bfa-2a4b-4bfe-9213-dd9e871c8898-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:02:57 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-b6f9ca40-0274-4ac8-9bdc-02c76e364a26 tempest-CreateVolumesFromImageTest-831885656 None] Lock "cinder-0ac09bfa-2a4b-4bfe-9213-dd9e871c8898-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:02:57 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-b6f9ca40-0274-4ac8-9bdc-02c76e364a26 tempest-CreateVolumesFromImageTest-831885656 None] Acquiring lock "cinder-quobyte-0ac09bfa-2a4b-4bfe-9213-dd9e871c8898" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:02:57 devstack sudo[110875]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_520a9f8f-658e-433e-a05a-85de6d34572d_6tawwx6kdevstack@QuobyteHD" returned: 0 in 0.772s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_520a9f8f-658e-433e-a05a-85de6d34572d_6tawwx6kdevstack@QuobyteHD {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:57 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-b6f9ca40-0274-4ac8-9bdc-02c76e364a26 tempest-CreateVolumesFromImageTest-831885656 None] Lock "cinder-quobyte-0ac09bfa-2a4b-4bfe-9213-dd9e871c8898" acquired by "delete_volume" :: waited 0.040s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:02:58 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[679ea86a-fd96-4d34-91d4-45f090bd19d6]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 06:02:58 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b6f9ca40-0274-4ac8-9bdc-02c76e364a26 tempest-CreateVolumesFromImageTest-831885656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0ac09bfa-2a4b-4bfe-9213-dd9e871c8898 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:58 devstack sudo[110876]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:58 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-01161bcb-2233-4acf-99a6-0e0966d679d5 tempest-CreateVolumesFromSnapshotTest-309904984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be813a23-b798-4f1d-9217-614239ea1735 -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-be813a23-b798-4f1d-9217-614239ea1735.c9d96988-40df-4503-abd5-81b2bcaedf76" returned: 0 in 0.765s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:58 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [None req-01161bcb-2233-4acf-99a6-0e0966d679d5 tempest-CreateVolumesFromSnapshotTest-309904984 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-be813a23-b798-4f1d-9217-614239ea1735.c9d96988-40df-4503-abd5-81b2bcaedf76 is being set with open permissions: ugo+rw Jun 17 06:02:58 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-01161bcb-2233-4acf-99a6-0e0966d679d5 tempest-CreateVolumesFromSnapshotTest-309904984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-be813a23-b798-4f1d-9217-614239ea1735.c9d96988-40df-4503-abd5-81b2bcaedf76 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:58 devstack sudo[110879]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:58 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-74d4a7cd-893f-4768-8f67-30404152e95b tempest-CreateVolumesFromImageTest-831885656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.691s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:58 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-74d4a7cd-893f-4768-8f67-30404152e95b tempest-CreateVolumesFromImageTest-831885656 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 06:02:58 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-74d4a7cd-893f-4768-8f67-30404152e95b tempest-CreateVolumesFromImageTest-831885656 None] Deleted volume successfully. Jun 17 06:02:58 devstack sudo[110889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-be813a23-b798-4f1d-9217-614239ea1735.c9d96988-40df-4503-abd5-81b2bcaedf76 Jun 17 06:02:58 devstack sudo[110889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:58 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-74d4a7cd-893f-4768-8f67-30404152e95b tempest-CreateVolumesFromImageTest-831885656 None] Lock "cinder-051fa7d8-d607-454c-9270-4cc2b78ed1c6-delete_volume" released by "delete_volume" :: held 2.419s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:02:58 devstack sudo[110887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_520a9f8f-658e-433e-a05a-85de6d34572d_6tawwx6kdevstack@QuobyteHD Jun 17 06:02:58 devstack sudo[110887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:58 devstack sudo[110888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0ac09bfa-2a4b-4bfe-9213-dd9e871c8898 Jun 17 06:02:58 devstack sudo[110888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:58 devstack sudo[110889]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:58 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-01161bcb-2233-4acf-99a6-0e0966d679d5 tempest-CreateVolumesFromSnapshotTest-309904984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-be813a23-b798-4f1d-9217-614239ea1735.c9d96988-40df-4503-abd5-81b2bcaedf76" returned: 0 in 0.641s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:58 devstack sudo[110887]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:58 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_520a9f8f-658e-433e-a05a-85de6d34572d_6tawwx6kdevstack@QuobyteHD" returned: 1 in 0.741s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:58 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_520a9f8f-658e-433e-a05a-85de6d34572d_6tawwx6kdevstack@QuobyteHD' failed. Not Retrying. {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 06:02:58 devstack cinder-volume[92083]: DEBUG cinder.image.image_utils [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] 520a9f8f-658e-433e-a05a-85de6d34572d was raw, converting to raw {{(pid=92083) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 17 06:02:58 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_520a9f8f-658e-433e-a05a-85de6d34572d_6tawwx6kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-71f3e450-78c5-4fa7-be84-3f4b1f472b3b {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:58 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-01161bcb-2233-4acf-99a6-0e0966d679d5 tempest-CreateVolumesFromSnapshotTest-309904984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-be813a23-b798-4f1d-9217-614239ea1735.info {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:58 devstack sudo[110900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_520a9f8f-658e-433e-a05a-85de6d34572d_6tawwx6kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-71f3e450-78c5-4fa7-be84-3f4b1f472b3b Jun 17 06:02:58 devstack sudo[110900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:58 devstack sudo[110888]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:58 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b6f9ca40-0274-4ac8-9bdc-02c76e364a26 tempest-CreateVolumesFromImageTest-831885656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0ac09bfa-2a4b-4bfe-9213-dd9e871c8898" returned: 0 in 0.737s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:58 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b6f9ca40-0274-4ac8-9bdc-02c76e364a26 tempest-CreateVolumesFromImageTest-831885656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0ac09bfa-2a4b-4bfe-9213-dd9e871c8898 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:58 devstack sudo[110901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-be813a23-b798-4f1d-9217-614239ea1735.info Jun 17 06:02:58 devstack sudo[110901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:58 devstack sudo[110903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0ac09bfa-2a4b-4bfe-9213-dd9e871c8898 Jun 17 06:02:58 devstack sudo[110903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:59 devstack sudo[110901]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:59 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-01161bcb-2233-4acf-99a6-0e0966d679d5 tempest-CreateVolumesFromSnapshotTest-309904984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-be813a23-b798-4f1d-9217-614239ea1735.info" returned: 0 in 0.649s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:59 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [None req-01161bcb-2233-4acf-99a6-0e0966d679d5 tempest-CreateVolumesFromSnapshotTest-309904984 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-be813a23-b798-4f1d-9217-614239ea1735.info is being set with open permissions: ugo+rw Jun 17 06:02:59 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-01161bcb-2233-4acf-99a6-0e0966d679d5 tempest-CreateVolumesFromSnapshotTest-309904984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-be813a23-b798-4f1d-9217-614239ea1735.info {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:59 devstack sudo[110903]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:59 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b6f9ca40-0274-4ac8-9bdc-02c76e364a26 tempest-CreateVolumesFromImageTest-831885656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0ac09bfa-2a4b-4bfe-9213-dd9e871c8898" returned: 0 in 0.642s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:59 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-b6f9ca40-0274-4ac8-9bdc-02c76e364a26 tempest-CreateVolumesFromImageTest-831885656 None] Lock "cinder-quobyte-0ac09bfa-2a4b-4bfe-9213-dd9e871c8898" released by "delete_volume" :: held 1.435s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:02:59 devstack sudo[110911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-be813a23-b798-4f1d-9217-614239ea1735.info Jun 17 06:02:59 devstack sudo[110911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:59 devstack sudo[110900]: pam_unix(sudo:session): session closed for user root Jun 17 06:02:59 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_520a9f8f-658e-433e-a05a-85de6d34572d_6tawwx6kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-71f3e450-78c5-4fa7-be84-3f4b1f472b3b" returned: 0 in 0.733s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:02:59 devstack cinder-volume[92083]: DEBUG cinder.image.image_utils [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_520a9f8f-658e-433e-a05a-85de6d34572d_6tawwx6kdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-71f3e450-78c5-4fa7-be84-3f4b1f472b3b {{(pid=92083) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 17 06:02:59 devstack cinder-volume[92083]: INFO cinder.image.image_utils [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] Converted 0.00 MB image at 0.00 MB/s Jun 17 06:02:59 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-71f3e450-78c5-4fa7-be84-3f4b1f472b3b 1G {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:59 devstack sudo[110914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-71f3e450-78c5-4fa7-be84-3f4b1f472b3b 1G Jun 17 06:02:59 devstack sudo[110914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:02:59 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-b6f9ca40-0274-4ac8-9bdc-02c76e364a26 tempest-CreateVolumesFromImageTest-831885656 None] Created reservations ['8c2ae69d-203d-4144-b160-bf68dd332204', '347c939f-1e8a-4ac3-837b-4419c042c743', '7de71dd0-a8d2-4495-90e0-c10376a1c92e', '610022e7-e949-453e-a539-4f5984ff5f0d'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 06:02:59 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-b6f9ca40-0274-4ac8-9bdc-02c76e364a26 tempest-CreateVolumesFromImageTest-831885656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:02:59 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-b6f9ca40-0274-4ac8-9bdc-02c76e364a26 tempest-CreateVolumesFromImageTest-831885656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:02:59 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-b6f9ca40-0274-4ac8-9bdc-02c76e364a26 tempest-CreateVolumesFromImageTest-831885656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 06:02:59 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-b6f9ca40-0274-4ac8-9bdc-02c76e364a26 tempest-CreateVolumesFromImageTest-831885656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 06:02:59 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-b6f9ca40-0274-4ac8-9bdc-02c76e364a26 tempest-CreateVolumesFromImageTest-831885656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:02:59 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b6f9ca40-0274-4ac8-9bdc-02c76e364a26 tempest-CreateVolumesFromImageTest-831885656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:02:59 devstack sudo[110916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 06:02:59 devstack sudo[110916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:00 devstack sudo[110911]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:00 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-01161bcb-2233-4acf-99a6-0e0966d679d5 tempest-CreateVolumesFromSnapshotTest-309904984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-be813a23-b798-4f1d-9217-614239ea1735.info" returned: 0 in 0.666s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:00 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-01161bcb-2233-4acf-99a6-0e0966d679d5 tempest-CreateVolumesFromSnapshotTest-309904984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.468s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:03:00 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-51bcf60b-9778-4097-b995-2b055a1eff80 tempest-CinderUnicodeTest-1598248645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.662s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:03:00 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-51bcf60b-9778-4097-b995-2b055a1eff80 tempest-CinderUnicodeTest-1598248645 None] Creating offline snapshot c6d0e575-8300-47a7-a479-4821110428c0 of volume 8ee2740c-e933-4c89-8489-5fb0297e2917 {{(pid=92083) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 17 06:03:00 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-01161bcb-2233-4acf-99a6-0e0966d679d5 tempest-CreateVolumesFromSnapshotTest-309904984 None] Create snapshot completed successfully Jun 17 06:03:00 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[155ecce6-350c-4acc-9c3a-7a52968ad33e]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 06:03:00 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-51bcf60b-9778-4097-b995-2b055a1eff80 tempest-CinderUnicodeTest-1598248645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-8ee2740c-e933-4c89-8489-5fb0297e2917 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:00 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-036c50f7-5abb-4643-a4fb-f4c309aa2c29 tempest-CreateVolumesFromImageTest-831885656 None] Acquiring lock "cinder-471f2815-c7e9-4e2f-aa17-49b943112e03-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:03:00 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-036c50f7-5abb-4643-a4fb-f4c309aa2c29 tempest-CreateVolumesFromImageTest-831885656 None] Lock "cinder-471f2815-c7e9-4e2f-aa17-49b943112e03-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:03:00 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-036c50f7-5abb-4643-a4fb-f4c309aa2c29 tempest-CreateVolumesFromImageTest-831885656 None] Acquiring lock "cinder-quobyte-471f2815-c7e9-4e2f-aa17-49b943112e03" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:03:00 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-036c50f7-5abb-4643-a4fb-f4c309aa2c29 tempest-CreateVolumesFromImageTest-831885656 None] Lock "cinder-quobyte-471f2815-c7e9-4e2f-aa17-49b943112e03" acquired by "delete_volume" :: waited 0.025s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:03:00 devstack sudo[110914]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:00 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-71f3e450-78c5-4fa7-be84-3f4b1f472b3b 1G" returned: 0 in 0.874s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:00 devstack sudo[110916]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:00 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b6f9ca40-0274-4ac8-9bdc-02c76e364a26 tempest-CreateVolumesFromImageTest-831885656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.768s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:00 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-b6f9ca40-0274-4ac8-9bdc-02c76e364a26 tempest-CreateVolumesFromImageTest-831885656 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 06:03:00 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d89d3e7-297a-4f32-9f92-59c67126654c]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 06:03:00 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-036c50f7-5abb-4643-a4fb-f4c309aa2c29 tempest-CreateVolumesFromImageTest-831885656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-471f2815-c7e9-4e2f-aa17-49b943112e03 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:00 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-b6f9ca40-0274-4ac8-9bdc-02c76e364a26 tempest-CreateVolumesFromImageTest-831885656 None] Deleted volume successfully. Jun 17 06:03:00 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-b6f9ca40-0274-4ac8-9bdc-02c76e364a26 tempest-CreateVolumesFromImageTest-831885656 None] Lock "cinder-0ac09bfa-2a4b-4bfe-9213-dd9e871c8898-delete_volume" released by "delete_volume" :: held 2.497s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:03:00 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[6816e6ad-8f95-4777-a05c-314fad5d5b90]: (4, 'raw') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 06:03:00 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-71f3e450-78c5-4fa7-be84-3f4b1f472b3b {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:00 devstack sudo[110923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-8ee2740c-e933-4c89-8489-5fb0297e2917 Jun 17 06:03:00 devstack sudo[110923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:00 devstack sudo[110925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-471f2815-c7e9-4e2f-aa17-49b943112e03 Jun 17 06:03:00 devstack sudo[110925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:00 devstack sudo[110927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-71f3e450-78c5-4fa7-be84-3f4b1f472b3b Jun 17 06:03:00 devstack sudo[110927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:01 devstack sudo[110923]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:01 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-51bcf60b-9778-4097-b995-2b055a1eff80 tempest-CinderUnicodeTest-1598248645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-8ee2740c-e933-4c89-8489-5fb0297e2917" returned: 0 in 0.906s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:01 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-51bcf60b-9778-4097-b995-2b055a1eff80 tempest-CinderUnicodeTest-1598248645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-8ee2740c-e933-4c89-8489-5fb0297e2917,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-8ee2740c-e933-4c89-8489-5fb0297e2917.c6d0e575-8300-47a7-a479-4821110428c0 1G {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:01 devstack sudo[110937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-8ee2740c-e933-4c89-8489-5fb0297e2917,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-8ee2740c-e933-4c89-8489-5fb0297e2917.c6d0e575-8300-47a7-a479-4821110428c0 1G Jun 17 06:03:01 devstack sudo[110937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:01 devstack sudo[110925]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:01 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-036c50f7-5abb-4643-a4fb-f4c309aa2c29 tempest-CreateVolumesFromImageTest-831885656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-471f2815-c7e9-4e2f-aa17-49b943112e03" returned: 0 in 0.891s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:01 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-036c50f7-5abb-4643-a4fb-f4c309aa2c29 tempest-CreateVolumesFromImageTest-831885656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-471f2815-c7e9-4e2f-aa17-49b943112e03 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:01 devstack sudo[110941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-471f2815-c7e9-4e2f-aa17-49b943112e03 Jun 17 06:03:01 devstack sudo[110941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:01 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a9e255a-3e47-4e34-9ec7-a3220c1ee99b tempest-CreateVolumesFromSnapshotTest-309904984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 06:03:01 devstack sudo[110927]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:01 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4a9e255a-3e47-4e34-9ec7-a3220c1ee99b tempest-CreateVolumesFromSnapshotTest-309904984 None] Flow 'volume_create_manager' (960c09f5-14b6-4a84-a2d2-802dce4fb2a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 06:03:01 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4a9e255a-3e47-4e34-9ec7-a3220c1ee99b tempest-CreateVolumesFromSnapshotTest-309904984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (722f07a9-f533-4492-b4f7-021d7c375eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:01 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-71f3e450-78c5-4fa7-be84-3f4b1f472b3b" returned: 0 in 1.007s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:01 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-71f3e450-78c5-4fa7-be84-3f4b1f472b3b {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:01 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4a9e255a-3e47-4e34-9ec7-a3220c1ee99b tempest-CreateVolumesFromSnapshotTest-309904984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (722f07a9-f533-4492-b4f7-021d7c375eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T04:03:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-316445020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=838fd2f6-b734-49dd-a60e-06de131c5d54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec2a339a1c5349309d139acd7586d036',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T04:03:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T04:03:01Z,use_quota=True,user_id='59f6ed0a529b4a3fa4f275ebe7bbb708',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:01 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4a9e255a-3e47-4e34-9ec7-a3220c1ee99b tempest-CreateVolumesFromSnapshotTest-309904984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (596c3d18-9bd4-4422-a20b-9c69dd178675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:01 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4a9e255a-3e47-4e34-9ec7-a3220c1ee99b tempest-CreateVolumesFromSnapshotTest-309904984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (596c3d18-9bd4-4422-a20b-9c69dd178675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:01 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4a9e255a-3e47-4e34-9ec7-a3220c1ee99b tempest-CreateVolumesFromSnapshotTest-309904984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8bbc8e8-9d2c-4661-b2a4-7462ba81b1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:01 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4a9e255a-3e47-4e34-9ec7-a3220c1ee99b tempest-CreateVolumesFromSnapshotTest-309904984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8bbc8e8-9d2c-4661-b2a4-7462ba81b1cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '838fd2f6-b734-49dd-a60e-06de131c5d54', 'volume_name': 'volume-838fd2f6-b734-49dd-a60e-06de131c5d54', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:01 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4a9e255a-3e47-4e34-9ec7-a3220c1ee99b tempest-CreateVolumesFromSnapshotTest-309904984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1b2e9e5-1fa7-44e5-929d-b4a2d60ca3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:01 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4a9e255a-3e47-4e34-9ec7-a3220c1ee99b tempest-CreateVolumesFromSnapshotTest-309904984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1b2e9e5-1fa7-44e5-929d-b4a2d60ca3e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:01 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4a9e255a-3e47-4e34-9ec7-a3220c1ee99b tempest-CreateVolumesFromSnapshotTest-309904984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (330e8cd1-eb36-4559-8d53-7aa67a1def4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:01 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-4a9e255a-3e47-4e34-9ec7-a3220c1ee99b tempest-CreateVolumesFromSnapshotTest-309904984 None] Volume 838fd2f6-b734-49dd-a60e-06de131c5d54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-838fd2f6-b734-49dd-a60e-06de131c5d54', 'volume_size': 1} Jun 17 06:03:01 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-4a9e255a-3e47-4e34-9ec7-a3220c1ee99b tempest-CreateVolumesFromSnapshotTest-309904984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:03:01 devstack sudo[110943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-71f3e450-78c5-4fa7-be84-3f4b1f472b3b Jun 17 06:03:01 devstack sudo[110943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:01 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-19113ee2-1cf2-4270-b03c-8f35967c294e tempest-CreateVolumesFromSnapshotTest-309904984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 06:03:01 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-19113ee2-1cf2-4270-b03c-8f35967c294e tempest-CreateVolumesFromSnapshotTest-309904984 None] Flow 'volume_create_manager' (0785f6fd-bef1-4008-bf13-4dc3f5b8f4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 06:03:01 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-19113ee2-1cf2-4270-b03c-8f35967c294e tempest-CreateVolumesFromSnapshotTest-309904984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b53747a4-30f2-4519-af3f-9b7b8ad806f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:01 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-19113ee2-1cf2-4270-b03c-8f35967c294e tempest-CreateVolumesFromSnapshotTest-309904984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b53747a4-30f2-4519-af3f-9b7b8ad806f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T04:03:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1413783308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20239d68-f922-4039-ae6a-83af6aeab024,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec2a339a1c5349309d139acd7586d036',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T04:03:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T04:03:02Z,use_quota=True,user_id='59f6ed0a529b4a3fa4f275ebe7bbb708',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:01 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-19113ee2-1cf2-4270-b03c-8f35967c294e tempest-CreateVolumesFromSnapshotTest-309904984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7eb33d6-dff0-496b-86c8-1ea42b978405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:01 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-19113ee2-1cf2-4270-b03c-8f35967c294e tempest-CreateVolumesFromSnapshotTest-309904984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7eb33d6-dff0-496b-86c8-1ea42b978405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:01 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-19113ee2-1cf2-4270-b03c-8f35967c294e tempest-CreateVolumesFromSnapshotTest-309904984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3247bfe-8024-444b-863e-e4e27751822e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:01 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-19113ee2-1cf2-4270-b03c-8f35967c294e tempest-CreateVolumesFromSnapshotTest-309904984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3247bfe-8024-444b-863e-e4e27751822e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20239d68-f922-4039-ae6a-83af6aeab024', 'volume_name': 'volume-20239d68-f922-4039-ae6a-83af6aeab024', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:01 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-19113ee2-1cf2-4270-b03c-8f35967c294e tempest-CreateVolumesFromSnapshotTest-309904984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bd8d360-128e-4bb9-aed8-6b7dddbc24c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:01 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-19113ee2-1cf2-4270-b03c-8f35967c294e tempest-CreateVolumesFromSnapshotTest-309904984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bd8d360-128e-4bb9-aed8-6b7dddbc24c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:01 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-19113ee2-1cf2-4270-b03c-8f35967c294e tempest-CreateVolumesFromSnapshotTest-309904984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50aafaff-4fc7-40ef-a0df-f190bb7334fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:01 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-19113ee2-1cf2-4270-b03c-8f35967c294e tempest-CreateVolumesFromSnapshotTest-309904984 None] Volume 20239d68-f922-4039-ae6a-83af6aeab024: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20239d68-f922-4039-ae6a-83af6aeab024', 'volume_size': 1} Jun 17 06:03:01 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-19113ee2-1cf2-4270-b03c-8f35967c294e tempest-CreateVolumesFromSnapshotTest-309904984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:03:02 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dc3dac9-67ce-4a0e-a433-90a8fa2e13ac tempest-CreateVolumesFromSnapshotTest-309904984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 06:03:02 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8dc3dac9-67ce-4a0e-a433-90a8fa2e13ac tempest-CreateVolumesFromSnapshotTest-309904984 None] Flow 'volume_create_manager' (c6dbca4f-5e22-4a59-8e73-4719e019f84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 06:03:02 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8dc3dac9-67ce-4a0e-a433-90a8fa2e13ac tempest-CreateVolumesFromSnapshotTest-309904984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34da08bf-a84f-4a5e-ab30-ab9c1bbb17fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:02 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8dc3dac9-67ce-4a0e-a433-90a8fa2e13ac tempest-CreateVolumesFromSnapshotTest-309904984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34da08bf-a84f-4a5e-ab30-ab9c1bbb17fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T04:03:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1426967506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9023bdb6-76eb-4cb6-b3ab-6be705910839,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec2a339a1c5349309d139acd7586d036',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T04:03:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T04:03:02Z,use_quota=True,user_id='59f6ed0a529b4a3fa4f275ebe7bbb708',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:02 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8dc3dac9-67ce-4a0e-a433-90a8fa2e13ac tempest-CreateVolumesFromSnapshotTest-309904984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64415277-fb40-4f39-9ad1-5f94305d597e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:02 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8dc3dac9-67ce-4a0e-a433-90a8fa2e13ac tempest-CreateVolumesFromSnapshotTest-309904984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64415277-fb40-4f39-9ad1-5f94305d597e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:02 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8dc3dac9-67ce-4a0e-a433-90a8fa2e13ac tempest-CreateVolumesFromSnapshotTest-309904984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2019026c-1c8d-4f14-b84a-7a962caad993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:02 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8dc3dac9-67ce-4a0e-a433-90a8fa2e13ac tempest-CreateVolumesFromSnapshotTest-309904984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2019026c-1c8d-4f14-b84a-7a962caad993) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9023bdb6-76eb-4cb6-b3ab-6be705910839', 'volume_name': 'volume-9023bdb6-76eb-4cb6-b3ab-6be705910839', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:02 devstack sudo[110937]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:02 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8dc3dac9-67ce-4a0e-a433-90a8fa2e13ac tempest-CreateVolumesFromSnapshotTest-309904984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac8f39b0-278d-488d-965f-b8f144be578e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:02 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8dc3dac9-67ce-4a0e-a433-90a8fa2e13ac tempest-CreateVolumesFromSnapshotTest-309904984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac8f39b0-278d-488d-965f-b8f144be578e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:02 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8dc3dac9-67ce-4a0e-a433-90a8fa2e13ac tempest-CreateVolumesFromSnapshotTest-309904984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82740c7e-b242-43a3-b59a-25c35da4801b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:02 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-8dc3dac9-67ce-4a0e-a433-90a8fa2e13ac tempest-CreateVolumesFromSnapshotTest-309904984 None] Volume 9023bdb6-76eb-4cb6-b3ab-6be705910839: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9023bdb6-76eb-4cb6-b3ab-6be705910839', 'volume_size': 1} Jun 17 06:03:02 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-8dc3dac9-67ce-4a0e-a433-90a8fa2e13ac tempest-CreateVolumesFromSnapshotTest-309904984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:03:02 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-51bcf60b-9778-4097-b995-2b055a1eff80 tempest-CinderUnicodeTest-1598248645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-8ee2740c-e933-4c89-8489-5fb0297e2917,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-8ee2740c-e933-4c89-8489-5fb0297e2917.c6d0e575-8300-47a7-a479-4821110428c0 1G" returned: 0 in 1.194s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:02 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-51bcf60b-9778-4097-b995-2b055a1eff80 tempest-CinderUnicodeTest-1598248645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ee2740c-e933-4c89-8489-5fb0297e2917 -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-8ee2740c-e933-4c89-8489-5fb0297e2917.c6d0e575-8300-47a7-a479-4821110428c0 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:02 devstack sudo[110941]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:02 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-036c50f7-5abb-4643-a4fb-f4c309aa2c29 tempest-CreateVolumesFromImageTest-831885656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-471f2815-c7e9-4e2f-aa17-49b943112e03" returned: 0 in 1.064s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:02 devstack sudo[110950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ee2740c-e933-4c89-8489-5fb0297e2917 -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-8ee2740c-e933-4c89-8489-5fb0297e2917.c6d0e575-8300-47a7-a479-4821110428c0 Jun 17 06:03:02 devstack sudo[110950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:02 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-036c50f7-5abb-4643-a4fb-f4c309aa2c29 tempest-CreateVolumesFromImageTest-831885656 None] Lock "cinder-quobyte-471f2815-c7e9-4e2f-aa17-49b943112e03" released by "delete_volume" :: held 2.020s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:03:02 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-036c50f7-5abb-4643-a4fb-f4c309aa2c29 tempest-CreateVolumesFromImageTest-831885656 None] Created reservations ['0ab899cf-4dbf-413a-8a25-8babcae754f6', 'bf053baa-4cff-411c-b9d4-d9638c89021b', 'a73cb8b8-b6d2-4c3b-9548-ce9ca08ac82c', 'ae35bf59-5aa6-493c-9777-4f19722abaa8'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 06:03:02 devstack sudo[110943]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:02 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-71f3e450-78c5-4fa7-be84-3f4b1f472b3b" returned: 1 in 1.202s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:02 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-71f3e450-78c5-4fa7-be84-3f4b1f472b3b' failed. Not Retrying. {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 06:03:02 devstack cinder-volume[92083]: DEBUG cinder.volume.volume_utils [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] Downloaded image 520a9f8f-658e-433e-a05a-85de6d34572d ((None, [{'url': 'file:///opt/stack/data/glance/images/520a9f8f-658e-433e-a05a-85de6d34572d', 'metadata': {}}])) to volume 71f3e450-78c5-4fa7-be84-3f4b1f472b3b successfully. {{(pid=92083) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 17 06:03:02 devstack cinder-volume[92083]: DEBUG cinder.image.image_utils [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] Temporary image 520a9f8f-658e-433e-a05a-85de6d34572d for user e9c22439b7a344c580228ad555ea0872 is deleted. {{(pid=92083) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 17 06:03:02 devstack cinder-volume[92083]: DEBUG cinder.volume.volume_utils [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] Marking volume 71f3e450-78c5-4fa7-be84-3f4b1f472b3b as bootable. {{(pid=92083) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 17 06:03:02 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-036c50f7-5abb-4643-a4fb-f4c309aa2c29 tempest-CreateVolumesFromImageTest-831885656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:03:02 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-036c50f7-5abb-4643-a4fb-f4c309aa2c29 tempest-CreateVolumesFromImageTest-831885656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:03:02 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-036c50f7-5abb-4643-a4fb-f4c309aa2c29 tempest-CreateVolumesFromImageTest-831885656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 06:03:02 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-036c50f7-5abb-4643-a4fb-f4c309aa2c29 tempest-CreateVolumesFromImageTest-831885656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 06:03:02 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-036c50f7-5abb-4643-a4fb-f4c309aa2c29 tempest-CreateVolumesFromImageTest-831885656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:03:02 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-036c50f7-5abb-4643-a4fb-f4c309aa2c29 tempest-CreateVolumesFromImageTest-831885656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:02 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] Copying metadata from image 520a9f8f-658e-433e-a05a-85de6d34572d to 71f3e450-78c5-4fa7-be84-3f4b1f472b3b. {{(pid=92083) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 17 06:03:02 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] Creating volume glance metadata for volume 71f3e450-78c5-4fa7-be84-3f4b1f472b3b backed by image 520a9f8f-658e-433e-a05a-85de6d34572d with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '520a9f8f-658e-433e-a05a-85de6d34572d', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '01bd44dbbb069c06fcaf2622b92888a4', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=92083) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 17 06:03:02 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ed7bbcc-6d69-475e-9388-dfb680621d55 tempest-CreateVolumesFromSnapshotTest-309904984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 06:03:02 devstack sudo[110955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 06:03:02 devstack sudo[110955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:02 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0ed7bbcc-6d69-475e-9388-dfb680621d55 tempest-CreateVolumesFromSnapshotTest-309904984 None] Flow 'volume_create_manager' (1e0147a6-5516-4733-bcbb-8900633477d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 06:03:02 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0ed7bbcc-6d69-475e-9388-dfb680621d55 tempest-CreateVolumesFromSnapshotTest-309904984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1210c179-401e-4a14-be95-3e3673075c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:02 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0ed7bbcc-6d69-475e-9388-dfb680621d55 tempest-CreateVolumesFromSnapshotTest-309904984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1210c179-401e-4a14-be95-3e3673075c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T04:03:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-263992746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e21e23ae-e481-4bee-a2c7-1c9b40ccf6f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec2a339a1c5349309d139acd7586d036',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T04:03:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T04:03:03Z,use_quota=True,user_id='59f6ed0a529b4a3fa4f275ebe7bbb708',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:02 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0ed7bbcc-6d69-475e-9388-dfb680621d55 tempest-CreateVolumesFromSnapshotTest-309904984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2d30605-6a19-4eee-9376-9cac87c68a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:02 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0ed7bbcc-6d69-475e-9388-dfb680621d55 tempest-CreateVolumesFromSnapshotTest-309904984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2d30605-6a19-4eee-9376-9cac87c68a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:02 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0ed7bbcc-6d69-475e-9388-dfb680621d55 tempest-CreateVolumesFromSnapshotTest-309904984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (830c82c6-9422-489f-8b5d-b5fdc08283f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:02 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0ed7bbcc-6d69-475e-9388-dfb680621d55 tempest-CreateVolumesFromSnapshotTest-309904984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (830c82c6-9422-489f-8b5d-b5fdc08283f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e21e23ae-e481-4bee-a2c7-1c9b40ccf6f7', 'volume_name': 'volume-e21e23ae-e481-4bee-a2c7-1c9b40ccf6f7', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:02 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0ed7bbcc-6d69-475e-9388-dfb680621d55 tempest-CreateVolumesFromSnapshotTest-309904984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d0fc543-6135-4e53-a264-92b9ffe0eb46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:02 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0ed7bbcc-6d69-475e-9388-dfb680621d55 tempest-CreateVolumesFromSnapshotTest-309904984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d0fc543-6135-4e53-a264-92b9ffe0eb46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:02 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0ed7bbcc-6d69-475e-9388-dfb680621d55 tempest-CreateVolumesFromSnapshotTest-309904984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8f3ce42-13ec-4c21-b0e9-d3f37cb9cdcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:02 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-0ed7bbcc-6d69-475e-9388-dfb680621d55 tempest-CreateVolumesFromSnapshotTest-309904984 None] Volume e21e23ae-e481-4bee-a2c7-1c9b40ccf6f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e21e23ae-e481-4bee-a2c7-1c9b40ccf6f7', 'volume_size': 1} Jun 17 06:03:02 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-0ed7bbcc-6d69-475e-9388-dfb680621d55 tempest-CreateVolumesFromSnapshotTest-309904984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:03:02 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40acbe70-24b2-45bd-a484-618f5a9c47d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71f3e450-78c5-4fa7-be84-3f4b1f472b3b', 'volume_size': 1, 'image_id': '520a9f8f-658e-433e-a05a-85de6d34572d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/520a9f8f-658e-433e-a05a-85de6d34572d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '01bd44dbbb069c06fcaf2622b92888a4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'eb9d38dca22e4fa39297c75165d7ec28', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b21da800a170b010316fec64a86fb680fdcf370a940bf828d9435df5c782b8d13fef268b87bebdcf5ea5a07aff115017593f1faf902720c8122f01f1c53f7ac6', 'id': '520a9f8f-658e-433e-a05a-85de6d34572d', 'created_at': datetime.datetime(2026, 6, 17, 4, 2, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 4, 2, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/520a9f8f-658e-433e-a05a-85de6d34572d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:02 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ae1544e-031b-44b5-b41c-26a806203f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:02 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] Volume volume-71f3e450-78c5-4fa7-be84-3f4b1f472b3b (71f3e450-78c5-4fa7-be84-3f4b1f472b3b): created successfully Jun 17 06:03:02 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ae1544e-031b-44b5-b41c-26a806203f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:02 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] Flow 'volume_create_manager' (f6a188e5-f34c-46b1-9d49-3b388ef20b9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 06:03:02 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-4a5a919c-5e86-482e-9f5f-02e74185e6b6 tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] Created volume successfully. Jun 17 06:03:03 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e86eb8b-2b8b-4181-a8e4-f0dd100aa69e tempest-CreateVolumesFromSnapshotTest-309904984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 06:03:03 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0e86eb8b-2b8b-4181-a8e4-f0dd100aa69e tempest-CreateVolumesFromSnapshotTest-309904984 None] Flow 'volume_create_manager' (3d739e92-151d-4dd7-81a5-241b7c5ce81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 06:03:03 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0e86eb8b-2b8b-4181-a8e4-f0dd100aa69e tempest-CreateVolumesFromSnapshotTest-309904984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df28afe2-4819-4b90-8c39-5585a65f4c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:03 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-3f47880f-9070-4653-8499-5053ae7c448a tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] Acquiring lock "cinder-71f3e450-78c5-4fa7-be84-3f4b1f472b3b-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:03:03 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0e86eb8b-2b8b-4181-a8e4-f0dd100aa69e tempest-CreateVolumesFromSnapshotTest-309904984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df28afe2-4819-4b90-8c39-5585a65f4c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T04:03:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-578130242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3453d74f-3b66-49a9-a184-febb02e2b71a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec2a339a1c5349309d139acd7586d036',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T04:03:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T04:03:03Z,use_quota=True,user_id='59f6ed0a529b4a3fa4f275ebe7bbb708',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:03 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0e86eb8b-2b8b-4181-a8e4-f0dd100aa69e tempest-CreateVolumesFromSnapshotTest-309904984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d80be72e-ce93-46d3-bd4e-4998372530c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:03 devstack sudo[110950]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:03 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0e86eb8b-2b8b-4181-a8e4-f0dd100aa69e tempest-CreateVolumesFromSnapshotTest-309904984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d80be72e-ce93-46d3-bd4e-4998372530c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:03 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0e86eb8b-2b8b-4181-a8e4-f0dd100aa69e tempest-CreateVolumesFromSnapshotTest-309904984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (643a7fe8-f760-4176-b5ef-bd84debe0bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:03 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0e86eb8b-2b8b-4181-a8e4-f0dd100aa69e tempest-CreateVolumesFromSnapshotTest-309904984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (643a7fe8-f760-4176-b5ef-bd84debe0bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3453d74f-3b66-49a9-a184-febb02e2b71a', 'volume_name': 'volume-3453d74f-3b66-49a9-a184-febb02e2b71a', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:03 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0e86eb8b-2b8b-4181-a8e4-f0dd100aa69e tempest-CreateVolumesFromSnapshotTest-309904984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3c5189c-b3d0-41b8-84c0-e606285d1556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:03 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0e86eb8b-2b8b-4181-a8e4-f0dd100aa69e tempest-CreateVolumesFromSnapshotTest-309904984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3c5189c-b3d0-41b8-84c0-e606285d1556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:03 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0e86eb8b-2b8b-4181-a8e4-f0dd100aa69e tempest-CreateVolumesFromSnapshotTest-309904984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60274ed2-170a-4d72-a455-e5dadd4f5740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:03 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-0e86eb8b-2b8b-4181-a8e4-f0dd100aa69e tempest-CreateVolumesFromSnapshotTest-309904984 None] Volume 3453d74f-3b66-49a9-a184-febb02e2b71a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3453d74f-3b66-49a9-a184-febb02e2b71a', 'volume_size': 1} Jun 17 06:03:03 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-0e86eb8b-2b8b-4181-a8e4-f0dd100aa69e tempest-CreateVolumesFromSnapshotTest-309904984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:03:03 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-3f47880f-9070-4653-8499-5053ae7c448a tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] Lock "cinder-71f3e450-78c5-4fa7-be84-3f4b1f472b3b-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:03:03 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-51bcf60b-9778-4097-b995-2b055a1eff80 tempest-CinderUnicodeTest-1598248645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ee2740c-e933-4c89-8489-5fb0297e2917 -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-8ee2740c-e933-4c89-8489-5fb0297e2917.c6d0e575-8300-47a7-a479-4821110428c0" returned: 0 in 0.941s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:03 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [None req-51bcf60b-9778-4097-b995-2b055a1eff80 tempest-CinderUnicodeTest-1598248645 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-8ee2740c-e933-4c89-8489-5fb0297e2917.c6d0e575-8300-47a7-a479-4821110428c0 is being set with open permissions: ugo+rw Jun 17 06:03:03 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-51bcf60b-9778-4097-b995-2b055a1eff80 tempest-CinderUnicodeTest-1598248645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-8ee2740c-e933-4c89-8489-5fb0297e2917.c6d0e575-8300-47a7-a479-4821110428c0 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:03 devstack sudo[110960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-8ee2740c-e933-4c89-8489-5fb0297e2917.c6d0e575-8300-47a7-a479-4821110428c0 Jun 17 06:03:03 devstack sudo[110960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:03 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-3f47880f-9070-4653-8499-5053ae7c448a tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] Acquiring lock "cinder-quobyte-71f3e450-78c5-4fa7-be84-3f4b1f472b3b" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:03:03 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-3f47880f-9070-4653-8499-5053ae7c448a tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] Lock "cinder-quobyte-71f3e450-78c5-4fa7-be84-3f4b1f472b3b" acquired by "delete_volume" :: waited 0.021s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:03:03 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab6f297-080f-421b-bec5-80898f4a3c3e]: (4, 'raw') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 06:03:03 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-3f47880f-9070-4653-8499-5053ae7c448a tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-71f3e450-78c5-4fa7-be84-3f4b1f472b3b {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:03 devstack sudo[110955]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:03 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-036c50f7-5abb-4643-a4fb-f4c309aa2c29 tempest-CreateVolumesFromImageTest-831885656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.712s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:03 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-036c50f7-5abb-4643-a4fb-f4c309aa2c29 tempest-CreateVolumesFromImageTest-831885656 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 06:03:03 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-036c50f7-5abb-4643-a4fb-f4c309aa2c29 tempest-CreateVolumesFromImageTest-831885656 None] Deleted volume successfully. Jun 17 06:03:03 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-036c50f7-5abb-4643-a4fb-f4c309aa2c29 tempest-CreateVolumesFromImageTest-831885656 None] Lock "cinder-471f2815-c7e9-4e2f-aa17-49b943112e03-delete_volume" released by "delete_volume" :: held 3.151s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:03:03 devstack sudo[110963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-71f3e450-78c5-4fa7-be84-3f4b1f472b3b Jun 17 06:03:03 devstack sudo[110963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:03 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-b1c1b416-d0fc-4a7c-a0de-3721b6623750 tempest-CreateVolumesFromImageTest-831885656 None] Acquiring lock "cinder-6ab6b0fc-7c1d-4714-9d5f-789834badb66-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:03:03 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-b1c1b416-d0fc-4a7c-a0de-3721b6623750 tempest-CreateVolumesFromImageTest-831885656 None] Lock "cinder-6ab6b0fc-7c1d-4714-9d5f-789834badb66-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:03:03 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-b1c1b416-d0fc-4a7c-a0de-3721b6623750 tempest-CreateVolumesFromImageTest-831885656 None] Acquiring lock "cinder-quobyte-6ab6b0fc-7c1d-4714-9d5f-789834badb66" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:03:03 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-b1c1b416-d0fc-4a7c-a0de-3721b6623750 tempest-CreateVolumesFromImageTest-831885656 None] Lock "cinder-quobyte-6ab6b0fc-7c1d-4714-9d5f-789834badb66" acquired by "delete_volume" :: waited 0.018s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:03:03 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d40143-09a9-4324-ac21-addedab73e96]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 06:03:03 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b1c1b416-d0fc-4a7c-a0de-3721b6623750 tempest-CreateVolumesFromImageTest-831885656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ab6b0fc-7c1d-4714-9d5f-789834badb66 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:03 devstack sudo[110960]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:03 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-51bcf60b-9778-4097-b995-2b055a1eff80 tempest-CinderUnicodeTest-1598248645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-8ee2740c-e933-4c89-8489-5fb0297e2917.c6d0e575-8300-47a7-a479-4821110428c0" returned: 0 in 0.680s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:03 devstack sudo[110966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ab6b0fc-7c1d-4714-9d5f-789834badb66 Jun 17 06:03:03 devstack sudo[110966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:03 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-51bcf60b-9778-4097-b995-2b055a1eff80 tempest-CinderUnicodeTest-1598248645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-8ee2740c-e933-4c89-8489-5fb0297e2917.info {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:03 devstack sudo[110970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-8ee2740c-e933-4c89-8489-5fb0297e2917.info Jun 17 06:03:03 devstack sudo[110970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:04 devstack sudo[110963]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:04 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-3f47880f-9070-4653-8499-5053ae7c448a tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-71f3e450-78c5-4fa7-be84-3f4b1f472b3b" returned: 0 in 0.737s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:04 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-3f47880f-9070-4653-8499-5053ae7c448a tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-71f3e450-78c5-4fa7-be84-3f4b1f472b3b {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:04 devstack sudo[110972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-71f3e450-78c5-4fa7-be84-3f4b1f472b3b Jun 17 06:03:04 devstack sudo[110972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:04 devstack sudo[110970]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:04 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-51bcf60b-9778-4097-b995-2b055a1eff80 tempest-CinderUnicodeTest-1598248645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-8ee2740c-e933-4c89-8489-5fb0297e2917.info" returned: 0 in 0.620s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:04 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [None req-51bcf60b-9778-4097-b995-2b055a1eff80 tempest-CinderUnicodeTest-1598248645 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-8ee2740c-e933-4c89-8489-5fb0297e2917.info is being set with open permissions: ugo+rw Jun 17 06:03:04 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-51bcf60b-9778-4097-b995-2b055a1eff80 tempest-CinderUnicodeTest-1598248645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-8ee2740c-e933-4c89-8489-5fb0297e2917.info {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:04 devstack sudo[110978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-8ee2740c-e933-4c89-8489-5fb0297e2917.info Jun 17 06:03:04 devstack sudo[110978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:04 devstack sudo[110966]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:04 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b1c1b416-d0fc-4a7c-a0de-3721b6623750 tempest-CreateVolumesFromImageTest-831885656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ab6b0fc-7c1d-4714-9d5f-789834badb66" returned: 0 in 0.778s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:04 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b1c1b416-d0fc-4a7c-a0de-3721b6623750 tempest-CreateVolumesFromImageTest-831885656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ab6b0fc-7c1d-4714-9d5f-789834badb66 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:04 devstack sudo[110980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ab6b0fc-7c1d-4714-9d5f-789834badb66 Jun 17 06:03:04 devstack sudo[110980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:04 devstack sudo[110972]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:04 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-3f47880f-9070-4653-8499-5053ae7c448a tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-71f3e450-78c5-4fa7-be84-3f4b1f472b3b" returned: 1 in 0.731s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:04 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-3f47880f-9070-4653-8499-5053ae7c448a tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-71f3e450-78c5-4fa7-be84-3f4b1f472b3b' failed. Not Retrying. {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 06:03:04 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-3f47880f-9070-4653-8499-5053ae7c448a tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-71f3e450-78c5-4fa7-be84-3f4b1f472b3b {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:04 devstack sudo[110985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-71f3e450-78c5-4fa7-be84-3f4b1f472b3b Jun 17 06:03:04 devstack sudo[110985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:05 devstack sudo[110978]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-51bcf60b-9778-4097-b995-2b055a1eff80 tempest-CinderUnicodeTest-1598248645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-8ee2740c-e933-4c89-8489-5fb0297e2917.info" returned: 0 in 0.620s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-51bcf60b-9778-4097-b995-2b055a1eff80 tempest-CinderUnicodeTest-1598248645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.104s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:03:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-4a9e255a-3e47-4e34-9ec7-a3220c1ee99b tempest-CreateVolumesFromSnapshotTest-309904984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.714s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:03:05 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-4a9e255a-3e47-4e34-9ec7-a3220c1ee99b tempest-CreateVolumesFromSnapshotTest-309904984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T04:03:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-316445020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=838fd2f6-b734-49dd-a60e-06de131c5d54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec2a339a1c5349309d139acd7586d036',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T04:03:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T04:03:01Z,use_quota=True,user_id='59f6ed0a529b4a3fa4f275ebe7bbb708',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 06:03:05 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-4a9e255a-3e47-4e34-9ec7-a3220c1ee99b tempest-CreateVolumesFromSnapshotTest-309904984 None] Creating volume 838fd2f6-b734-49dd-a60e-06de131c5d54 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 06:03:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-4a9e255a-3e47-4e34-9ec7-a3220c1ee99b tempest-CreateVolumesFromSnapshotTest-309904984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:03:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-4a9e255a-3e47-4e34-9ec7-a3220c1ee99b tempest-CreateVolumesFromSnapshotTest-309904984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:03:05 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-4a9e255a-3e47-4e34-9ec7-a3220c1ee99b tempest-CreateVolumesFromSnapshotTest-309904984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 06:03:05 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-4a9e255a-3e47-4e34-9ec7-a3220c1ee99b tempest-CreateVolumesFromSnapshotTest-309904984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 06:03:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-4a9e255a-3e47-4e34-9ec7-a3220c1ee99b tempest-CreateVolumesFromSnapshotTest-309904984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:03:05 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-4a9e255a-3e47-4e34-9ec7-a3220c1ee99b tempest-CreateVolumesFromSnapshotTest-309904984 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 06:03:05 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-4a9e255a-3e47-4e34-9ec7-a3220c1ee99b tempest-CreateVolumesFromSnapshotTest-309904984 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 06:03:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4a9e255a-3e47-4e34-9ec7-a3220c1ee99b tempest-CreateVolumesFromSnapshotTest-309904984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-838fd2f6-b734-49dd-a60e-06de131c5d54 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:05 devstack sudo[110980]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:05 devstack sudo[110989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-838fd2f6-b734-49dd-a60e-06de131c5d54 1073741824 Jun 17 06:03:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b1c1b416-d0fc-4a7c-a0de-3721b6623750 tempest-CreateVolumesFromImageTest-831885656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-6ab6b0fc-7c1d-4714-9d5f-789834badb66" returned: 0 in 0.651s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:05 devstack sudo[110989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:05 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-b1c1b416-d0fc-4a7c-a0de-3721b6623750 tempest-CreateVolumesFromImageTest-831885656 None] Lock "cinder-quobyte-6ab6b0fc-7c1d-4714-9d5f-789834badb66" released by "delete_volume" :: held 1.494s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:03:05 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-51bcf60b-9778-4097-b995-2b055a1eff80 tempest-CinderUnicodeTest-1598248645 None] Create snapshot completed successfully Jun 17 06:03:05 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-b1c1b416-d0fc-4a7c-a0de-3721b6623750 tempest-CreateVolumesFromImageTest-831885656 None] Created reservations ['8da9d70b-4350-4728-826e-9c562ec0ef0b', 'd894aae4-4a16-4caa-b024-1768689e8e61', 'b59921e1-f4eb-49da-a15a-0e0f0fc9537e', '306f31f6-547e-42fb-baa8-001eb225839b'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 06:03:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-b1c1b416-d0fc-4a7c-a0de-3721b6623750 tempest-CreateVolumesFromImageTest-831885656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:03:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-b1c1b416-d0fc-4a7c-a0de-3721b6623750 tempest-CreateVolumesFromImageTest-831885656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:03:05 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-b1c1b416-d0fc-4a7c-a0de-3721b6623750 tempest-CreateVolumesFromImageTest-831885656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 06:03:05 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-b1c1b416-d0fc-4a7c-a0de-3721b6623750 tempest-CreateVolumesFromImageTest-831885656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 06:03:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-b1c1b416-d0fc-4a7c-a0de-3721b6623750 tempest-CreateVolumesFromImageTest-831885656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:03:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b1c1b416-d0fc-4a7c-a0de-3721b6623750 tempest-CreateVolumesFromImageTest-831885656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:05 devstack sudo[110985]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-3f47880f-9070-4653-8499-5053ae7c448a tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-71f3e450-78c5-4fa7-be84-3f4b1f472b3b" returned: 0 in 0.615s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:05 devstack sudo[110992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 06:03:05 devstack sudo[110992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:05 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-3f47880f-9070-4653-8499-5053ae7c448a tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] Lock "cinder-quobyte-71f3e450-78c5-4fa7-be84-3f4b1f472b3b" released by "delete_volume" :: held 2.148s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:03:05 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-3f47880f-9070-4653-8499-5053ae7c448a tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] Created reservations ['18d4fb27-0903-4943-9b54-fd823b2632ee', '8e1d60d2-903c-45f4-9124-89336aeb3c96', '2a89f7d8-9ae1-4d39-a050-63c8b0778ae2', '98b9db57-deb0-41de-a76d-ee8011dd8e1d'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 06:03:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-3f47880f-9070-4653-8499-5053ae7c448a tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:03:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-3f47880f-9070-4653-8499-5053ae7c448a tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:03:05 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-3f47880f-9070-4653-8499-5053ae7c448a tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 06:03:05 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-3f47880f-9070-4653-8499-5053ae7c448a tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 06:03:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-3f47880f-9070-4653-8499-5053ae7c448a tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:03:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-3f47880f-9070-4653-8499-5053ae7c448a tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:05 devstack sudo[110994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 06:03:05 devstack sudo[110994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:05 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-753c5c8e-e923-48ab-9554-2446ea9f2c27 tempest-CinderUnicodeTest-1598248645 None] Acquiring lock "cinder-c6d0e575-8300-47a7-a479-4821110428c0-delete_snapshot" by "delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:03:05 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-753c5c8e-e923-48ab-9554-2446ea9f2c27 tempest-CinderUnicodeTest-1598248645 None] Lock "cinder-c6d0e575-8300-47a7-a479-4821110428c0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:03:05 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-753c5c8e-e923-48ab-9554-2446ea9f2c27 tempest-CinderUnicodeTest-1598248645 None] Acquiring lock "cinder-quobyte-8ee2740c-e933-4c89-8489-5fb0297e2917" by "delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:03:05 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-753c5c8e-e923-48ab-9554-2446ea9f2c27 tempest-CinderUnicodeTest-1598248645 None] Lock "cinder-quobyte-8ee2740c-e933-4c89-8489-5fb0297e2917" acquired by "delete_snapshot" :: waited 0.030s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:03:05 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-753c5c8e-e923-48ab-9554-2446ea9f2c27 tempest-CinderUnicodeTest-1598248645 None] Acquiring lock "cinder-quobyte-c6d0e575-8300-47a7-a479-4821110428c0" by "_delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:03:06 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-753c5c8e-e923-48ab-9554-2446ea9f2c27 tempest-CinderUnicodeTest-1598248645 None] Lock "cinder-quobyte-c6d0e575-8300-47a7-a479-4821110428c0" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:03:06 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-753c5c8e-e923-48ab-9554-2446ea9f2c27 tempest-CinderUnicodeTest-1598248645 None] Deleting offline snapshot c6d0e575-8300-47a7-a479-4821110428c0 of volume 8ee2740c-e933-4c89-8489-5fb0297e2917 {{(pid=92083) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 17 06:03:06 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-753c5c8e-e923-48ab-9554-2446ea9f2c27 tempest-CinderUnicodeTest-1598248645 None] snapshot_file for this snap is: volume-8ee2740c-e933-4c89-8489-5fb0297e2917.c6d0e575-8300-47a7-a479-4821110428c0 {{(pid=92083) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 17 06:03:06 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba925217-bb7d-43c5-9aef-af9cc2f79f9f]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 06:03:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-753c5c8e-e923-48ab-9554-2446ea9f2c27 tempest-CinderUnicodeTest-1598248645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-8ee2740c-e933-4c89-8489-5fb0297e2917.c6d0e575-8300-47a7-a479-4821110428c0 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:06 devstack sudo[110992]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b1c1b416-d0fc-4a7c-a0de-3721b6623750 tempest-CreateVolumesFromImageTest-831885656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.663s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:06 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-b1c1b416-d0fc-4a7c-a0de-3721b6623750 tempest-CreateVolumesFromImageTest-831885656 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 06:03:06 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-b1c1b416-d0fc-4a7c-a0de-3721b6623750 tempest-CreateVolumesFromImageTest-831885656 None] Deleted volume successfully. Jun 17 06:03:06 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-b1c1b416-d0fc-4a7c-a0de-3721b6623750 tempest-CreateVolumesFromImageTest-831885656 None] Lock "cinder-6ab6b0fc-7c1d-4714-9d5f-789834badb66-delete_volume" released by "delete_volume" :: held 2.450s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:03:06 devstack sudo[111002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-8ee2740c-e933-4c89-8489-5fb0297e2917.c6d0e575-8300-47a7-a479-4821110428c0 Jun 17 06:03:06 devstack sudo[111002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:06 devstack sudo[110989]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4a9e255a-3e47-4e34-9ec7-a3220c1ee99b tempest-CreateVolumesFromSnapshotTest-309904984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-838fd2f6-b734-49dd-a60e-06de131c5d54 1073741824" returned: 0 in 1.027s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4a9e255a-3e47-4e34-9ec7-a3220c1ee99b tempest-CreateVolumesFromSnapshotTest-309904984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-838fd2f6-b734-49dd-a60e-06de131c5d54 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:06 devstack sudo[111005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-838fd2f6-b734-49dd-a60e-06de131c5d54 Jun 17 06:03:06 devstack sudo[111005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:06 devstack sudo[110994]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-3f47880f-9070-4653-8499-5053ae7c448a tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.833s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:06 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-3f47880f-9070-4653-8499-5053ae7c448a tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 06:03:06 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-3f47880f-9070-4653-8499-5053ae7c448a tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] Deleted volume successfully. Jun 17 06:03:06 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-3f47880f-9070-4653-8499-5053ae7c448a tempest-VolumeAndVolumeTypeFromImageTest-775877641 None] Lock "cinder-71f3e450-78c5-4fa7-be84-3f4b1f472b3b-delete_volume" released by "delete_volume" :: held 3.204s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:03:06 devstack sudo[111002]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-753c5c8e-e923-48ab-9554-2446ea9f2c27 tempest-CinderUnicodeTest-1598248645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-8ee2740c-e933-4c89-8489-5fb0297e2917.c6d0e575-8300-47a7-a479-4821110428c0" returned: 0 in 0.838s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:06 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-753c5c8e-e923-48ab-9554-2446ea9f2c27 tempest-CinderUnicodeTest-1598248645 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ee2740c-e933-4c89-8489-5fb0297e2917(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92083) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 06:03:06 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa79ce89-2da1-483f-8f7b-7f668dc966ed]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 06:03:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-753c5c8e-e923-48ab-9554-2446ea9f2c27 tempest-CinderUnicodeTest-1598248645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-8ee2740c-e933-4c89-8489-5fb0297e2917 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:07 devstack sudo[111010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-8ee2740c-e933-4c89-8489-5fb0297e2917 Jun 17 06:03:07 devstack sudo[111010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:07 devstack sudo[111005]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4a9e255a-3e47-4e34-9ec7-a3220c1ee99b tempest-CreateVolumesFromSnapshotTest-309904984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-838fd2f6-b734-49dd-a60e-06de131c5d54" returned: 0 in 0.871s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:07 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-4a9e255a-3e47-4e34-9ec7-a3220c1ee99b tempest-CreateVolumesFromSnapshotTest-309904984 None] <== create_volume: return (1970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 06:03:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-4a9e255a-3e47-4e34-9ec7-a3220c1ee99b tempest-CreateVolumesFromSnapshotTest-309904984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.973s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:03:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-19113ee2-1cf2-4270-b03c-8f35967c294e tempest-CreateVolumesFromSnapshotTest-309904984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.221s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:03:07 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-19113ee2-1cf2-4270-b03c-8f35967c294e tempest-CreateVolumesFromSnapshotTest-309904984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T04:03:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1413783308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20239d68-f922-4039-ae6a-83af6aeab024,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec2a339a1c5349309d139acd7586d036',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T04:03:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T04:03:02Z,use_quota=True,user_id='59f6ed0a529b4a3fa4f275ebe7bbb708',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 06:03:07 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-19113ee2-1cf2-4270-b03c-8f35967c294e tempest-CreateVolumesFromSnapshotTest-309904984 None] Creating volume 20239d68-f922-4039-ae6a-83af6aeab024 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 06:03:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-19113ee2-1cf2-4270-b03c-8f35967c294e tempest-CreateVolumesFromSnapshotTest-309904984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:03:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-19113ee2-1cf2-4270-b03c-8f35967c294e tempest-CreateVolumesFromSnapshotTest-309904984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:03:07 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-19113ee2-1cf2-4270-b03c-8f35967c294e tempest-CreateVolumesFromSnapshotTest-309904984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 06:03:07 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-19113ee2-1cf2-4270-b03c-8f35967c294e tempest-CreateVolumesFromSnapshotTest-309904984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 06:03:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-19113ee2-1cf2-4270-b03c-8f35967c294e tempest-CreateVolumesFromSnapshotTest-309904984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:03:07 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-19113ee2-1cf2-4270-b03c-8f35967c294e tempest-CreateVolumesFromSnapshotTest-309904984 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 06:03:07 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-19113ee2-1cf2-4270-b03c-8f35967c294e tempest-CreateVolumesFromSnapshotTest-309904984 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 06:03:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-19113ee2-1cf2-4270-b03c-8f35967c294e tempest-CreateVolumesFromSnapshotTest-309904984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-20239d68-f922-4039-ae6a-83af6aeab024 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:07 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4a9e255a-3e47-4e34-9ec7-a3220c1ee99b tempest-CreateVolumesFromSnapshotTest-309904984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (330e8cd1-eb36-4559-8d53-7aa67a1def4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-838fd2f6-b734-49dd-a60e-06de131c5d54', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:07 devstack sudo[111013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-20239d68-f922-4039-ae6a-83af6aeab024 1073741824 Jun 17 06:03:07 devstack sudo[111013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:07 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4a9e255a-3e47-4e34-9ec7-a3220c1ee99b tempest-CreateVolumesFromSnapshotTest-309904984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7936de9-693c-4c73-bc6e-5fc680637473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:07 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-4a9e255a-3e47-4e34-9ec7-a3220c1ee99b tempest-CreateVolumesFromSnapshotTest-309904984 None] Volume volume-838fd2f6-b734-49dd-a60e-06de131c5d54 (838fd2f6-b734-49dd-a60e-06de131c5d54): created successfully Jun 17 06:03:07 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4a9e255a-3e47-4e34-9ec7-a3220c1ee99b tempest-CreateVolumesFromSnapshotTest-309904984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7936de9-693c-4c73-bc6e-5fc680637473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:07 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4a9e255a-3e47-4e34-9ec7-a3220c1ee99b tempest-CreateVolumesFromSnapshotTest-309904984 None] Flow 'volume_create_manager' (960c09f5-14b6-4a84-a2d2-802dce4fb2a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 06:03:07 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-4a9e255a-3e47-4e34-9ec7-a3220c1ee99b tempest-CreateVolumesFromSnapshotTest-309904984 None] Created volume successfully. Jun 17 06:03:07 devstack sudo[111010]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-753c5c8e-e923-48ab-9554-2446ea9f2c27 tempest-CinderUnicodeTest-1598248645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-8ee2740c-e933-4c89-8489-5fb0297e2917" returned: 0 in 0.987s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-753c5c8e-e923-48ab-9554-2446ea9f2c27 tempest-CinderUnicodeTest-1598248645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-8ee2740c-e933-4c89-8489-5fb0297e2917.c6d0e575-8300-47a7-a479-4821110428c0 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:07 devstack sudo[111021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-8ee2740c-e933-4c89-8489-5fb0297e2917.c6d0e575-8300-47a7-a479-4821110428c0 Jun 17 06:03:07 devstack sudo[111021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:08 devstack sudo[111013]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-19113ee2-1cf2-4270-b03c-8f35967c294e tempest-CreateVolumesFromSnapshotTest-309904984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-20239d68-f922-4039-ae6a-83af6aeab024 1073741824" returned: 0 in 1.190s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-19113ee2-1cf2-4270-b03c-8f35967c294e tempest-CreateVolumesFromSnapshotTest-309904984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-20239d68-f922-4039-ae6a-83af6aeab024 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:08 devstack sudo[111025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-20239d68-f922-4039-ae6a-83af6aeab024 Jun 17 06:03:08 devstack sudo[111025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:08 devstack sudo[111021]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-753c5c8e-e923-48ab-9554-2446ea9f2c27 tempest-CinderUnicodeTest-1598248645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-8ee2740c-e933-4c89-8489-5fb0297e2917.c6d0e575-8300-47a7-a479-4821110428c0" returned: 0 in 0.856s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-753c5c8e-e923-48ab-9554-2446ea9f2c27 tempest-CinderUnicodeTest-1598248645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-8ee2740c-e933-4c89-8489-5fb0297e2917.c6d0e575-8300-47a7-a479-4821110428c0 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:08 devstack sudo[111030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-8ee2740c-e933-4c89-8489-5fb0297e2917.c6d0e575-8300-47a7-a479-4821110428c0 Jun 17 06:03:08 devstack sudo[111030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:09 devstack sudo[111025]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-19113ee2-1cf2-4270-b03c-8f35967c294e tempest-CreateVolumesFromSnapshotTest-309904984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-20239d68-f922-4039-ae6a-83af6aeab024" returned: 0 in 0.742s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:09 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-19113ee2-1cf2-4270-b03c-8f35967c294e tempest-CreateVolumesFromSnapshotTest-309904984 None] <== create_volume: return (2005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 06:03:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-19113ee2-1cf2-4270-b03c-8f35967c294e tempest-CreateVolumesFromSnapshotTest-309904984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.007s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:03:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-8dc3dac9-67ce-4a0e-a433-90a8fa2e13ac tempest-CreateVolumesFromSnapshotTest-309904984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.914s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:03:09 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-8dc3dac9-67ce-4a0e-a433-90a8fa2e13ac tempest-CreateVolumesFromSnapshotTest-309904984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T04:03:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1426967506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9023bdb6-76eb-4cb6-b3ab-6be705910839,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec2a339a1c5349309d139acd7586d036',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T04:03:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T04:03:02Z,use_quota=True,user_id='59f6ed0a529b4a3fa4f275ebe7bbb708',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 06:03:09 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-8dc3dac9-67ce-4a0e-a433-90a8fa2e13ac tempest-CreateVolumesFromSnapshotTest-309904984 None] Creating volume 9023bdb6-76eb-4cb6-b3ab-6be705910839 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 06:03:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-8dc3dac9-67ce-4a0e-a433-90a8fa2e13ac tempest-CreateVolumesFromSnapshotTest-309904984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:03:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-8dc3dac9-67ce-4a0e-a433-90a8fa2e13ac tempest-CreateVolumesFromSnapshotTest-309904984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:03:09 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-8dc3dac9-67ce-4a0e-a433-90a8fa2e13ac tempest-CreateVolumesFromSnapshotTest-309904984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 06:03:09 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-8dc3dac9-67ce-4a0e-a433-90a8fa2e13ac tempest-CreateVolumesFromSnapshotTest-309904984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 06:03:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-8dc3dac9-67ce-4a0e-a433-90a8fa2e13ac tempest-CreateVolumesFromSnapshotTest-309904984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:03:09 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-8dc3dac9-67ce-4a0e-a433-90a8fa2e13ac tempest-CreateVolumesFromSnapshotTest-309904984 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 06:03:09 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-8dc3dac9-67ce-4a0e-a433-90a8fa2e13ac tempest-CreateVolumesFromSnapshotTest-309904984 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 06:03:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8dc3dac9-67ce-4a0e-a433-90a8fa2e13ac tempest-CreateVolumesFromSnapshotTest-309904984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9023bdb6-76eb-4cb6-b3ab-6be705910839 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:09 devstack sudo[111033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9023bdb6-76eb-4cb6-b3ab-6be705910839 1073741824 Jun 17 06:03:09 devstack sudo[111033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:09 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-19113ee2-1cf2-4270-b03c-8f35967c294e tempest-CreateVolumesFromSnapshotTest-309904984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50aafaff-4fc7-40ef-a0df-f190bb7334fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20239d68-f922-4039-ae6a-83af6aeab024', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:09 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-19113ee2-1cf2-4270-b03c-8f35967c294e tempest-CreateVolumesFromSnapshotTest-309904984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66db4c8e-8939-4d51-935e-04c725a48280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:09 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-19113ee2-1cf2-4270-b03c-8f35967c294e tempest-CreateVolumesFromSnapshotTest-309904984 None] Volume volume-20239d68-f922-4039-ae6a-83af6aeab024 (20239d68-f922-4039-ae6a-83af6aeab024): created successfully Jun 17 06:03:09 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-19113ee2-1cf2-4270-b03c-8f35967c294e tempest-CreateVolumesFromSnapshotTest-309904984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66db4c8e-8939-4d51-935e-04c725a48280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:09 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-19113ee2-1cf2-4270-b03c-8f35967c294e tempest-CreateVolumesFromSnapshotTest-309904984 None] Flow 'volume_create_manager' (0785f6fd-bef1-4008-bf13-4dc3f5b8f4cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 06:03:09 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-19113ee2-1cf2-4270-b03c-8f35967c294e tempest-CreateVolumesFromSnapshotTest-309904984 None] Created volume successfully. Jun 17 06:03:09 devstack sudo[111030]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-753c5c8e-e923-48ab-9554-2446ea9f2c27 tempest-CinderUnicodeTest-1598248645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-8ee2740c-e933-4c89-8489-5fb0297e2917.c6d0e575-8300-47a7-a479-4821110428c0" returned: 0 in 0.837s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:09 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-753c5c8e-e923-48ab-9554-2446ea9f2c27 tempest-CinderUnicodeTest-1598248645 None] Lock "cinder-quobyte-c6d0e575-8300-47a7-a479-4821110428c0" released by "_delete_snapshot" :: held 3.684s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:03:09 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-753c5c8e-e923-48ab-9554-2446ea9f2c27 tempest-CinderUnicodeTest-1598248645 None] Lock "cinder-quobyte-8ee2740c-e933-4c89-8489-5fb0297e2917" released by "delete_snapshot" :: held 3.718s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:03:09 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-753c5c8e-e923-48ab-9554-2446ea9f2c27 tempest-CinderUnicodeTest-1598248645 None] Created reservations ['9deca56b-ab26-44be-bd78-6b947a82f9b0', '13799585-5194-4940-a6d5-4a99006cb164', 'cef77575-2fa5-411b-bfb1-ffb9d07d44df', '7f419975-84a8-484c-8915-4f9ffeaae4af'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 06:03:09 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-0254c985-3b2f-42d6-a0c7-fa253781d0d3 tempest-VolumeDependencyTests-1046372343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 06:03:09 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0254c985-3b2f-42d6-a0c7-fa253781d0d3 tempest-VolumeDependencyTests-1046372343 None] Flow 'volume_create_manager' (688164c7-7f1a-4203-83f0-477406a18e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 06:03:09 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0254c985-3b2f-42d6-a0c7-fa253781d0d3 tempest-VolumeDependencyTests-1046372343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (576dfd9d-85fd-46bb-9737-c8b4c809cfcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:09 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-753c5c8e-e923-48ab-9554-2446ea9f2c27 tempest-CinderUnicodeTest-1598248645 None] Delete snapshot completed successfully. Jun 17 06:03:09 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0254c985-3b2f-42d6-a0c7-fa253781d0d3 tempest-VolumeDependencyTests-1046372343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (576dfd9d-85fd-46bb-9737-c8b4c809cfcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T04:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1661436204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b06a460e-45f4-4bde-af43-3638d5cd2511,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6c19aa15d104b83b9155f54053652ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T04:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T04:03:10Z,use_quota=True,user_id='1982b1c61fac46aca6b2cbf83b69f484',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:09 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0254c985-3b2f-42d6-a0c7-fa253781d0d3 tempest-VolumeDependencyTests-1046372343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c485197-bbc7-4e5f-a9e9-2d6600667ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:09 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0254c985-3b2f-42d6-a0c7-fa253781d0d3 tempest-VolumeDependencyTests-1046372343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c485197-bbc7-4e5f-a9e9-2d6600667ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:09 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0254c985-3b2f-42d6-a0c7-fa253781d0d3 tempest-VolumeDependencyTests-1046372343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a014d3b-0655-4fc6-8b2e-67ed22cd3a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:09 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0254c985-3b2f-42d6-a0c7-fa253781d0d3 tempest-VolumeDependencyTests-1046372343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a014d3b-0655-4fc6-8b2e-67ed22cd3a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b06a460e-45f4-4bde-af43-3638d5cd2511', 'volume_name': 'volume-b06a460e-45f4-4bde-af43-3638d5cd2511', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:09 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0254c985-3b2f-42d6-a0c7-fa253781d0d3 tempest-VolumeDependencyTests-1046372343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cda1b60c-a49f-4f61-9289-2e35bc48120c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:09 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0254c985-3b2f-42d6-a0c7-fa253781d0d3 tempest-VolumeDependencyTests-1046372343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cda1b60c-a49f-4f61-9289-2e35bc48120c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:09 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0254c985-3b2f-42d6-a0c7-fa253781d0d3 tempest-VolumeDependencyTests-1046372343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (160a02e4-fbf9-4f5f-9317-d8fe45cfbc29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:09 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-0254c985-3b2f-42d6-a0c7-fa253781d0d3 tempest-VolumeDependencyTests-1046372343 None] Volume b06a460e-45f4-4bde-af43-3638d5cd2511: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b06a460e-45f4-4bde-af43-3638d5cd2511', 'volume_size': 1} Jun 17 06:03:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-0254c985-3b2f-42d6-a0c7-fa253781d0d3 tempest-VolumeDependencyTests-1046372343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:03:09 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-753c5c8e-e923-48ab-9554-2446ea9f2c27 tempest-CinderUnicodeTest-1598248645 None] Lock "cinder-c6d0e575-8300-47a7-a479-4821110428c0-delete_snapshot" released by "delete_snapshot" :: held 4.033s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:03:10 devstack sudo[111033]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8dc3dac9-67ce-4a0e-a433-90a8fa2e13ac tempest-CreateVolumesFromSnapshotTest-309904984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9023bdb6-76eb-4cb6-b3ab-6be705910839 1073741824" returned: 0 in 1.025s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:10 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-c0b09be0-1866-4b8b-b819-371621d52fd7 tempest-CinderUnicodeTest-1598248645 None] Acquiring lock "cinder-8ee2740c-e933-4c89-8489-5fb0297e2917-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:03:10 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-c0b09be0-1866-4b8b-b819-371621d52fd7 tempest-CinderUnicodeTest-1598248645 None] Lock "cinder-8ee2740c-e933-4c89-8489-5fb0297e2917-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:03:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8dc3dac9-67ce-4a0e-a433-90a8fa2e13ac tempest-CreateVolumesFromSnapshotTest-309904984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9023bdb6-76eb-4cb6-b3ab-6be705910839 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:10 devstack sudo[111040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9023bdb6-76eb-4cb6-b3ab-6be705910839 Jun 17 06:03:10 devstack sudo[111040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:10 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-c0b09be0-1866-4b8b-b819-371621d52fd7 tempest-CinderUnicodeTest-1598248645 None] Acquiring lock "cinder-quobyte-8ee2740c-e933-4c89-8489-5fb0297e2917" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:03:10 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-c0b09be0-1866-4b8b-b819-371621d52fd7 tempest-CinderUnicodeTest-1598248645 None] Lock "cinder-quobyte-8ee2740c-e933-4c89-8489-5fb0297e2917" acquired by "delete_volume" :: waited 0.016s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:03:10 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3be836-dc91-4db0-a62e-454615136645]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 06:03:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c0b09be0-1866-4b8b-b819-371621d52fd7 tempest-CinderUnicodeTest-1598248645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-8ee2740c-e933-4c89-8489-5fb0297e2917 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:10 devstack sudo[111042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-8ee2740c-e933-4c89-8489-5fb0297e2917 Jun 17 06:03:10 devstack sudo[111042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:10 devstack sudo[111040]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-8dc3dac9-67ce-4a0e-a433-90a8fa2e13ac tempest-CreateVolumesFromSnapshotTest-309904984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9023bdb6-76eb-4cb6-b3ab-6be705910839" returned: 0 in 0.664s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:10 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-8dc3dac9-67ce-4a0e-a433-90a8fa2e13ac tempest-CreateVolumesFromSnapshotTest-309904984 None] <== create_volume: return (1758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 06:03:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-8dc3dac9-67ce-4a0e-a433-90a8fa2e13ac tempest-CreateVolumesFromSnapshotTest-309904984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.762s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:03:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-0ed7bbcc-6d69-475e-9388-dfb680621d55 tempest-CreateVolumesFromSnapshotTest-309904984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.167s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:03:10 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-0ed7bbcc-6d69-475e-9388-dfb680621d55 tempest-CreateVolumesFromSnapshotTest-309904984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T04:03:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-263992746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e21e23ae-e481-4bee-a2c7-1c9b40ccf6f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec2a339a1c5349309d139acd7586d036',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T04:03:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T04:03:03Z,use_quota=True,user_id='59f6ed0a529b4a3fa4f275ebe7bbb708',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 06:03:10 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-0ed7bbcc-6d69-475e-9388-dfb680621d55 tempest-CreateVolumesFromSnapshotTest-309904984 None] Creating volume e21e23ae-e481-4bee-a2c7-1c9b40ccf6f7 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 06:03:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-0ed7bbcc-6d69-475e-9388-dfb680621d55 tempest-CreateVolumesFromSnapshotTest-309904984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:03:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-0ed7bbcc-6d69-475e-9388-dfb680621d55 tempest-CreateVolumesFromSnapshotTest-309904984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:03:10 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-0ed7bbcc-6d69-475e-9388-dfb680621d55 tempest-CreateVolumesFromSnapshotTest-309904984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 06:03:10 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-0ed7bbcc-6d69-475e-9388-dfb680621d55 tempest-CreateVolumesFromSnapshotTest-309904984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 06:03:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-0ed7bbcc-6d69-475e-9388-dfb680621d55 tempest-CreateVolumesFromSnapshotTest-309904984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:03:10 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-0ed7bbcc-6d69-475e-9388-dfb680621d55 tempest-CreateVolumesFromSnapshotTest-309904984 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 06:03:10 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-0ed7bbcc-6d69-475e-9388-dfb680621d55 tempest-CreateVolumesFromSnapshotTest-309904984 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 06:03:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0ed7bbcc-6d69-475e-9388-dfb680621d55 tempest-CreateVolumesFromSnapshotTest-309904984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-e21e23ae-e481-4bee-a2c7-1c9b40ccf6f7 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:10 devstack sudo[111045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-e21e23ae-e481-4bee-a2c7-1c9b40ccf6f7 1073741824 Jun 17 06:03:10 devstack sudo[111045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:11 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8dc3dac9-67ce-4a0e-a433-90a8fa2e13ac tempest-CreateVolumesFromSnapshotTest-309904984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82740c7e-b242-43a3-b59a-25c35da4801b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9023bdb6-76eb-4cb6-b3ab-6be705910839', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:11 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8dc3dac9-67ce-4a0e-a433-90a8fa2e13ac tempest-CreateVolumesFromSnapshotTest-309904984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7907caff-dd48-4037-a4df-8a5b5787887c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:11 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-8dc3dac9-67ce-4a0e-a433-90a8fa2e13ac tempest-CreateVolumesFromSnapshotTest-309904984 None] Volume volume-9023bdb6-76eb-4cb6-b3ab-6be705910839 (9023bdb6-76eb-4cb6-b3ab-6be705910839): created successfully Jun 17 06:03:11 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8dc3dac9-67ce-4a0e-a433-90a8fa2e13ac tempest-CreateVolumesFromSnapshotTest-309904984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7907caff-dd48-4037-a4df-8a5b5787887c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:11 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-8dc3dac9-67ce-4a0e-a433-90a8fa2e13ac tempest-CreateVolumesFromSnapshotTest-309904984 None] Flow 'volume_create_manager' (c6dbca4f-5e22-4a59-8e73-4719e019f84a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 06:03:11 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-8dc3dac9-67ce-4a0e-a433-90a8fa2e13ac tempest-CreateVolumesFromSnapshotTest-309904984 None] Created volume successfully. Jun 17 06:03:11 devstack sudo[111042]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c0b09be0-1866-4b8b-b819-371621d52fd7 tempest-CinderUnicodeTest-1598248645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-8ee2740c-e933-4c89-8489-5fb0297e2917" returned: 0 in 0.758s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c0b09be0-1866-4b8b-b819-371621d52fd7 tempest-CinderUnicodeTest-1598248645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-8ee2740c-e933-4c89-8489-5fb0297e2917 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:11 devstack sudo[111050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-8ee2740c-e933-4c89-8489-5fb0297e2917 Jun 17 06:03:11 devstack sudo[111050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:11 devstack sudo[111050]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c0b09be0-1866-4b8b-b819-371621d52fd7 tempest-CinderUnicodeTest-1598248645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-8ee2740c-e933-4c89-8489-5fb0297e2917" returned: 0 in 0.622s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:11 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-c0b09be0-1866-4b8b-b819-371621d52fd7 tempest-CinderUnicodeTest-1598248645 None] Lock "cinder-quobyte-8ee2740c-e933-4c89-8489-5fb0297e2917" released by "delete_volume" :: held 1.454s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:03:11 devstack sudo[111045]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0ed7bbcc-6d69-475e-9388-dfb680621d55 tempest-CreateVolumesFromSnapshotTest-309904984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-e21e23ae-e481-4bee-a2c7-1c9b40ccf6f7 1073741824" returned: 0 in 0.885s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:11 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-c0b09be0-1866-4b8b-b819-371621d52fd7 tempest-CinderUnicodeTest-1598248645 None] Created reservations ['e2206bfd-b98f-4952-92f1-c10ebbc5e5c4', 'a7596780-0163-435c-a3be-7fd14d917acd', 'a9d433d2-a7bf-424b-8002-8de8066c7eb4', 'ecf4dc4e-2c48-4d43-b1e0-df1cd19df5b7'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 06:03:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0ed7bbcc-6d69-475e-9388-dfb680621d55 tempest-CreateVolumesFromSnapshotTest-309904984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-e21e23ae-e481-4bee-a2c7-1c9b40ccf6f7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:11 devstack sudo[111057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-e21e23ae-e481-4bee-a2c7-1c9b40ccf6f7 Jun 17 06:03:11 devstack sudo[111057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-c0b09be0-1866-4b8b-b819-371621d52fd7 tempest-CinderUnicodeTest-1598248645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:03:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-c0b09be0-1866-4b8b-b819-371621d52fd7 tempest-CinderUnicodeTest-1598248645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:03:11 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-c0b09be0-1866-4b8b-b819-371621d52fd7 tempest-CinderUnicodeTest-1598248645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 06:03:12 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-c0b09be0-1866-4b8b-b819-371621d52fd7 tempest-CinderUnicodeTest-1598248645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 06:03:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-c0b09be0-1866-4b8b-b819-371621d52fd7 tempest-CinderUnicodeTest-1598248645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:03:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c0b09be0-1866-4b8b-b819-371621d52fd7 tempest-CinderUnicodeTest-1598248645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:12 devstack sudo[111059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 06:03:12 devstack sudo[111059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:12 devstack sudo[111057]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:12 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-473831fa-08f7-4bb4-be99-721578e4535e tempest-CinderUnicodeTest-1598248645 None] Acquiring lock "cinder-c1254f3f-ef13-41e5-bf81-012ec7fc515b-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:03:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0ed7bbcc-6d69-475e-9388-dfb680621d55 tempest-CreateVolumesFromSnapshotTest-309904984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-e21e23ae-e481-4bee-a2c7-1c9b40ccf6f7" returned: 0 in 0.636s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:12 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-0ed7bbcc-6d69-475e-9388-dfb680621d55 tempest-CreateVolumesFromSnapshotTest-309904984 None] <== create_volume: return (1590ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 06:03:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-0ed7bbcc-6d69-475e-9388-dfb680621d55 tempest-CreateVolumesFromSnapshotTest-309904984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.593s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:03:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-0e86eb8b-2b8b-4181-a8e4-f0dd100aa69e tempest-CreateVolumesFromSnapshotTest-309904984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.345s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:03:12 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-0e86eb8b-2b8b-4181-a8e4-f0dd100aa69e tempest-CreateVolumesFromSnapshotTest-309904984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T04:03:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-578130242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3453d74f-3b66-49a9-a184-febb02e2b71a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec2a339a1c5349309d139acd7586d036',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T04:03:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T04:03:03Z,use_quota=True,user_id='59f6ed0a529b4a3fa4f275ebe7bbb708',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 06:03:12 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-0e86eb8b-2b8b-4181-a8e4-f0dd100aa69e tempest-CreateVolumesFromSnapshotTest-309904984 None] Creating volume 3453d74f-3b66-49a9-a184-febb02e2b71a {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 06:03:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-0e86eb8b-2b8b-4181-a8e4-f0dd100aa69e tempest-CreateVolumesFromSnapshotTest-309904984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:03:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-0e86eb8b-2b8b-4181-a8e4-f0dd100aa69e tempest-CreateVolumesFromSnapshotTest-309904984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:03:12 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-0e86eb8b-2b8b-4181-a8e4-f0dd100aa69e tempest-CreateVolumesFromSnapshotTest-309904984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 06:03:12 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-0e86eb8b-2b8b-4181-a8e4-f0dd100aa69e tempest-CreateVolumesFromSnapshotTest-309904984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 06:03:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-0e86eb8b-2b8b-4181-a8e4-f0dd100aa69e tempest-CreateVolumesFromSnapshotTest-309904984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:03:12 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-0e86eb8b-2b8b-4181-a8e4-f0dd100aa69e tempest-CreateVolumesFromSnapshotTest-309904984 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 06:03:12 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-0e86eb8b-2b8b-4181-a8e4-f0dd100aa69e tempest-CreateVolumesFromSnapshotTest-309904984 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 06:03:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0e86eb8b-2b8b-4181-a8e4-f0dd100aa69e tempest-CreateVolumesFromSnapshotTest-309904984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-3453d74f-3b66-49a9-a184-febb02e2b71a 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:12 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-473831fa-08f7-4bb4-be99-721578e4535e tempest-CinderUnicodeTest-1598248645 None] Lock "cinder-c1254f3f-ef13-41e5-bf81-012ec7fc515b-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:03:12 devstack sudo[111063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-3453d74f-3b66-49a9-a184-febb02e2b71a 1073741824 Jun 17 06:03:12 devstack sudo[111063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:12 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0ed7bbcc-6d69-475e-9388-dfb680621d55 tempest-CreateVolumesFromSnapshotTest-309904984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8f3ce42-13ec-4c21-b0e9-d3f37cb9cdcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e21e23ae-e481-4bee-a2c7-1c9b40ccf6f7', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:12 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0ed7bbcc-6d69-475e-9388-dfb680621d55 tempest-CreateVolumesFromSnapshotTest-309904984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea1dd620-f695-4c5c-ade6-3dddcd3eaf11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:12 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-0ed7bbcc-6d69-475e-9388-dfb680621d55 tempest-CreateVolumesFromSnapshotTest-309904984 None] Volume volume-e21e23ae-e481-4bee-a2c7-1c9b40ccf6f7 (e21e23ae-e481-4bee-a2c7-1c9b40ccf6f7): created successfully Jun 17 06:03:12 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0ed7bbcc-6d69-475e-9388-dfb680621d55 tempest-CreateVolumesFromSnapshotTest-309904984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea1dd620-f695-4c5c-ade6-3dddcd3eaf11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:12 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0ed7bbcc-6d69-475e-9388-dfb680621d55 tempest-CreateVolumesFromSnapshotTest-309904984 None] Flow 'volume_create_manager' (1e0147a6-5516-4733-bcbb-8900633477d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 06:03:12 devstack sudo[111059]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c0b09be0-1866-4b8b-b819-371621d52fd7 tempest-CinderUnicodeTest-1598248645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.673s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:12 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-c0b09be0-1866-4b8b-b819-371621d52fd7 tempest-CinderUnicodeTest-1598248645 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 06:03:12 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-0ed7bbcc-6d69-475e-9388-dfb680621d55 tempest-CreateVolumesFromSnapshotTest-309904984 None] Created volume successfully. Jun 17 06:03:12 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-473831fa-08f7-4bb4-be99-721578e4535e tempest-CinderUnicodeTest-1598248645 None] Acquiring lock "cinder-quobyte-c1254f3f-ef13-41e5-bf81-012ec7fc515b" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:03:12 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-c0b09be0-1866-4b8b-b819-371621d52fd7 tempest-CinderUnicodeTest-1598248645 None] Deleted volume successfully. Jun 17 06:03:12 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-473831fa-08f7-4bb4-be99-721578e4535e tempest-CinderUnicodeTest-1598248645 None] Lock "cinder-quobyte-c1254f3f-ef13-41e5-bf81-012ec7fc515b" acquired by "delete_volume" :: waited 0.030s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:03:12 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-c0b09be0-1866-4b8b-b819-371621d52fd7 tempest-CinderUnicodeTest-1598248645 None] Lock "cinder-8ee2740c-e933-4c89-8489-5fb0297e2917-delete_volume" released by "delete_volume" :: held 2.456s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:03:12 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c27c48-f573-4c95-8ef9-2339ca3da8b5]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 06:03:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-473831fa-08f7-4bb4-be99-721578e4535e tempest-CinderUnicodeTest-1598248645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c1254f3f-ef13-41e5-bf81-012ec7fc515b {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:12 devstack sudo[111065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c1254f3f-ef13-41e5-bf81-012ec7fc515b Jun 17 06:03:12 devstack sudo[111065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:13 devstack sudo[111063]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:13 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0e86eb8b-2b8b-4181-a8e4-f0dd100aa69e tempest-CreateVolumesFromSnapshotTest-309904984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-3453d74f-3b66-49a9-a184-febb02e2b71a 1073741824" returned: 0 in 0.915s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:13 devstack sudo[111065]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:13 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-473831fa-08f7-4bb4-be99-721578e4535e tempest-CinderUnicodeTest-1598248645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c1254f3f-ef13-41e5-bf81-012ec7fc515b" returned: 0 in 0.754s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:13 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-473831fa-08f7-4bb4-be99-721578e4535e tempest-CinderUnicodeTest-1598248645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c1254f3f-ef13-41e5-bf81-012ec7fc515b {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:13 devstack sudo[111073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c1254f3f-ef13-41e5-bf81-012ec7fc515b Jun 17 06:03:13 devstack sudo[111073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:13 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0e86eb8b-2b8b-4181-a8e4-f0dd100aa69e tempest-CreateVolumesFromSnapshotTest-309904984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-3453d74f-3b66-49a9-a184-febb02e2b71a {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:13 devstack sudo[111075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-3453d74f-3b66-49a9-a184-febb02e2b71a Jun 17 06:03:13 devstack sudo[111075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:13 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 06:03:13 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] Flow 'volume_create_manager' (0a986c39-fb1e-4a19-8efd-16be69ebce0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 06:03:13 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64b29b2e-4d87-487f-85af-85dd89ac050b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:13 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64b29b2e-4d87-487f-85af-85dd89ac050b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T04:03:14Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=169f084b-6714-44b4-ad9d-5069f48bcb45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='458b508dfd66482f9f58740899e3952d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T04:03:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T04:03:14Z,use_quota=True,user_id='a9ae8aafbb5b45f7aff3a842e184d08d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:13 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1331dc1-82cd-4b6d-83ec-4fcd8853ce66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:14 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1331dc1-82cd-4b6d-83ec-4fcd8853ce66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:14 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16c82af3-bbda-49a6-8d20-15007a813917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:14 devstack cinder-volume[92083]: DEBUG cinder.image.glance [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] Creating Keystone auth plugin from conf {{(pid=92083) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 17 06:03:14 devstack sudo[111073]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-473831fa-08f7-4bb4-be99-721578e4535e tempest-CinderUnicodeTest-1598248645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-c1254f3f-ef13-41e5-bf81-012ec7fc515b" returned: 0 in 0.673s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:14 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-473831fa-08f7-4bb4-be99-721578e4535e tempest-CinderUnicodeTest-1598248645 None] Lock "cinder-quobyte-c1254f3f-ef13-41e5-bf81-012ec7fc515b" released by "delete_volume" :: held 1.484s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:03:14 devstack sudo[111075]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0e86eb8b-2b8b-4181-a8e4-f0dd100aa69e tempest-CreateVolumesFromSnapshotTest-309904984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-3453d74f-3b66-49a9-a184-febb02e2b71a" returned: 0 in 0.723s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:14 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-0e86eb8b-2b8b-4181-a8e4-f0dd100aa69e tempest-CreateVolumesFromSnapshotTest-309904984 None] <== create_volume: return (1695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 06:03:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-0e86eb8b-2b8b-4181-a8e4-f0dd100aa69e tempest-CreateVolumesFromSnapshotTest-309904984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.700s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:03:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-0254c985-3b2f-42d6-a0c7-fa253781d0d3 tempest-VolumeDependencyTests-1046372343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.280s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:03:14 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-0254c985-3b2f-42d6-a0c7-fa253781d0d3 tempest-VolumeDependencyTests-1046372343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T04:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1661436204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b06a460e-45f4-4bde-af43-3638d5cd2511,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6c19aa15d104b83b9155f54053652ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T04:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T04:03:10Z,use_quota=True,user_id='1982b1c61fac46aca6b2cbf83b69f484',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 06:03:14 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-0254c985-3b2f-42d6-a0c7-fa253781d0d3 tempest-VolumeDependencyTests-1046372343 None] Creating volume b06a460e-45f4-4bde-af43-3638d5cd2511 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 06:03:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-0254c985-3b2f-42d6-a0c7-fa253781d0d3 tempest-VolumeDependencyTests-1046372343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:03:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-0254c985-3b2f-42d6-a0c7-fa253781d0d3 tempest-VolumeDependencyTests-1046372343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:03:14 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-0254c985-3b2f-42d6-a0c7-fa253781d0d3 tempest-VolumeDependencyTests-1046372343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 06:03:14 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-0254c985-3b2f-42d6-a0c7-fa253781d0d3 tempest-VolumeDependencyTests-1046372343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 06:03:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-0254c985-3b2f-42d6-a0c7-fa253781d0d3 tempest-VolumeDependencyTests-1046372343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:03:14 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-0254c985-3b2f-42d6-a0c7-fa253781d0d3 tempest-VolumeDependencyTests-1046372343 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 06:03:14 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-0254c985-3b2f-42d6-a0c7-fa253781d0d3 tempest-VolumeDependencyTests-1046372343 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 06:03:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0254c985-3b2f-42d6-a0c7-fa253781d0d3 tempest-VolumeDependencyTests-1046372343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b06a460e-45f4-4bde-af43-3638d5cd2511 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:14 devstack sudo[111079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b06a460e-45f4-4bde-af43-3638d5cd2511 1073741824 Jun 17 06:03:14 devstack sudo[111079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:14 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0e86eb8b-2b8b-4181-a8e4-f0dd100aa69e tempest-CreateVolumesFromSnapshotTest-309904984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60274ed2-170a-4d72-a455-e5dadd4f5740) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3453d74f-3b66-49a9-a184-febb02e2b71a', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:14 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0e86eb8b-2b8b-4181-a8e4-f0dd100aa69e tempest-CreateVolumesFromSnapshotTest-309904984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da3d9df8-ccaa-4c4c-8503-7c19231bb9c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:14 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-0e86eb8b-2b8b-4181-a8e4-f0dd100aa69e tempest-CreateVolumesFromSnapshotTest-309904984 None] Volume volume-3453d74f-3b66-49a9-a184-febb02e2b71a (3453d74f-3b66-49a9-a184-febb02e2b71a): created successfully Jun 17 06:03:14 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0e86eb8b-2b8b-4181-a8e4-f0dd100aa69e tempest-CreateVolumesFromSnapshotTest-309904984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da3d9df8-ccaa-4c4c-8503-7c19231bb9c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:14 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0e86eb8b-2b8b-4181-a8e4-f0dd100aa69e tempest-CreateVolumesFromSnapshotTest-309904984 None] Flow 'volume_create_manager' (3d739e92-151d-4dd7-81a5-241b7c5ce81c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 06:03:14 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16c82af3-bbda-49a6-8d20-15007a813917) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '169f084b-6714-44b4-ad9d-5069f48bcb45', 'volume_name': 'volume-169f084b-6714-44b4-ad9d-5069f48bcb45', 'volume_size': 1, 'image_id': '58087b50-c893-4592-914f-cd037b88b0f6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/58087b50-c893-4592-914f-cd037b88b0f6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e8f60edc7a82535bdc94430278b3df69', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '458b508dfd66482f9f58740899e3952d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b02f03ef8e3c7ba82c9f40bb1a93b611fb8b8f924777c7f17f545395e6f71e635b0ca568899cd72ce31339b8eb86746c379517fd3838015587b190c6ec4f122e', 'id': '58087b50-c893-4592-914f-cd037b88b0f6', 'created_at': datetime.datetime(2026, 6, 17, 4, 3, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 4, 3, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/58087b50-c893-4592-914f-cd037b88b0f6/file', 'properties': {}}, 'image_service': }' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:14 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b173ff6b-0300-46fa-8415-2317362f224e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:14 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b173ff6b-0300-46fa-8415-2317362f224e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:14 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f04e83d-0eab-4e48-8dae-786b6bb157b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:14 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] Volume 169f084b-6714-44b4-ad9d-5069f48bcb45: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-169f084b-6714-44b4-ad9d-5069f48bcb45', 'volume_size': 1, 'image_id': '58087b50-c893-4592-914f-cd037b88b0f6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/58087b50-c893-4592-914f-cd037b88b0f6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e8f60edc7a82535bdc94430278b3df69', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '458b508dfd66482f9f58740899e3952d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b02f03ef8e3c7ba82c9f40bb1a93b611fb8b8f924777c7f17f545395e6f71e635b0ca568899cd72ce31339b8eb86746c379517fd3838015587b190c6ec4f122e', 'id': '58087b50-c893-4592-914f-cd037b88b0f6', 'created_at': datetime.datetime(2026, 6, 17, 4, 3, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 4, 3, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/58087b50-c893-4592-914f-cd037b88b0f6/file', 'properties': {}}, 'image_service': } Jun 17 06:03:14 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] Trying to clone 169f084b-6714-44b4-ad9d-5069f48bcb45 from image 58087b50-c893-4592-914f-cd037b88b0f6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/58087b50-c893-4592-914f-cd037b88b0f6', 'metadata': {}}]). {{(pid=92083) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 17 06:03:14 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-0e86eb8b-2b8b-4181-a8e4-f0dd100aa69e tempest-CreateVolumesFromSnapshotTest-309904984 None] Created volume successfully. Jun 17 06:03:14 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-473831fa-08f7-4bb4-be99-721578e4535e tempest-CinderUnicodeTest-1598248645 None] Created reservations ['00806eb7-12b0-4b66-aaa9-dd458be9d309', '83e650f8-db54-4296-9093-3a0f97794e63', 'a06d8467-b480-484b-a536-b16a077cd46e', '768a5ad7-f91c-40b1-b483-f77f7f4c50a3'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 06:03:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-473831fa-08f7-4bb4-be99-721578e4535e tempest-CinderUnicodeTest-1598248645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:03:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-473831fa-08f7-4bb4-be99-721578e4535e tempest-CinderUnicodeTest-1598248645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:03:14 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-473831fa-08f7-4bb4-be99-721578e4535e tempest-CinderUnicodeTest-1598248645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 06:03:14 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-473831fa-08f7-4bb4-be99-721578e4535e tempest-CinderUnicodeTest-1598248645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 06:03:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-473831fa-08f7-4bb4-be99-721578e4535e tempest-CinderUnicodeTest-1598248645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:03:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-473831fa-08f7-4bb4-be99-721578e4535e tempest-CinderUnicodeTest-1598248645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:14 devstack cinder-volume[92083]: DEBUG cinder.image.image_utils [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_58087b50-c893-4592-914f-cd037b88b0f6_wibt5ixhdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=92083) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 17 06:03:14 devstack cinder-volume[92083]: INFO cinder.image.image_utils [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] Image download 0.00 MB at 0.00 MB/s Jun 17 06:03:14 devstack sudo[111081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 06:03:14 devstack sudo[111081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:14 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d0d34b5-a343-44f7-9e62-f709a62815b1]: (4, 'raw') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 06:03:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_58087b50-c893-4592-914f-cd037b88b0f6_wibt5ixhdevstack@QuobyteHD {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:14 devstack sudo[111083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_58087b50-c893-4592-914f-cd037b88b0f6_wibt5ixhdevstack@QuobyteHD Jun 17 06:03:14 devstack sudo[111083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:15 devstack sudo[111081]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-473831fa-08f7-4bb4-be99-721578e4535e tempest-CinderUnicodeTest-1598248645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.654s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:15 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-473831fa-08f7-4bb4-be99-721578e4535e tempest-CinderUnicodeTest-1598248645 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 06:03:15 devstack sudo[111079]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:15 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-473831fa-08f7-4bb4-be99-721578e4535e tempest-CinderUnicodeTest-1598248645 None] Deleted volume successfully. Jun 17 06:03:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0254c985-3b2f-42d6-a0c7-fa253781d0d3 tempest-VolumeDependencyTests-1046372343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b06a460e-45f4-4bde-af43-3638d5cd2511 1073741824" returned: 0 in 0.872s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:15 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-473831fa-08f7-4bb4-be99-721578e4535e tempest-CinderUnicodeTest-1598248645 None] Lock "cinder-c1254f3f-ef13-41e5-bf81-012ec7fc515b-delete_volume" released by "delete_volume" :: held 2.586s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:03:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0254c985-3b2f-42d6-a0c7-fa253781d0d3 tempest-VolumeDependencyTests-1046372343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b06a460e-45f4-4bde-af43-3638d5cd2511 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:15 devstack sudo[111090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b06a460e-45f4-4bde-af43-3638d5cd2511 Jun 17 06:03:15 devstack sudo[111090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:15 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-ab26a589-91e4-4b79-ae5c-0bb5fc880631 tempest-CreateVolumesFromSnapshotTest-309904984 None] Acquiring lock "cinder-3453d74f-3b66-49a9-a184-febb02e2b71a-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:03:15 devstack sudo[111083]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_58087b50-c893-4592-914f-cd037b88b0f6_wibt5ixhdevstack@QuobyteHD" returned: 0 in 0.830s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_58087b50-c893-4592-914f-cd037b88b0f6_wibt5ixhdevstack@QuobyteHD {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:15 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-ab26a589-91e4-4b79-ae5c-0bb5fc880631 tempest-CreateVolumesFromSnapshotTest-309904984 None] Lock "cinder-3453d74f-3b66-49a9-a184-febb02e2b71a-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:03:15 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-ab26a589-91e4-4b79-ae5c-0bb5fc880631 tempest-CreateVolumesFromSnapshotTest-309904984 None] Acquiring lock "cinder-quobyte-3453d74f-3b66-49a9-a184-febb02e2b71a" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:03:15 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-ab26a589-91e4-4b79-ae5c-0bb5fc880631 tempest-CreateVolumesFromSnapshotTest-309904984 None] Lock "cinder-quobyte-3453d74f-3b66-49a9-a184-febb02e2b71a" acquired by "delete_volume" :: waited 0.025s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:03:15 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c9e77dc-7c96-4660-a027-923639e44e7c]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 06:03:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ab26a589-91e4-4b79-ae5c-0bb5fc880631 tempest-CreateVolumesFromSnapshotTest-309904984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-3453d74f-3b66-49a9-a184-febb02e2b71a {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:15 devstack sudo[111094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_58087b50-c893-4592-914f-cd037b88b0f6_wibt5ixhdevstack@QuobyteHD Jun 17 06:03:15 devstack sudo[111094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:15 devstack sudo[111095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-3453d74f-3b66-49a9-a184-febb02e2b71a Jun 17 06:03:15 devstack sudo[111095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:15 devstack sudo[111090]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-0254c985-3b2f-42d6-a0c7-fa253781d0d3 tempest-VolumeDependencyTests-1046372343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b06a460e-45f4-4bde-af43-3638d5cd2511" returned: 0 in 0.709s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:15 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-0254c985-3b2f-42d6-a0c7-fa253781d0d3 tempest-VolumeDependencyTests-1046372343 None] <== create_volume: return (1646ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 06:03:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-0254c985-3b2f-42d6-a0c7-fa253781d0d3 tempest-VolumeDependencyTests-1046372343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.651s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:03:15 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0254c985-3b2f-42d6-a0c7-fa253781d0d3 tempest-VolumeDependencyTests-1046372343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (160a02e4-fbf9-4f5f-9317-d8fe45cfbc29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b06a460e-45f4-4bde-af43-3638d5cd2511', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:15 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0254c985-3b2f-42d6-a0c7-fa253781d0d3 tempest-VolumeDependencyTests-1046372343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (305c0ff9-c30f-48e7-a502-a54a15dbefb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:15 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-0254c985-3b2f-42d6-a0c7-fa253781d0d3 tempest-VolumeDependencyTests-1046372343 None] Volume volume-b06a460e-45f4-4bde-af43-3638d5cd2511 (b06a460e-45f4-4bde-af43-3638d5cd2511): created successfully Jun 17 06:03:15 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0254c985-3b2f-42d6-a0c7-fa253781d0d3 tempest-VolumeDependencyTests-1046372343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (305c0ff9-c30f-48e7-a502-a54a15dbefb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:15 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-0254c985-3b2f-42d6-a0c7-fa253781d0d3 tempest-VolumeDependencyTests-1046372343 None] Flow 'volume_create_manager' (688164c7-7f1a-4203-83f0-477406a18e6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 06:03:16 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-0254c985-3b2f-42d6-a0c7-fa253781d0d3 tempest-VolumeDependencyTests-1046372343 None] Created volume successfully. Jun 17 06:03:16 devstack sudo[111094]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_58087b50-c893-4592-914f-cd037b88b0f6_wibt5ixhdevstack@QuobyteHD" returned: 1 in 0.902s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_58087b50-c893-4592-914f-cd037b88b0f6_wibt5ixhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 06:03:16 devstack cinder-volume[92083]: DEBUG cinder.image.image_utils [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] Temporary image 58087b50-c893-4592-914f-cd037b88b0f6 is fetched for user a9ae8aafbb5b45f7aff3a842e184d08d. {{(pid=92083) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 17 06:03:16 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[b49adca0-0fbc-4c62-bffa-158e2055e126]: (4, 'raw') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 06:03:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_58087b50-c893-4592-914f-cd037b88b0f6_wibt5ixhdevstack@QuobyteHD {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:16 devstack sudo[111095]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ab26a589-91e4-4b79-ae5c-0bb5fc880631 tempest-CreateVolumesFromSnapshotTest-309904984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-3453d74f-3b66-49a9-a184-febb02e2b71a" returned: 0 in 0.927s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ab26a589-91e4-4b79-ae5c-0bb5fc880631 tempest-CreateVolumesFromSnapshotTest-309904984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-3453d74f-3b66-49a9-a184-febb02e2b71a {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:16 devstack sudo[111106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-3453d74f-3b66-49a9-a184-febb02e2b71a Jun 17 06:03:16 devstack sudo[111106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:16 devstack sudo[111105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_58087b50-c893-4592-914f-cd037b88b0f6_wibt5ixhdevstack@QuobyteHD Jun 17 06:03:16 devstack sudo[111105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-65e15fcb-61a0-4186-973a-698cc3da6f4f tempest-VolumeDependencyTests-1046372343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:03:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-65e15fcb-61a0-4186-973a-698cc3da6f4f tempest-VolumeDependencyTests-1046372343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:03:16 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-65e15fcb-61a0-4186-973a-698cc3da6f4f tempest-VolumeDependencyTests-1046372343 None] Creating offline snapshot 55f3f77b-ea1e-4423-92c0-8d6dbd5ec778 of volume b06a460e-45f4-4bde-af43-3638d5cd2511 {{(pid=92083) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 17 06:03:16 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[3facbe1d-22cd-49ff-acf0-831db032eaa1]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 06:03:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-65e15fcb-61a0-4186-973a-698cc3da6f4f tempest-VolumeDependencyTests-1046372343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b06a460e-45f4-4bde-af43-3638d5cd2511 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:16 devstack sudo[111115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b06a460e-45f4-4bde-af43-3638d5cd2511 Jun 17 06:03:16 devstack sudo[111115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:17 devstack sudo[111106]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ab26a589-91e4-4b79-ae5c-0bb5fc880631 tempest-CreateVolumesFromSnapshotTest-309904984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-3453d74f-3b66-49a9-a184-febb02e2b71a" returned: 0 in 0.775s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:17 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-ab26a589-91e4-4b79-ae5c-0bb5fc880631 tempest-CreateVolumesFromSnapshotTest-309904984 None] Lock "cinder-quobyte-3453d74f-3b66-49a9-a184-febb02e2b71a" released by "delete_volume" :: held 1.761s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:03:17 devstack sudo[111105]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_58087b50-c893-4592-914f-cd037b88b0f6_wibt5ixhdevstack@QuobyteHD" returned: 0 in 0.879s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_58087b50-c893-4592-914f-cd037b88b0f6_wibt5ixhdevstack@QuobyteHD {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:17 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-ab26a589-91e4-4b79-ae5c-0bb5fc880631 tempest-CreateVolumesFromSnapshotTest-309904984 None] Created reservations ['b74c1cf7-d859-4537-83f8-cac80d704c01', '089f430e-fba9-4e96-8882-be81c84fe152', '51977c14-4af6-4c8a-ae4a-1b1410c8d976', '1701af76-d3d3-4fcb-867a-f3de8598387d'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 06:03:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ab26a589-91e4-4b79-ae5c-0bb5fc880631 tempest-CreateVolumesFromSnapshotTest-309904984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:03:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ab26a589-91e4-4b79-ae5c-0bb5fc880631 tempest-CreateVolumesFromSnapshotTest-309904984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:03:17 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ab26a589-91e4-4b79-ae5c-0bb5fc880631 tempest-CreateVolumesFromSnapshotTest-309904984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 06:03:17 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ab26a589-91e4-4b79-ae5c-0bb5fc880631 tempest-CreateVolumesFromSnapshotTest-309904984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 06:03:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ab26a589-91e4-4b79-ae5c-0bb5fc880631 tempest-CreateVolumesFromSnapshotTest-309904984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:03:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ab26a589-91e4-4b79-ae5c-0bb5fc880631 tempest-CreateVolumesFromSnapshotTest-309904984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:17 devstack sudo[111120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_58087b50-c893-4592-914f-cd037b88b0f6_wibt5ixhdevstack@QuobyteHD Jun 17 06:03:17 devstack sudo[111120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:17 devstack sudo[111122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 06:03:17 devstack sudo[111122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:17 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-252d2450-4638-4c96-814a-21e6d6f579c3 tempest-CreateVolumesFromSnapshotTest-309904984 None] Acquiring lock "cinder-e21e23ae-e481-4bee-a2c7-1c9b40ccf6f7-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:03:17 devstack sudo[111115]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-65e15fcb-61a0-4186-973a-698cc3da6f4f tempest-VolumeDependencyTests-1046372343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b06a460e-45f4-4bde-af43-3638d5cd2511" returned: 0 in 0.998s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-65e15fcb-61a0-4186-973a-698cc3da6f4f tempest-VolumeDependencyTests-1046372343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b06a460e-45f4-4bde-af43-3638d5cd2511,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b06a460e-45f4-4bde-af43-3638d5cd2511.55f3f77b-ea1e-4423-92c0-8d6dbd5ec778 1G {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:17 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-252d2450-4638-4c96-814a-21e6d6f579c3 tempest-CreateVolumesFromSnapshotTest-309904984 None] Lock "cinder-e21e23ae-e481-4bee-a2c7-1c9b40ccf6f7-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:03:17 devstack sudo[111127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b06a460e-45f4-4bde-af43-3638d5cd2511,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b06a460e-45f4-4bde-af43-3638d5cd2511.55f3f77b-ea1e-4423-92c0-8d6dbd5ec778 1G Jun 17 06:03:17 devstack sudo[111127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:17 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-252d2450-4638-4c96-814a-21e6d6f579c3 tempest-CreateVolumesFromSnapshotTest-309904984 None] Acquiring lock "cinder-quobyte-e21e23ae-e481-4bee-a2c7-1c9b40ccf6f7" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:03:17 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-252d2450-4638-4c96-814a-21e6d6f579c3 tempest-CreateVolumesFromSnapshotTest-309904984 None] Lock "cinder-quobyte-e21e23ae-e481-4bee-a2c7-1c9b40ccf6f7" acquired by "delete_volume" :: waited 0.021s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:03:17 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b21c57-7617-4816-8ff4-f7ae2673bf1d]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 06:03:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-252d2450-4638-4c96-814a-21e6d6f579c3 tempest-CreateVolumesFromSnapshotTest-309904984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-e21e23ae-e481-4bee-a2c7-1c9b40ccf6f7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:17 devstack sudo[111129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-e21e23ae-e481-4bee-a2c7-1c9b40ccf6f7 Jun 17 06:03:17 devstack sudo[111129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:18 devstack sudo[111122]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:18 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ab26a589-91e4-4b79-ae5c-0bb5fc880631 tempest-CreateVolumesFromSnapshotTest-309904984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.902s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:18 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-ab26a589-91e4-4b79-ae5c-0bb5fc880631 tempest-CreateVolumesFromSnapshotTest-309904984 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 06:03:18 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-ab26a589-91e4-4b79-ae5c-0bb5fc880631 tempest-CreateVolumesFromSnapshotTest-309904984 None] Deleted volume successfully. Jun 17 06:03:18 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-ab26a589-91e4-4b79-ae5c-0bb5fc880631 tempest-CreateVolumesFromSnapshotTest-309904984 None] Lock "cinder-3453d74f-3b66-49a9-a184-febb02e2b71a-delete_volume" released by "delete_volume" :: held 2.961s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:03:18 devstack sudo[111120]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:18 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_58087b50-c893-4592-914f-cd037b88b0f6_wibt5ixhdevstack@QuobyteHD" returned: 1 in 1.081s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:18 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_58087b50-c893-4592-914f-cd037b88b0f6_wibt5ixhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 06:03:18 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:03:18 devstack sudo[111127]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:18 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-65e15fcb-61a0-4186-973a-698cc3da6f4f tempest-VolumeDependencyTests-1046372343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b06a460e-45f4-4bde-af43-3638d5cd2511,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b06a460e-45f4-4bde-af43-3638d5cd2511.55f3f77b-ea1e-4423-92c0-8d6dbd5ec778 1G" returned: 0 in 1.010s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:18 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-65e15fcb-61a0-4186-973a-698cc3da6f4f tempest-VolumeDependencyTests-1046372343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b06a460e-45f4-4bde-af43-3638d5cd2511 -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b06a460e-45f4-4bde-af43-3638d5cd2511.55f3f77b-ea1e-4423-92c0-8d6dbd5ec778 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:18 devstack sudo[111129]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:18 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-252d2450-4638-4c96-814a-21e6d6f579c3 tempest-CreateVolumesFromSnapshotTest-309904984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-e21e23ae-e481-4bee-a2c7-1c9b40ccf6f7" returned: 0 in 0.880s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:18 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-252d2450-4638-4c96-814a-21e6d6f579c3 tempest-CreateVolumesFromSnapshotTest-309904984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-e21e23ae-e481-4bee-a2c7-1c9b40ccf6f7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:18 devstack sudo[111142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b06a460e-45f4-4bde-af43-3638d5cd2511 -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b06a460e-45f4-4bde-af43-3638d5cd2511.55f3f77b-ea1e-4423-92c0-8d6dbd5ec778 Jun 17 06:03:18 devstack sudo[111142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:18 devstack sudo[111143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-e21e23ae-e481-4bee-a2c7-1c9b40ccf6f7 Jun 17 06:03:18 devstack sudo[111143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:19 devstack sudo[111143]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:19 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-252d2450-4638-4c96-814a-21e6d6f579c3 tempest-CreateVolumesFromSnapshotTest-309904984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-e21e23ae-e481-4bee-a2c7-1c9b40ccf6f7" returned: 0 in 0.633s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:19 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-252d2450-4638-4c96-814a-21e6d6f579c3 tempest-CreateVolumesFromSnapshotTest-309904984 None] Lock "cinder-quobyte-e21e23ae-e481-4bee-a2c7-1c9b40ccf6f7" released by "delete_volume" :: held 1.561s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:03:19 devstack sudo[111142]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:19 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-65e15fcb-61a0-4186-973a-698cc3da6f4f tempest-VolumeDependencyTests-1046372343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b06a460e-45f4-4bde-af43-3638d5cd2511 -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b06a460e-45f4-4bde-af43-3638d5cd2511.55f3f77b-ea1e-4423-92c0-8d6dbd5ec778" returned: 0 in 0.716s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:19 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [None req-65e15fcb-61a0-4186-973a-698cc3da6f4f tempest-VolumeDependencyTests-1046372343 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b06a460e-45f4-4bde-af43-3638d5cd2511.55f3f77b-ea1e-4423-92c0-8d6dbd5ec778 is being set with open permissions: ugo+rw Jun 17 06:03:19 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-65e15fcb-61a0-4186-973a-698cc3da6f4f tempest-VolumeDependencyTests-1046372343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b06a460e-45f4-4bde-af43-3638d5cd2511.55f3f77b-ea1e-4423-92c0-8d6dbd5ec778 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:19 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-252d2450-4638-4c96-814a-21e6d6f579c3 tempest-CreateVolumesFromSnapshotTest-309904984 None] Created reservations ['be6f6660-fde1-4f39-adb6-e65fcade42b9', '516f1ed5-d1c2-4aee-a394-53612fca6c7e', 'ac95e65b-c2c1-4e2c-b357-4670606ecafe', '853120dc-27b5-4af6-a940-310282461c92'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 06:03:19 devstack sudo[111152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b06a460e-45f4-4bde-af43-3638d5cd2511.55f3f77b-ea1e-4423-92c0-8d6dbd5ec778 Jun 17 06:03:19 devstack sudo[111152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:19 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-252d2450-4638-4c96-814a-21e6d6f579c3 tempest-CreateVolumesFromSnapshotTest-309904984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:03:19 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-252d2450-4638-4c96-814a-21e6d6f579c3 tempest-CreateVolumesFromSnapshotTest-309904984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:03:19 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-252d2450-4638-4c96-814a-21e6d6f579c3 tempest-CreateVolumesFromSnapshotTest-309904984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 06:03:19 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-252d2450-4638-4c96-814a-21e6d6f579c3 tempest-CreateVolumesFromSnapshotTest-309904984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 06:03:19 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-252d2450-4638-4c96-814a-21e6d6f579c3 tempest-CreateVolumesFromSnapshotTest-309904984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:03:19 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-252d2450-4638-4c96-814a-21e6d6f579c3 tempest-CreateVolumesFromSnapshotTest-309904984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:19 devstack sudo[111154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 06:03:19 devstack sudo[111154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:19 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-4ba27671-fd51-4b76-9648-b911d37b9fe1 tempest-CreateVolumesFromSnapshotTest-309904984 None] Acquiring lock "cinder-9023bdb6-76eb-4cb6-b3ab-6be705910839-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:03:19 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-4ba27671-fd51-4b76-9648-b911d37b9fe1 tempest-CreateVolumesFromSnapshotTest-309904984 None] Lock "cinder-9023bdb6-76eb-4cb6-b3ab-6be705910839-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:03:20 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-4ba27671-fd51-4b76-9648-b911d37b9fe1 tempest-CreateVolumesFromSnapshotTest-309904984 None] Acquiring lock "cinder-quobyte-9023bdb6-76eb-4cb6-b3ab-6be705910839" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:03:20 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-4ba27671-fd51-4b76-9648-b911d37b9fe1 tempest-CreateVolumesFromSnapshotTest-309904984 None] Lock "cinder-quobyte-9023bdb6-76eb-4cb6-b3ab-6be705910839" acquired by "delete_volume" :: waited 0.030s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:03:20 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdffc8d3-3005-4d78-8530-250124566ce7]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 06:03:20 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4ba27671-fd51-4b76-9648-b911d37b9fe1 tempest-CreateVolumesFromSnapshotTest-309904984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9023bdb6-76eb-4cb6-b3ab-6be705910839 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:20 devstack sudo[111152]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:20 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-65e15fcb-61a0-4186-973a-698cc3da6f4f tempest-VolumeDependencyTests-1046372343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b06a460e-45f4-4bde-af43-3638d5cd2511.55f3f77b-ea1e-4423-92c0-8d6dbd5ec778" returned: 0 in 0.710s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:20 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-65e15fcb-61a0-4186-973a-698cc3da6f4f tempest-VolumeDependencyTests-1046372343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b06a460e-45f4-4bde-af43-3638d5cd2511.info {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:20 devstack sudo[111158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9023bdb6-76eb-4cb6-b3ab-6be705910839 Jun 17 06:03:20 devstack sudo[111154]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:20 devstack sudo[111158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:20 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-252d2450-4638-4c96-814a-21e6d6f579c3 tempest-CreateVolumesFromSnapshotTest-309904984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.677s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:20 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-252d2450-4638-4c96-814a-21e6d6f579c3 tempest-CreateVolumesFromSnapshotTest-309904984 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 06:03:20 devstack sudo[111159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b06a460e-45f4-4bde-af43-3638d5cd2511.info Jun 17 06:03:20 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-252d2450-4638-4c96-814a-21e6d6f579c3 tempest-CreateVolumesFromSnapshotTest-309904984 None] Deleted volume successfully. Jun 17 06:03:20 devstack sudo[111159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:20 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-252d2450-4638-4c96-814a-21e6d6f579c3 tempest-CreateVolumesFromSnapshotTest-309904984 None] Lock "cinder-e21e23ae-e481-4bee-a2c7-1c9b40ccf6f7-delete_volume" released by "delete_volume" :: held 2.509s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:03:20 devstack sudo[111159]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:20 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-65e15fcb-61a0-4186-973a-698cc3da6f4f tempest-VolumeDependencyTests-1046372343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b06a460e-45f4-4bde-af43-3638d5cd2511.info" returned: 0 in 0.651s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:20 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [None req-65e15fcb-61a0-4186-973a-698cc3da6f4f tempest-VolumeDependencyTests-1046372343 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b06a460e-45f4-4bde-af43-3638d5cd2511.info is being set with open permissions: ugo+rw Jun 17 06:03:20 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-65e15fcb-61a0-4186-973a-698cc3da6f4f tempest-VolumeDependencyTests-1046372343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b06a460e-45f4-4bde-af43-3638d5cd2511.info {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:20 devstack sudo[111166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b06a460e-45f4-4bde-af43-3638d5cd2511.info Jun 17 06:03:20 devstack sudo[111166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:20 devstack sudo[111158]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:20 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4ba27671-fd51-4b76-9648-b911d37b9fe1 tempest-CreateVolumesFromSnapshotTest-309904984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9023bdb6-76eb-4cb6-b3ab-6be705910839" returned: 0 in 0.822s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:20 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4ba27671-fd51-4b76-9648-b911d37b9fe1 tempest-CreateVolumesFromSnapshotTest-309904984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9023bdb6-76eb-4cb6-b3ab-6be705910839 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:20 devstack sudo[111168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9023bdb6-76eb-4cb6-b3ab-6be705910839 Jun 17 06:03:20 devstack sudo[111168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:21 devstack sudo[111166]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:21 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-65e15fcb-61a0-4186-973a-698cc3da6f4f tempest-VolumeDependencyTests-1046372343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b06a460e-45f4-4bde-af43-3638d5cd2511.info" returned: 0 in 0.613s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:21 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-65e15fcb-61a0-4186-973a-698cc3da6f4f tempest-VolumeDependencyTests-1046372343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.830s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:03:21 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.127s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:03:21 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T04:03:14Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=169f084b-6714-44b4-ad9d-5069f48bcb45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='458b508dfd66482f9f58740899e3952d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T04:03:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T04:03:14Z,use_quota=True,user_id='a9ae8aafbb5b45f7aff3a842e184d08d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 06:03:21 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] Creating volume 169f084b-6714-44b4-ad9d-5069f48bcb45 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 06:03:21 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:03:21 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:03:21 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 06:03:21 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 06:03:21 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:03:21 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 06:03:21 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 06:03:21 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-169f084b-6714-44b4-ad9d-5069f48bcb45 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:21 devstack sudo[111168]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:21 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4ba27671-fd51-4b76-9648-b911d37b9fe1 tempest-CreateVolumesFromSnapshotTest-309904984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-9023bdb6-76eb-4cb6-b3ab-6be705910839" returned: 0 in 0.664s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:21 devstack sudo[111172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-169f084b-6714-44b4-ad9d-5069f48bcb45 1073741824 Jun 17 06:03:21 devstack sudo[111172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:21 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-4ba27671-fd51-4b76-9648-b911d37b9fe1 tempest-CreateVolumesFromSnapshotTest-309904984 None] Lock "cinder-quobyte-9023bdb6-76eb-4cb6-b3ab-6be705910839" released by "delete_volume" :: held 1.552s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:03:21 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-65e15fcb-61a0-4186-973a-698cc3da6f4f tempest-VolumeDependencyTests-1046372343 None] Create snapshot completed successfully Jun 17 06:03:21 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-4ba27671-fd51-4b76-9648-b911d37b9fe1 tempest-CreateVolumesFromSnapshotTest-309904984 None] Created reservations ['98dc7dd7-d3e7-4284-978b-0e923392dffd', '5d2f3f3b-e83a-4145-9dab-13ae59f9a3a4', '6f4eadcb-df80-4f51-a233-dbc6c26acab4', 'b2bc3565-350c-423a-b448-1dadd9658329'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 06:03:21 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-4ba27671-fd51-4b76-9648-b911d37b9fe1 tempest-CreateVolumesFromSnapshotTest-309904984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:03:21 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-4ba27671-fd51-4b76-9648-b911d37b9fe1 tempest-CreateVolumesFromSnapshotTest-309904984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:03:21 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-4ba27671-fd51-4b76-9648-b911d37b9fe1 tempest-CreateVolumesFromSnapshotTest-309904984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 06:03:21 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-4ba27671-fd51-4b76-9648-b911d37b9fe1 tempest-CreateVolumesFromSnapshotTest-309904984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 06:03:21 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-4ba27671-fd51-4b76-9648-b911d37b9fe1 tempest-CreateVolumesFromSnapshotTest-309904984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:03:21 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4ba27671-fd51-4b76-9648-b911d37b9fe1 tempest-CreateVolumesFromSnapshotTest-309904984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:21 devstack sudo[111174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 06:03:21 devstack sudo[111174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:22 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-808b707b-90c2-470e-9c2f-bd98b561fcdc tempest-CreateVolumesFromSnapshotTest-309904984 None] Acquiring lock "cinder-20239d68-f922-4039-ae6a-83af6aeab024-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:03:22 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-808b707b-90c2-470e-9c2f-bd98b561fcdc tempest-CreateVolumesFromSnapshotTest-309904984 None] Lock "cinder-20239d68-f922-4039-ae6a-83af6aeab024-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:03:22 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-808b707b-90c2-470e-9c2f-bd98b561fcdc tempest-CreateVolumesFromSnapshotTest-309904984 None] Acquiring lock "cinder-quobyte-20239d68-f922-4039-ae6a-83af6aeab024" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:03:22 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-808b707b-90c2-470e-9c2f-bd98b561fcdc tempest-CreateVolumesFromSnapshotTest-309904984 None] Lock "cinder-quobyte-20239d68-f922-4039-ae6a-83af6aeab024" acquired by "delete_volume" :: waited 0.023s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:03:22 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd070e5f-ecfd-4fed-b84d-ebe35ee9f5bc]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 06:03:22 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-808b707b-90c2-470e-9c2f-bd98b561fcdc tempest-CreateVolumesFromSnapshotTest-309904984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-20239d68-f922-4039-ae6a-83af6aeab024 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:22 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-f25653fe-8d4a-479f-a353-d99cd1980d20 tempest-VolumeDependencyTests-1046372343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 06:03:22 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-f25653fe-8d4a-479f-a353-d99cd1980d20 tempest-VolumeDependencyTests-1046372343 None] Flow 'volume_create_manager' (738853de-2617-47ee-89f2-262d1faf3dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 06:03:22 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-f25653fe-8d4a-479f-a353-d99cd1980d20 tempest-VolumeDependencyTests-1046372343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51097f69-dd25-4393-8bab-4bdf36725890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:22 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-f25653fe-8d4a-479f-a353-d99cd1980d20 tempest-VolumeDependencyTests-1046372343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51097f69-dd25-4393-8bab-4bdf36725890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T04:03:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1157135638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=135d30a5-df59-4e44-b0e5-8f4f15c2722b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6c19aa15d104b83b9155f54053652ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T04:03:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=55f3f77b-ea1e-4423-92c0-8d6dbd5ec778,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T04:03:22Z,use_quota=True,user_id='1982b1c61fac46aca6b2cbf83b69f484',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:22 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-f25653fe-8d4a-479f-a353-d99cd1980d20 tempest-VolumeDependencyTests-1046372343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (842c5403-02a7-4656-820a-69d53986e5bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:22 devstack sudo[111174]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:22 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-f25653fe-8d4a-479f-a353-d99cd1980d20 tempest-VolumeDependencyTests-1046372343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (842c5403-02a7-4656-820a-69d53986e5bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:22 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-f25653fe-8d4a-479f-a353-d99cd1980d20 tempest-VolumeDependencyTests-1046372343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02dede59-30c7-40ba-bba2-51e874e4e8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:22 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-f25653fe-8d4a-479f-a353-d99cd1980d20 tempest-VolumeDependencyTests-1046372343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02dede59-30c7-40ba-bba2-51e874e4e8e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '135d30a5-df59-4e44-b0e5-8f4f15c2722b', 'volume_name': 'volume-135d30a5-df59-4e44-b0e5-8f4f15c2722b', 'volume_size': 1, 'snapshot_id': '55f3f77b-ea1e-4423-92c0-8d6dbd5ec778'}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:22 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-f25653fe-8d4a-479f-a353-d99cd1980d20 tempest-VolumeDependencyTests-1046372343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaa9940f-6f1d-4f6b-aa15-adc93d301f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:22 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-f25653fe-8d4a-479f-a353-d99cd1980d20 tempest-VolumeDependencyTests-1046372343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaa9940f-6f1d-4f6b-aa15-adc93d301f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:22 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-f25653fe-8d4a-479f-a353-d99cd1980d20 tempest-VolumeDependencyTests-1046372343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d298e9c0-99cd-4c5b-b516-ac38fd5d17db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:22 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-f25653fe-8d4a-479f-a353-d99cd1980d20 tempest-VolumeDependencyTests-1046372343 None] Volume 135d30a5-df59-4e44-b0e5-8f4f15c2722b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-135d30a5-df59-4e44-b0e5-8f4f15c2722b', 'volume_size': 1, 'snapshot_id': '55f3f77b-ea1e-4423-92c0-8d6dbd5ec778'} Jun 17 06:03:22 devstack sudo[111172]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:22 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4ba27671-fd51-4b76-9648-b911d37b9fe1 tempest-CreateVolumesFromSnapshotTest-309904984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.890s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:22 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-4ba27671-fd51-4b76-9648-b911d37b9fe1 tempest-CreateVolumesFromSnapshotTest-309904984 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 06:03:22 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-169f084b-6714-44b4-ad9d-5069f48bcb45 1073741824" returned: 0 in 1.119s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:22 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-4ba27671-fd51-4b76-9648-b911d37b9fe1 tempest-CreateVolumesFromSnapshotTest-309904984 None] Deleted volume successfully. Jun 17 06:03:22 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-f25653fe-8d4a-479f-a353-d99cd1980d20 tempest-VolumeDependencyTests-1046372343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:03:22 devstack sudo[111181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-20239d68-f922-4039-ae6a-83af6aeab024 Jun 17 06:03:22 devstack sudo[111181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:22 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-4ba27671-fd51-4b76-9648-b911d37b9fe1 tempest-CreateVolumesFromSnapshotTest-309904984 None] Lock "cinder-9023bdb6-76eb-4cb6-b3ab-6be705910839-delete_volume" released by "delete_volume" :: held 2.726s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:03:22 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-169f084b-6714-44b4-ad9d-5069f48bcb45 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:22 devstack sudo[111183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-169f084b-6714-44b4-ad9d-5069f48bcb45 Jun 17 06:03:22 devstack sudo[111183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:23 devstack sudo[111181]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:23 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-808b707b-90c2-470e-9c2f-bd98b561fcdc tempest-CreateVolumesFromSnapshotTest-309904984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-20239d68-f922-4039-ae6a-83af6aeab024" returned: 0 in 0.954s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:23 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-808b707b-90c2-470e-9c2f-bd98b561fcdc tempest-CreateVolumesFromSnapshotTest-309904984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-20239d68-f922-4039-ae6a-83af6aeab024 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:23 devstack sudo[111183]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:23 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-169f084b-6714-44b4-ad9d-5069f48bcb45" returned: 0 in 0.771s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:23 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] <== create_volume: return (1958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 06:03:23 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.969s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:03:23 devstack sudo[111189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-20239d68-f922-4039-ae6a-83af6aeab024 Jun 17 06:03:23 devstack sudo[111189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:23 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-f25653fe-8d4a-479f-a353-d99cd1980d20 tempest-VolumeDependencyTests-1046372343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.818s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:03:23 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-f25653fe-8d4a-479f-a353-d99cd1980d20 tempest-VolumeDependencyTests-1046372343 None] Acquiring lock "cinder-quobyte-55f3f77b-ea1e-4423-92c0-8d6dbd5ec778-135d30a5-df59-4e44-b0e5-8f4f15c2722b" by "_create_volume_from_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:03:23 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-f25653fe-8d4a-479f-a353-d99cd1980d20 tempest-VolumeDependencyTests-1046372343 None] Lock "cinder-quobyte-55f3f77b-ea1e-4423-92c0-8d6dbd5ec778-135d30a5-df59-4e44-b0e5-8f4f15c2722b" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:03:23 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-f25653fe-8d4a-479f-a353-d99cd1980d20 tempest-VolumeDependencyTests-1046372343 None] Creating volume 135d30a5-df59-4e44-b0e5-8f4f15c2722b from snapshot 55f3f77b-ea1e-4423-92c0-8d6dbd5ec778 {{(pid=92083) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 17 06:03:23 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-f25653fe-8d4a-479f-a353-d99cd1980d20 tempest-VolumeDependencyTests-1046372343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:03:23 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-f25653fe-8d4a-479f-a353-d99cd1980d20 tempest-VolumeDependencyTests-1046372343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:03:23 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-f25653fe-8d4a-479f-a353-d99cd1980d20 tempest-VolumeDependencyTests-1046372343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 06:03:23 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-f25653fe-8d4a-479f-a353-d99cd1980d20 tempest-VolumeDependencyTests-1046372343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 06:03:23 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-f25653fe-8d4a-479f-a353-d99cd1980d20 tempest-VolumeDependencyTests-1046372343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:03:23 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-f25653fe-8d4a-479f-a353-d99cd1980d20 tempest-VolumeDependencyTests-1046372343 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 06:03:23 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-f25653fe-8d4a-479f-a353-d99cd1980d20 tempest-VolumeDependencyTests-1046372343 None] Acquiring lock "cinder-quobyte-135d30a5-df59-4e44-b0e5-8f4f15c2722b" by "_copy_volume_from_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:03:23 devstack cinder-volume[92083]: DEBUG cinder.volume.volume_utils [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] Attempting download of 58087b50-c893-4592-914f-cd037b88b0f6 ((None, [{'url': 'file:///opt/stack/data/glance/images/58087b50-c893-4592-914f-cd037b88b0f6', 'metadata': {}}])) to volume 169f084b-6714-44b4-ad9d-5069f48bcb45. {{(pid=92083) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 17 06:03:23 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-f25653fe-8d4a-479f-a353-d99cd1980d20 tempest-VolumeDependencyTests-1046372343 None] Lock "cinder-quobyte-135d30a5-df59-4e44-b0e5-8f4f15c2722b" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:03:23 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-f25653fe-8d4a-479f-a353-d99cd1980d20 tempest-VolumeDependencyTests-1046372343 None] snapshot: 55f3f77b-ea1e-4423-92c0-8d6dbd5ec778, volume: 135d30a5-df59-4e44-b0e5-8f4f15c2722b, {{(pid=92083) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 17 06:03:23 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-f25653fe-8d4a-479f-a353-d99cd1980d20 tempest-VolumeDependencyTests-1046372343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:03:23 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-f25653fe-8d4a-479f-a353-d99cd1980d20 tempest-VolumeDependencyTests-1046372343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:03:23 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-f25653fe-8d4a-479f-a353-d99cd1980d20 tempest-VolumeDependencyTests-1046372343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 06:03:23 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-f25653fe-8d4a-479f-a353-d99cd1980d20 tempest-VolumeDependencyTests-1046372343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 06:03:23 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-f25653fe-8d4a-479f-a353-d99cd1980d20 tempest-VolumeDependencyTests-1046372343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:03:23 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bef0a1c-41d6-4a6e-a812-174c7df03b74]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 06:03:23 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f25653fe-8d4a-479f-a353-d99cd1980d20 tempest-VolumeDependencyTests-1046372343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b06a460e-45f4-4bde-af43-3638d5cd2511.55f3f77b-ea1e-4423-92c0-8d6dbd5ec778 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:23 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[67362b77-f6fd-4724-9fdc-bd02103408b3]: (4, 'raw') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 06:03:23 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_58087b50-c893-4592-914f-cd037b88b0f6_jhg37yww {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:23 devstack sudo[111192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_58087b50-c893-4592-914f-cd037b88b0f6_jhg37yww Jun 17 06:03:23 devstack sudo[111192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:23 devstack sudo[111191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b06a460e-45f4-4bde-af43-3638d5cd2511.55f3f77b-ea1e-4423-92c0-8d6dbd5ec778 Jun 17 06:03:23 devstack sudo[111191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:24 devstack sudo[111189]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-808b707b-90c2-470e-9c2f-bd98b561fcdc tempest-CreateVolumesFromSnapshotTest-309904984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-20239d68-f922-4039-ae6a-83af6aeab024" returned: 0 in 0.694s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:24 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-808b707b-90c2-470e-9c2f-bd98b561fcdc tempest-CreateVolumesFromSnapshotTest-309904984 None] Lock "cinder-quobyte-20239d68-f922-4039-ae6a-83af6aeab024" released by "delete_volume" :: held 1.718s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:03:24 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-808b707b-90c2-470e-9c2f-bd98b561fcdc tempest-CreateVolumesFromSnapshotTest-309904984 None] Created reservations ['d1501344-3139-4d5e-858c-79bc4e6ffdb4', '224295da-f00a-4970-823d-c3a76dc747dc', '6449d657-c69a-408f-8fd3-a6694a91b7d4', 'a760b863-2004-4d41-92a9-c795ad8c6037'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 06:03:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-808b707b-90c2-470e-9c2f-bd98b561fcdc tempest-CreateVolumesFromSnapshotTest-309904984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:03:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-808b707b-90c2-470e-9c2f-bd98b561fcdc tempest-CreateVolumesFromSnapshotTest-309904984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:03:24 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-808b707b-90c2-470e-9c2f-bd98b561fcdc tempest-CreateVolumesFromSnapshotTest-309904984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 06:03:24 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-808b707b-90c2-470e-9c2f-bd98b561fcdc tempest-CreateVolumesFromSnapshotTest-309904984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 06:03:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-808b707b-90c2-470e-9c2f-bd98b561fcdc tempest-CreateVolumesFromSnapshotTest-309904984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:03:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-808b707b-90c2-470e-9c2f-bd98b561fcdc tempest-CreateVolumesFromSnapshotTest-309904984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:24 devstack sudo[111196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 06:03:24 devstack sudo[111196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:24 devstack sudo[111191]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f25653fe-8d4a-479f-a353-d99cd1980d20 tempest-VolumeDependencyTests-1046372343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b06a460e-45f4-4bde-af43-3638d5cd2511.55f3f77b-ea1e-4423-92c0-8d6dbd5ec778" returned: 0 in 0.882s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:24 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-f25653fe-8d4a-479f-a353-d99cd1980d20 tempest-VolumeDependencyTests-1046372343 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b06a460e-45f4-4bde-af43-3638d5cd2511(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92083) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 06:03:24 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-f25653fe-8d4a-479f-a353-d99cd1980d20 tempest-VolumeDependencyTests-1046372343 None] will copy from snapshot at /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b06a460e-45f4-4bde-af43-3638d5cd2511 {{(pid=92083) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 17 06:03:24 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-f25653fe-8d4a-479f-a353-d99cd1980d20 tempest-VolumeDependencyTests-1046372343 None] Creating direct copy from snapshot {{(pid=92083) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 17 06:03:24 devstack sudo[111192]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_58087b50-c893-4592-914f-cd037b88b0f6_jhg37yww" returned: 0 in 0.874s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_58087b50-c893-4592-914f-cd037b88b0f6_jhg37yww {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:24 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[78bdd179-7be5-4cb2-8649-896758201017]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 06:03:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f25653fe-8d4a-479f-a353-d99cd1980d20 tempest-VolumeDependencyTests-1046372343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b06a460e-45f4-4bde-af43-3638d5cd2511 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:24 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-58a0b959-b37a-4a15-9517-50abe150a121 tempest-CreateVolumesFromSnapshotTest-309904984 None] Acquiring lock "cinder-838fd2f6-b734-49dd-a60e-06de131c5d54-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:03:24 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-58a0b959-b37a-4a15-9517-50abe150a121 tempest-CreateVolumesFromSnapshotTest-309904984 None] Lock "cinder-838fd2f6-b734-49dd-a60e-06de131c5d54-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:03:24 devstack sudo[111204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b06a460e-45f4-4bde-af43-3638d5cd2511 Jun 17 06:03:24 devstack sudo[111204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:24 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-58a0b959-b37a-4a15-9517-50abe150a121 tempest-CreateVolumesFromSnapshotTest-309904984 None] Acquiring lock "cinder-quobyte-838fd2f6-b734-49dd-a60e-06de131c5d54" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:03:24 devstack sudo[111203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_58087b50-c893-4592-914f-cd037b88b0f6_jhg37yww Jun 17 06:03:24 devstack sudo[111203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:24 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-58a0b959-b37a-4a15-9517-50abe150a121 tempest-CreateVolumesFromSnapshotTest-309904984 None] Lock "cinder-quobyte-838fd2f6-b734-49dd-a60e-06de131c5d54" acquired by "delete_volume" :: waited 0.027s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:03:24 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f6091c5-ec67-46a7-8484-9ab62c0838a2]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 06:03:24 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-58a0b959-b37a-4a15-9517-50abe150a121 tempest-CreateVolumesFromSnapshotTest-309904984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-838fd2f6-b734-49dd-a60e-06de131c5d54 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:25 devstack sudo[111207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-838fd2f6-b734-49dd-a60e-06de131c5d54 Jun 17 06:03:25 devstack sudo[111207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:25 devstack sudo[111196]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-808b707b-90c2-470e-9c2f-bd98b561fcdc tempest-CreateVolumesFromSnapshotTest-309904984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 1.014s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:25 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-808b707b-90c2-470e-9c2f-bd98b561fcdc tempest-CreateVolumesFromSnapshotTest-309904984 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 06:03:25 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-808b707b-90c2-470e-9c2f-bd98b561fcdc tempest-CreateVolumesFromSnapshotTest-309904984 None] Deleted volume successfully. Jun 17 06:03:25 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-808b707b-90c2-470e-9c2f-bd98b561fcdc tempest-CreateVolumesFromSnapshotTest-309904984 None] Lock "cinder-20239d68-f922-4039-ae6a-83af6aeab024-delete_volume" released by "delete_volume" :: held 3.096s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:03:25 devstack sudo[111203]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_58087b50-c893-4592-914f-cd037b88b0f6_jhg37yww" returned: 1 in 1.078s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_58087b50-c893-4592-914f-cd037b88b0f6_jhg37yww' failed. Not Retrying. {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 06:03:25 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[e808e05d-6fbb-4bc7-8b32-334e1e63d5ba]: (4, 'raw') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 06:03:25 devstack sudo[111204]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_58087b50-c893-4592-914f-cd037b88b0f6_wibt5ixhdevstack@QuobyteHD {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f25653fe-8d4a-479f-a353-d99cd1980d20 tempest-VolumeDependencyTests-1046372343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b06a460e-45f4-4bde-af43-3638d5cd2511" returned: 0 in 1.080s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:25 devstack cinder-volume[92083]: DEBUG cinder.utils [None req-f25653fe-8d4a-479f-a353-d99cd1980d20 tempest-VolumeDependencyTests-1046372343 None] Path /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-135d30a5-df59-4e44-b0e5-8f4f15c2722b not found in is_blk_device check {{(pid=92083) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 17 06:03:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f25653fe-8d4a-479f-a353-d99cd1980d20 tempest-VolumeDependencyTests-1046372343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b06a460e-45f4-4bde-af43-3638d5cd2511 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-135d30a5-df59-4e44-b0e5-8f4f15c2722b {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:25 devstack sudo[111216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b06a460e-45f4-4bde-af43-3638d5cd2511 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-135d30a5-df59-4e44-b0e5-8f4f15c2722b Jun 17 06:03:25 devstack sudo[111216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:25 devstack sudo[111215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_58087b50-c893-4592-914f-cd037b88b0f6_wibt5ixhdevstack@QuobyteHD Jun 17 06:03:25 devstack sudo[111215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:25 devstack sudo[111207]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-58a0b959-b37a-4a15-9517-50abe150a121 tempest-CreateVolumesFromSnapshotTest-309904984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-838fd2f6-b734-49dd-a60e-06de131c5d54" returned: 0 in 1.073s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:25 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-58a0b959-b37a-4a15-9517-50abe150a121 tempest-CreateVolumesFromSnapshotTest-309904984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-838fd2f6-b734-49dd-a60e-06de131c5d54 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:25 devstack sudo[111222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-838fd2f6-b734-49dd-a60e-06de131c5d54 Jun 17 06:03:25 devstack sudo[111222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:26 devstack sudo[111215]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:26 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_58087b50-c893-4592-914f-cd037b88b0f6_wibt5ixhdevstack@QuobyteHD" returned: 0 in 1.016s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:26 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_58087b50-c893-4592-914f-cd037b88b0f6_wibt5ixhdevstack@QuobyteHD {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:26 devstack sudo[111222]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:26 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-58a0b959-b37a-4a15-9517-50abe150a121 tempest-CreateVolumesFromSnapshotTest-309904984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-838fd2f6-b734-49dd-a60e-06de131c5d54" returned: 0 in 0.739s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:26 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-58a0b959-b37a-4a15-9517-50abe150a121 tempest-CreateVolumesFromSnapshotTest-309904984 None] Lock "cinder-quobyte-838fd2f6-b734-49dd-a60e-06de131c5d54" released by "delete_volume" :: held 1.920s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:03:26 devstack sudo[111231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_58087b50-c893-4592-914f-cd037b88b0f6_wibt5ixhdevstack@QuobyteHD Jun 17 06:03:26 devstack sudo[111231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:26 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-58a0b959-b37a-4a15-9517-50abe150a121 tempest-CreateVolumesFromSnapshotTest-309904984 None] Created reservations ['432f6ab0-a027-4838-b83f-f85ac4175371', 'f9e75364-dbfb-405a-9682-3b572ee89c11', '426c9946-90bb-4a50-ad69-fbff2ddbf25e', 'fd1d3168-c0fd-45d1-9b93-c5932b9d2fa6'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 06:03:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-58a0b959-b37a-4a15-9517-50abe150a121 tempest-CreateVolumesFromSnapshotTest-309904984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:03:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-58a0b959-b37a-4a15-9517-50abe150a121 tempest-CreateVolumesFromSnapshotTest-309904984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:03:27 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-58a0b959-b37a-4a15-9517-50abe150a121 tempest-CreateVolumesFromSnapshotTest-309904984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 06:03:27 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-58a0b959-b37a-4a15-9517-50abe150a121 tempest-CreateVolumesFromSnapshotTest-309904984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 06:03:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-58a0b959-b37a-4a15-9517-50abe150a121 tempest-CreateVolumesFromSnapshotTest-309904984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:03:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-58a0b959-b37a-4a15-9517-50abe150a121 tempest-CreateVolumesFromSnapshotTest-309904984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:27 devstack sudo[111240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 06:03:27 devstack sudo[111240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:27 devstack cinder-volume[92083]: DEBUG oslo_service.periodic_task [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92083) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 06:03:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:03:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:03:27 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 06:03:27 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 06:03:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:03:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:27 devstack sudo[111242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 06:03:27 devstack sudo[111242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:28 devstack sudo[111231]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_58087b50-c893-4592-914f-cd037b88b0f6_wibt5ixhdevstack@QuobyteHD" returned: 1 in 1.693s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_58087b50-c893-4592-914f-cd037b88b0f6_wibt5ixhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 06:03:28 devstack cinder-volume[92083]: DEBUG cinder.image.image_utils [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] 58087b50-c893-4592-914f-cd037b88b0f6 was raw, converting to raw {{(pid=92083) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 17 06:03:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_58087b50-c893-4592-914f-cd037b88b0f6_wibt5ixhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-169f084b-6714-44b4-ad9d-5069f48bcb45 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:28 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-5ab324d3-30d4-4e8f-be32-95a77a2afdbe tempest-CreateVolumesFromSnapshotTest-309904984 None] Acquiring lock "cinder-c9d96988-40df-4503-abd5-81b2bcaedf76-delete_snapshot" by "delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:03:28 devstack sudo[111248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_58087b50-c893-4592-914f-cd037b88b0f6_wibt5ixhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-169f084b-6714-44b4-ad9d-5069f48bcb45 Jun 17 06:03:28 devstack sudo[111248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:28 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-5ab324d3-30d4-4e8f-be32-95a77a2afdbe tempest-CreateVolumesFromSnapshotTest-309904984 None] Lock "cinder-c9d96988-40df-4503-abd5-81b2bcaedf76-delete_snapshot" acquired by "delete_snapshot" :: waited 0.083s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:03:28 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-5ab324d3-30d4-4e8f-be32-95a77a2afdbe tempest-CreateVolumesFromSnapshotTest-309904984 None] Acquiring lock "cinder-quobyte-be813a23-b798-4f1d-9217-614239ea1735" by "delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:03:28 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-5ab324d3-30d4-4e8f-be32-95a77a2afdbe tempest-CreateVolumesFromSnapshotTest-309904984 None] Lock "cinder-quobyte-be813a23-b798-4f1d-9217-614239ea1735" acquired by "delete_snapshot" :: waited 0.051s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:03:28 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-5ab324d3-30d4-4e8f-be32-95a77a2afdbe tempest-CreateVolumesFromSnapshotTest-309904984 None] Acquiring lock "cinder-quobyte-c9d96988-40df-4503-abd5-81b2bcaedf76" by "_delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:03:28 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-5ab324d3-30d4-4e8f-be32-95a77a2afdbe tempest-CreateVolumesFromSnapshotTest-309904984 None] Lock "cinder-quobyte-c9d96988-40df-4503-abd5-81b2bcaedf76" acquired by "_delete_snapshot" :: waited 0.059s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:03:28 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-5ab324d3-30d4-4e8f-be32-95a77a2afdbe tempest-CreateVolumesFromSnapshotTest-309904984 None] Deleting offline snapshot c9d96988-40df-4503-abd5-81b2bcaedf76 of volume be813a23-b798-4f1d-9217-614239ea1735 {{(pid=92083) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 17 06:03:28 devstack sudo[111242]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:28 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-5ab324d3-30d4-4e8f-be32-95a77a2afdbe tempest-CreateVolumesFromSnapshotTest-309904984 None] snapshot_file for this snap is: volume-be813a23-b798-4f1d-9217-614239ea1735.c9d96988-40df-4503-abd5-81b2bcaedf76 {{(pid=92083) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 17 06:03:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 1.143s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:28 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 06:03:28 devstack cinder-volume[92083]: DEBUG oslo_service.periodic_task [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running periodic task VolumeManager._thread_info {{(pid=92083) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 06:03:28 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] thread count: 28 {{(pid=92083) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 17 06:03:28 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] thread info: [<_MainThread(MainThread, started 133483869905024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92083) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 17 06:03:28 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[22be4e5d-9231-4a65-b297-2cf5e57c053f]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 06:03:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-5ab324d3-30d4-4e8f-be32-95a77a2afdbe tempest-CreateVolumesFromSnapshotTest-309904984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-be813a23-b798-4f1d-9217-614239ea1735.c9d96988-40df-4503-abd5-81b2bcaedf76 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:29 devstack sudo[111252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-be813a23-b798-4f1d-9217-614239ea1735.c9d96988-40df-4503-abd5-81b2bcaedf76 Jun 17 06:03:29 devstack sudo[111252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:29 devstack sudo[111240]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:29 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-58a0b959-b37a-4a15-9517-50abe150a121 tempest-CreateVolumesFromSnapshotTest-309904984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 2.035s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:29 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-58a0b959-b37a-4a15-9517-50abe150a121 tempest-CreateVolumesFromSnapshotTest-309904984 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 06:03:29 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-58a0b959-b37a-4a15-9517-50abe150a121 tempest-CreateVolumesFromSnapshotTest-309904984 None] Deleted volume successfully. Jun 17 06:03:29 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-58a0b959-b37a-4a15-9517-50abe150a121 tempest-CreateVolumesFromSnapshotTest-309904984 None] Lock "cinder-838fd2f6-b734-49dd-a60e-06de131c5d54-delete_volume" released by "delete_volume" :: held 4.640s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:03:30 devstack sudo[111252]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:30 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-5ab324d3-30d4-4e8f-be32-95a77a2afdbe tempest-CreateVolumesFromSnapshotTest-309904984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-be813a23-b798-4f1d-9217-614239ea1735.c9d96988-40df-4503-abd5-81b2bcaedf76" returned: 0 in 1.622s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:30 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-5ab324d3-30d4-4e8f-be32-95a77a2afdbe tempest-CreateVolumesFromSnapshotTest-309904984 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be813a23-b798-4f1d-9217-614239ea1735(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92083) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 06:03:30 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[45960cc0-79bf-4eca-8b36-e502a37cf22a]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 06:03:30 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-5ab324d3-30d4-4e8f-be32-95a77a2afdbe tempest-CreateVolumesFromSnapshotTest-309904984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-be813a23-b798-4f1d-9217-614239ea1735 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:30 devstack sudo[111248]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:30 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_58087b50-c893-4592-914f-cd037b88b0f6_wibt5ixhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-169f084b-6714-44b4-ad9d-5069f48bcb45" returned: 0 in 2.230s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:30 devstack cinder-volume[92083]: DEBUG cinder.image.image_utils [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_58087b50-c893-4592-914f-cd037b88b0f6_wibt5ixhdevstack@QuobyteHD, size 0.00 MB, duration 2.24 sec, destination /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-169f084b-6714-44b4-ad9d-5069f48bcb45 {{(pid=92083) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 17 06:03:30 devstack cinder-volume[92083]: INFO cinder.image.image_utils [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] Converted 0.00 MB image at 0.00 MB/s Jun 17 06:03:30 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-169f084b-6714-44b4-ad9d-5069f48bcb45 1G {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:30 devstack sudo[111262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-169f084b-6714-44b4-ad9d-5069f48bcb45 1G Jun 17 06:03:30 devstack sudo[111262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:30 devstack sudo[111261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-be813a23-b798-4f1d-9217-614239ea1735 Jun 17 06:03:30 devstack sudo[111261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:32 devstack sudo[111262]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:32 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-169f084b-6714-44b4-ad9d-5069f48bcb45 1G" returned: 0 in 1.734s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:32 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97ba423-392f-4c9f-a651-cf49f89863a0]: (4, 'raw') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 06:03:32 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-169f084b-6714-44b4-ad9d-5069f48bcb45 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:32 devstack sudo[111270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-169f084b-6714-44b4-ad9d-5069f48bcb45 Jun 17 06:03:32 devstack sudo[111270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:32 devstack sudo[111216]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:32 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f25653fe-8d4a-479f-a353-d99cd1980d20 tempest-VolumeDependencyTests-1046372343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b06a460e-45f4-4bde-af43-3638d5cd2511 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-135d30a5-df59-4e44-b0e5-8f4f15c2722b" returned: 0 in 7.268s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:32 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb21c30-2ebd-4847-a638-adbd8dccf399]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 06:03:32 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f25653fe-8d4a-479f-a353-d99cd1980d20 tempest-VolumeDependencyTests-1046372343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b06a460e-45f4-4bde-af43-3638d5cd2511 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:33 devstack sudo[111261]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:33 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-5ab324d3-30d4-4e8f-be32-95a77a2afdbe tempest-CreateVolumesFromSnapshotTest-309904984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-be813a23-b798-4f1d-9217-614239ea1735" returned: 0 in 2.551s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:33 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-5ab324d3-30d4-4e8f-be32-95a77a2afdbe tempest-CreateVolumesFromSnapshotTest-309904984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-be813a23-b798-4f1d-9217-614239ea1735.c9d96988-40df-4503-abd5-81b2bcaedf76 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:33 devstack sudo[111277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-be813a23-b798-4f1d-9217-614239ea1735.c9d96988-40df-4503-abd5-81b2bcaedf76 Jun 17 06:03:33 devstack sudo[111277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:33 devstack sudo[111276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b06a460e-45f4-4bde-af43-3638d5cd2511 Jun 17 06:03:33 devstack sudo[111276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:33 devstack sudo[111270]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:33 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-169f084b-6714-44b4-ad9d-5069f48bcb45" returned: 0 in 1.098s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:33 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-169f084b-6714-44b4-ad9d-5069f48bcb45 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:33 devstack sudo[111282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-169f084b-6714-44b4-ad9d-5069f48bcb45 Jun 17 06:03:33 devstack sudo[111282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:34 devstack sudo[111277]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:34 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-5ab324d3-30d4-4e8f-be32-95a77a2afdbe tempest-CreateVolumesFromSnapshotTest-309904984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-be813a23-b798-4f1d-9217-614239ea1735.c9d96988-40df-4503-abd5-81b2bcaedf76" returned: 0 in 0.921s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:34 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-5ab324d3-30d4-4e8f-be32-95a77a2afdbe tempest-CreateVolumesFromSnapshotTest-309904984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-be813a23-b798-4f1d-9217-614239ea1735.c9d96988-40df-4503-abd5-81b2bcaedf76 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:34 devstack sudo[111291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-be813a23-b798-4f1d-9217-614239ea1735.c9d96988-40df-4503-abd5-81b2bcaedf76 Jun 17 06:03:34 devstack sudo[111291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:34 devstack sudo[111276]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:34 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f25653fe-8d4a-479f-a353-d99cd1980d20 tempest-VolumeDependencyTests-1046372343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b06a460e-45f4-4bde-af43-3638d5cd2511" returned: 0 in 1.193s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:34 devstack cinder-volume[92083]: DEBUG cinder.image.image_utils [None req-f25653fe-8d4a-479f-a353-d99cd1980d20 tempest-VolumeDependencyTests-1046372343 None] Image conversion details: src /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b06a460e-45f4-4bde-af43-3638d5cd2511, size 1024.00 MB, duration 7.27 sec, destination /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-135d30a5-df59-4e44-b0e5-8f4f15c2722b {{(pid=92083) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 17 06:03:34 devstack cinder-volume[92083]: INFO cinder.image.image_utils [None req-f25653fe-8d4a-479f-a353-d99cd1980d20 tempest-VolumeDependencyTests-1046372343 None] Converted 1024.00 MB image at 140.84 MB/s Jun 17 06:03:34 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [None req-f25653fe-8d4a-479f-a353-d99cd1980d20 tempest-VolumeDependencyTests-1046372343 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-135d30a5-df59-4e44-b0e5-8f4f15c2722b is being set with open permissions: ugo+rw Jun 17 06:03:34 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f25653fe-8d4a-479f-a353-d99cd1980d20 tempest-VolumeDependencyTests-1046372343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-135d30a5-df59-4e44-b0e5-8f4f15c2722b {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:34 devstack sudo[111293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-135d30a5-df59-4e44-b0e5-8f4f15c2722b Jun 17 06:03:34 devstack sudo[111293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:34 devstack sudo[111282]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:34 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-169f084b-6714-44b4-ad9d-5069f48bcb45" returned: 1 in 0.860s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:34 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-169f084b-6714-44b4-ad9d-5069f48bcb45' failed. Not Retrying. {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 06:03:34 devstack cinder-volume[92083]: DEBUG cinder.volume.volume_utils [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] Downloaded image 58087b50-c893-4592-914f-cd037b88b0f6 ((None, [{'url': 'file:///opt/stack/data/glance/images/58087b50-c893-4592-914f-cd037b88b0f6', 'metadata': {}}])) to volume 169f084b-6714-44b4-ad9d-5069f48bcb45 successfully. {{(pid=92083) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 17 06:03:34 devstack cinder-volume[92083]: DEBUG cinder.image.image_utils [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] Temporary image 58087b50-c893-4592-914f-cd037b88b0f6 for user a9ae8aafbb5b45f7aff3a842e184d08d is deleted. {{(pid=92083) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 17 06:03:34 devstack cinder-volume[92083]: DEBUG cinder.volume.volume_utils [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] Marking volume 169f084b-6714-44b4-ad9d-5069f48bcb45 as bootable. {{(pid=92083) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 17 06:03:34 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] Copying metadata from image 58087b50-c893-4592-914f-cd037b88b0f6 to 169f084b-6714-44b4-ad9d-5069f48bcb45. {{(pid=92083) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 17 06:03:34 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] Creating volume glance metadata for volume 169f084b-6714-44b4-ad9d-5069f48bcb45 backed by image 58087b50-c893-4592-914f-cd037b88b0f6 with: {'image_id': '58087b50-c893-4592-914f-cd037b88b0f6', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'e8f60edc7a82535bdc94430278b3df69', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=92083) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 17 06:03:34 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f04e83d-0eab-4e48-8dae-786b6bb157b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-169f084b-6714-44b4-ad9d-5069f48bcb45', 'volume_size': 1, 'image_id': '58087b50-c893-4592-914f-cd037b88b0f6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/58087b50-c893-4592-914f-cd037b88b0f6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e8f60edc7a82535bdc94430278b3df69', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '458b508dfd66482f9f58740899e3952d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b02f03ef8e3c7ba82c9f40bb1a93b611fb8b8f924777c7f17f545395e6f71e635b0ca568899cd72ce31339b8eb86746c379517fd3838015587b190c6ec4f122e', 'id': '58087b50-c893-4592-914f-cd037b88b0f6', 'created_at': datetime.datetime(2026, 6, 17, 4, 3, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 4, 3, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/58087b50-c893-4592-914f-cd037b88b0f6/file', 'properties': {}}, 'image_service': }' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:34 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cabb7fdf-2e54-4b5e-a517-1621359ec5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:34 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] Volume volume-169f084b-6714-44b4-ad9d-5069f48bcb45 (169f084b-6714-44b4-ad9d-5069f48bcb45): created successfully Jun 17 06:03:34 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cabb7fdf-2e54-4b5e-a517-1621359ec5de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:34 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] Flow 'volume_create_manager' (0a986c39-fb1e-4a19-8efd-16be69ebce0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 06:03:34 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-c1fab69a-8366-4bba-968d-076b15e93828 tempest-VolumeImageDependencyTests-1401919445 None] Created volume successfully. Jun 17 06:03:34 devstack sudo[111291]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:34 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-5ab324d3-30d4-4e8f-be32-95a77a2afdbe tempest-CreateVolumesFromSnapshotTest-309904984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-be813a23-b798-4f1d-9217-614239ea1735.c9d96988-40df-4503-abd5-81b2bcaedf76" returned: 0 in 0.782s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:34 devstack sudo[111293]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:34 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-5ab324d3-30d4-4e8f-be32-95a77a2afdbe tempest-CreateVolumesFromSnapshotTest-309904984 None] Lock "cinder-quobyte-c9d96988-40df-4503-abd5-81b2bcaedf76" released by "_delete_snapshot" :: held 6.182s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:03:34 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-f25653fe-8d4a-479f-a353-d99cd1980d20 tempest-VolumeDependencyTests-1046372343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-135d30a5-df59-4e44-b0e5-8f4f15c2722b" returned: 0 in 0.711s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:34 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-5ab324d3-30d4-4e8f-be32-95a77a2afdbe tempest-CreateVolumesFromSnapshotTest-309904984 None] Lock "cinder-quobyte-be813a23-b798-4f1d-9217-614239ea1735" released by "delete_snapshot" :: held 6.254s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:03:34 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-f25653fe-8d4a-479f-a353-d99cd1980d20 tempest-VolumeDependencyTests-1046372343 None] Lock "cinder-quobyte-135d30a5-df59-4e44-b0e5-8f4f15c2722b" released by "_copy_volume_from_snapshot" :: held 11.335s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:03:34 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-f25653fe-8d4a-479f-a353-d99cd1980d20 tempest-VolumeDependencyTests-1046372343 None] Lock "cinder-quobyte-55f3f77b-ea1e-4423-92c0-8d6dbd5ec778-135d30a5-df59-4e44-b0e5-8f4f15c2722b" released by "_create_volume_from_snapshot" :: held 11.401s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:03:34 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-f25653fe-8d4a-479f-a353-d99cd1980d20 tempest-VolumeDependencyTests-1046372343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.440s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:03:34 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-f25653fe-8d4a-479f-a353-d99cd1980d20 tempest-VolumeDependencyTests-1046372343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d298e9c0-99cd-4c5b-b516-ac38fd5d17db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-135d30a5-df59-4e44-b0e5-8f4f15c2722b', 'volume_size': 1, 'snapshot_id': '55f3f77b-ea1e-4423-92c0-8d6dbd5ec778'}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:34 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-f25653fe-8d4a-479f-a353-d99cd1980d20 tempest-VolumeDependencyTests-1046372343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (278d4682-ed42-4d1c-ad38-e6387aec24af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:34 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-f25653fe-8d4a-479f-a353-d99cd1980d20 tempest-VolumeDependencyTests-1046372343 None] Volume volume-135d30a5-df59-4e44-b0e5-8f4f15c2722b (135d30a5-df59-4e44-b0e5-8f4f15c2722b): created successfully Jun 17 06:03:35 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-f25653fe-8d4a-479f-a353-d99cd1980d20 tempest-VolumeDependencyTests-1046372343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (278d4682-ed42-4d1c-ad38-e6387aec24af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:35 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-f25653fe-8d4a-479f-a353-d99cd1980d20 tempest-VolumeDependencyTests-1046372343 None] Flow 'volume_create_manager' (738853de-2617-47ee-89f2-262d1faf3dd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 06:03:35 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-5ab324d3-30d4-4e8f-be32-95a77a2afdbe tempest-CreateVolumesFromSnapshotTest-309904984 None] Created reservations ['7c1c133f-3399-41ca-8807-640251681c47', '8eb2f871-5594-4baa-a8e6-0ba2861733b3', 'd023b52b-aead-4c35-8af7-9c4daa02416d', '086c8ba8-bb0a-4eaf-b93b-b4ee3993a19f'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 06:03:35 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-f25653fe-8d4a-479f-a353-d99cd1980d20 tempest-VolumeDependencyTests-1046372343 None] Created volume successfully. Jun 17 06:03:35 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-5ab324d3-30d4-4e8f-be32-95a77a2afdbe tempest-CreateVolumesFromSnapshotTest-309904984 None] Delete snapshot completed successfully. Jun 17 06:03:35 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-5ab324d3-30d4-4e8f-be32-95a77a2afdbe tempest-CreateVolumesFromSnapshotTest-309904984 None] Lock "cinder-c9d96988-40df-4503-abd5-81b2bcaedf76-delete_snapshot" released by "delete_snapshot" :: held 6.610s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:03:35 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-cedb6f0b-be7b-4d79-95fb-419475f39707 tempest-VolumeImageDependencyTests-1401919445 None] Acquiring lock "cinder-169f084b-6714-44b4-ad9d-5069f48bcb45-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:03:35 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-cedb6f0b-be7b-4d79-95fb-419475f39707 tempest-VolumeImageDependencyTests-1401919445 None] Lock "cinder-169f084b-6714-44b4-ad9d-5069f48bcb45-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:03:35 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-cedb6f0b-be7b-4d79-95fb-419475f39707 tempest-VolumeImageDependencyTests-1401919445 None] Acquiring lock "cinder-quobyte-169f084b-6714-44b4-ad9d-5069f48bcb45" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:03:35 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-cedb6f0b-be7b-4d79-95fb-419475f39707 tempest-VolumeImageDependencyTests-1401919445 None] Lock "cinder-quobyte-169f084b-6714-44b4-ad9d-5069f48bcb45" acquired by "delete_volume" :: waited 0.017s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:03:35 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d191368-8b9c-4389-bc8a-38bb627abf6d]: (4, 'raw') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 06:03:35 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-cedb6f0b-be7b-4d79-95fb-419475f39707 tempest-VolumeImageDependencyTests-1401919445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-169f084b-6714-44b4-ad9d-5069f48bcb45 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:35 devstack sudo[111336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-169f084b-6714-44b4-ad9d-5069f48bcb45 Jun 17 06:03:35 devstack sudo[111336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:36 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-7e8f0054-247f-4a43-9e4e-9cd9a1e509d9 tempest-CreateVolumesFromSnapshotTest-309904984 None] Acquiring lock "cinder-be813a23-b798-4f1d-9217-614239ea1735-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:03:36 devstack sudo[111336]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:36 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-cedb6f0b-be7b-4d79-95fb-419475f39707 tempest-VolumeImageDependencyTests-1401919445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-169f084b-6714-44b4-ad9d-5069f48bcb45" returned: 0 in 0.722s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:36 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-cedb6f0b-be7b-4d79-95fb-419475f39707 tempest-VolumeImageDependencyTests-1401919445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-169f084b-6714-44b4-ad9d-5069f48bcb45 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:36 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-40bfadc5-f33b-4e43-a52f-1add3ac36c21 tempest-VolumeDependencyTests-1046372343 None] Acquiring lock "cinder-55f3f77b-ea1e-4423-92c0-8d6dbd5ec778-delete_snapshot" by "delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:03:36 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-7e8f0054-247f-4a43-9e4e-9cd9a1e509d9 tempest-CreateVolumesFromSnapshotTest-309904984 None] Lock "cinder-be813a23-b798-4f1d-9217-614239ea1735-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:03:36 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-40bfadc5-f33b-4e43-a52f-1add3ac36c21 tempest-VolumeDependencyTests-1046372343 None] Lock "cinder-55f3f77b-ea1e-4423-92c0-8d6dbd5ec778-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:03:36 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-40bfadc5-f33b-4e43-a52f-1add3ac36c21 tempest-VolumeDependencyTests-1046372343 None] Acquiring lock "cinder-quobyte-b06a460e-45f4-4bde-af43-3638d5cd2511" by "delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:03:36 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-40bfadc5-f33b-4e43-a52f-1add3ac36c21 tempest-VolumeDependencyTests-1046372343 None] Lock "cinder-quobyte-b06a460e-45f4-4bde-af43-3638d5cd2511" acquired by "delete_snapshot" :: waited 0.030s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:03:36 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-40bfadc5-f33b-4e43-a52f-1add3ac36c21 tempest-VolumeDependencyTests-1046372343 None] Acquiring lock "cinder-quobyte-55f3f77b-ea1e-4423-92c0-8d6dbd5ec778" by "_delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:03:36 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-40bfadc5-f33b-4e43-a52f-1add3ac36c21 tempest-VolumeDependencyTests-1046372343 None] Lock "cinder-quobyte-55f3f77b-ea1e-4423-92c0-8d6dbd5ec778" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:03:36 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-40bfadc5-f33b-4e43-a52f-1add3ac36c21 tempest-VolumeDependencyTests-1046372343 None] Deleting offline snapshot 55f3f77b-ea1e-4423-92c0-8d6dbd5ec778 of volume b06a460e-45f4-4bde-af43-3638d5cd2511 {{(pid=92083) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 17 06:03:36 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-40bfadc5-f33b-4e43-a52f-1add3ac36c21 tempest-VolumeDependencyTests-1046372343 None] snapshot_file for this snap is: volume-b06a460e-45f4-4bde-af43-3638d5cd2511.55f3f77b-ea1e-4423-92c0-8d6dbd5ec778 {{(pid=92083) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 17 06:03:36 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-7e8f0054-247f-4a43-9e4e-9cd9a1e509d9 tempest-CreateVolumesFromSnapshotTest-309904984 None] Acquiring lock "cinder-quobyte-be813a23-b798-4f1d-9217-614239ea1735" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:03:36 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9da4b7-f958-4de5-a758-fe0ac67a3b23]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 06:03:36 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-40bfadc5-f33b-4e43-a52f-1add3ac36c21 tempest-VolumeDependencyTests-1046372343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b06a460e-45f4-4bde-af43-3638d5cd2511.55f3f77b-ea1e-4423-92c0-8d6dbd5ec778 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:36 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-7e8f0054-247f-4a43-9e4e-9cd9a1e509d9 tempest-CreateVolumesFromSnapshotTest-309904984 None] Lock "cinder-quobyte-be813a23-b798-4f1d-9217-614239ea1735" acquired by "delete_volume" :: waited 0.032s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:03:36 devstack sudo[111340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-169f084b-6714-44b4-ad9d-5069f48bcb45 Jun 17 06:03:36 devstack sudo[111340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:36 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[415d8e07-1df3-46d5-be46-b2a337ba269e]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 06:03:36 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-7e8f0054-247f-4a43-9e4e-9cd9a1e509d9 tempest-CreateVolumesFromSnapshotTest-309904984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-be813a23-b798-4f1d-9217-614239ea1735 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:36 devstack sudo[111341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b06a460e-45f4-4bde-af43-3638d5cd2511.55f3f77b-ea1e-4423-92c0-8d6dbd5ec778 Jun 17 06:03:36 devstack sudo[111341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:36 devstack sudo[111343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-be813a23-b798-4f1d-9217-614239ea1735 Jun 17 06:03:36 devstack sudo[111343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:37 devstack sudo[111340]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:37 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-cedb6f0b-be7b-4d79-95fb-419475f39707 tempest-VolumeImageDependencyTests-1401919445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-169f084b-6714-44b4-ad9d-5069f48bcb45" returned: 1 in 0.874s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:37 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-cedb6f0b-be7b-4d79-95fb-419475f39707 tempest-VolumeImageDependencyTests-1401919445 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-169f084b-6714-44b4-ad9d-5069f48bcb45' failed. Not Retrying. {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 06:03:37 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-cedb6f0b-be7b-4d79-95fb-419475f39707 tempest-VolumeImageDependencyTests-1401919445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-169f084b-6714-44b4-ad9d-5069f48bcb45 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:37 devstack sudo[111352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-169f084b-6714-44b4-ad9d-5069f48bcb45 Jun 17 06:03:37 devstack sudo[111352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:37 devstack sudo[111341]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:37 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-40bfadc5-f33b-4e43-a52f-1add3ac36c21 tempest-VolumeDependencyTests-1046372343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b06a460e-45f4-4bde-af43-3638d5cd2511.55f3f77b-ea1e-4423-92c0-8d6dbd5ec778" returned: 0 in 0.853s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:37 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-40bfadc5-f33b-4e43-a52f-1add3ac36c21 tempest-VolumeDependencyTests-1046372343 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b06a460e-45f4-4bde-af43-3638d5cd2511(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92083) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 06:03:37 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ddc609-5502-4ca2-84d2-07d674efee25]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 06:03:37 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-40bfadc5-f33b-4e43-a52f-1add3ac36c21 tempest-VolumeDependencyTests-1046372343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b06a460e-45f4-4bde-af43-3638d5cd2511 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:37 devstack sudo[111343]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:37 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-7e8f0054-247f-4a43-9e4e-9cd9a1e509d9 tempest-CreateVolumesFromSnapshotTest-309904984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-be813a23-b798-4f1d-9217-614239ea1735" returned: 0 in 0.878s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:37 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-7e8f0054-247f-4a43-9e4e-9cd9a1e509d9 tempest-CreateVolumesFromSnapshotTest-309904984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-be813a23-b798-4f1d-9217-614239ea1735 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:37 devstack sudo[111358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-be813a23-b798-4f1d-9217-614239ea1735 Jun 17 06:03:37 devstack sudo[111358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:37 devstack sudo[111357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b06a460e-45f4-4bde-af43-3638d5cd2511 Jun 17 06:03:37 devstack sudo[111357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:37 devstack sudo[111352]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:37 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-cedb6f0b-be7b-4d79-95fb-419475f39707 tempest-VolumeImageDependencyTests-1401919445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-169f084b-6714-44b4-ad9d-5069f48bcb45" returned: 0 in 0.730s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:37 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-cedb6f0b-be7b-4d79-95fb-419475f39707 tempest-VolumeImageDependencyTests-1401919445 None] Lock "cinder-quobyte-169f084b-6714-44b4-ad9d-5069f48bcb45" released by "delete_volume" :: held 2.393s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:03:37 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-cedb6f0b-be7b-4d79-95fb-419475f39707 tempest-VolumeImageDependencyTests-1401919445 None] Created reservations ['a67624a2-de32-44a9-a5f9-a80eb2b3a067', 'd71f9b58-f25b-487b-b75e-2f5f59c68558', 'f35895b4-7ef5-4c22-8e35-d492b6c7c2f2', '993cbead-7809-4d56-8f55-951725331aba'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 06:03:37 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-cedb6f0b-be7b-4d79-95fb-419475f39707 tempest-VolumeImageDependencyTests-1401919445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:03:37 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-cedb6f0b-be7b-4d79-95fb-419475f39707 tempest-VolumeImageDependencyTests-1401919445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:03:37 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-cedb6f0b-be7b-4d79-95fb-419475f39707 tempest-VolumeImageDependencyTests-1401919445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 06:03:37 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-cedb6f0b-be7b-4d79-95fb-419475f39707 tempest-VolumeImageDependencyTests-1401919445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 06:03:37 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-cedb6f0b-be7b-4d79-95fb-419475f39707 tempest-VolumeImageDependencyTests-1401919445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:03:37 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-cedb6f0b-be7b-4d79-95fb-419475f39707 tempest-VolumeImageDependencyTests-1401919445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:37 devstack sudo[111363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 06:03:37 devstack sudo[111363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:37 devstack sudo[111358]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:37 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-7e8f0054-247f-4a43-9e4e-9cd9a1e509d9 tempest-CreateVolumesFromSnapshotTest-309904984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-be813a23-b798-4f1d-9217-614239ea1735" returned: 0 in 0.727s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:38 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-7e8f0054-247f-4a43-9e4e-9cd9a1e509d9 tempest-CreateVolumesFromSnapshotTest-309904984 None] Lock "cinder-quobyte-be813a23-b798-4f1d-9217-614239ea1735" released by "delete_volume" :: held 1.686s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:03:38 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-7e8f0054-247f-4a43-9e4e-9cd9a1e509d9 tempest-CreateVolumesFromSnapshotTest-309904984 None] Created reservations ['3730780a-559f-46a4-87a2-9da4d3e52f1a', '923a079b-9f2e-4734-baee-e7cf50725752', '6512805d-7a89-41c7-9173-c89698870e1b', 'e85d1317-3c30-413c-ab1c-3629eb3cc250'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 06:03:38 devstack sudo[111357]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:38 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-40bfadc5-f33b-4e43-a52f-1add3ac36c21 tempest-VolumeDependencyTests-1046372343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b06a460e-45f4-4bde-af43-3638d5cd2511" returned: 0 in 0.919s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:38 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-40bfadc5-f33b-4e43-a52f-1add3ac36c21 tempest-VolumeDependencyTests-1046372343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b06a460e-45f4-4bde-af43-3638d5cd2511.55f3f77b-ea1e-4423-92c0-8d6dbd5ec778 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:38 devstack sudo[111368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b06a460e-45f4-4bde-af43-3638d5cd2511.55f3f77b-ea1e-4423-92c0-8d6dbd5ec778 Jun 17 06:03:38 devstack sudo[111368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:38 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-7e8f0054-247f-4a43-9e4e-9cd9a1e509d9 tempest-CreateVolumesFromSnapshotTest-309904984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:03:38 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-7e8f0054-247f-4a43-9e4e-9cd9a1e509d9 tempest-CreateVolumesFromSnapshotTest-309904984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:03:38 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-7e8f0054-247f-4a43-9e4e-9cd9a1e509d9 tempest-CreateVolumesFromSnapshotTest-309904984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 06:03:38 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-7e8f0054-247f-4a43-9e4e-9cd9a1e509d9 tempest-CreateVolumesFromSnapshotTest-309904984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 06:03:38 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-7e8f0054-247f-4a43-9e4e-9cd9a1e509d9 tempest-CreateVolumesFromSnapshotTest-309904984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:03:38 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-7e8f0054-247f-4a43-9e4e-9cd9a1e509d9 tempest-CreateVolumesFromSnapshotTest-309904984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:38 devstack sudo[111370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 06:03:38 devstack sudo[111370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:38 devstack sudo[111363]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:38 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-cedb6f0b-be7b-4d79-95fb-419475f39707 tempest-VolumeImageDependencyTests-1401919445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.782s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:38 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-cedb6f0b-be7b-4d79-95fb-419475f39707 tempest-VolumeImageDependencyTests-1401919445 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 06:03:38 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-cedb6f0b-be7b-4d79-95fb-419475f39707 tempest-VolumeImageDependencyTests-1401919445 None] Deleted volume successfully. Jun 17 06:03:38 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-cedb6f0b-be7b-4d79-95fb-419475f39707 tempest-VolumeImageDependencyTests-1401919445 None] Lock "cinder-169f084b-6714-44b4-ad9d-5069f48bcb45-delete_volume" released by "delete_volume" :: held 3.415s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:03:39 devstack sudo[111370]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-7e8f0054-247f-4a43-9e4e-9cd9a1e509d9 tempest-CreateVolumesFromSnapshotTest-309904984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.897s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:39 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-7e8f0054-247f-4a43-9e4e-9cd9a1e509d9 tempest-CreateVolumesFromSnapshotTest-309904984 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 06:03:39 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-7e8f0054-247f-4a43-9e4e-9cd9a1e509d9 tempest-CreateVolumesFromSnapshotTest-309904984 None] Deleted volume successfully. Jun 17 06:03:39 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-7e8f0054-247f-4a43-9e4e-9cd9a1e509d9 tempest-CreateVolumesFromSnapshotTest-309904984 None] Lock "cinder-be813a23-b798-4f1d-9217-614239ea1735-delete_volume" released by "delete_volume" :: held 3.011s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:03:39 devstack sudo[111368]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-40bfadc5-f33b-4e43-a52f-1add3ac36c21 tempest-VolumeDependencyTests-1046372343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b06a460e-45f4-4bde-af43-3638d5cd2511.55f3f77b-ea1e-4423-92c0-8d6dbd5ec778" returned: 0 in 1.086s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-40bfadc5-f33b-4e43-a52f-1add3ac36c21 tempest-VolumeDependencyTests-1046372343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b06a460e-45f4-4bde-af43-3638d5cd2511.55f3f77b-ea1e-4423-92c0-8d6dbd5ec778 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:39 devstack sudo[111379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b06a460e-45f4-4bde-af43-3638d5cd2511.55f3f77b-ea1e-4423-92c0-8d6dbd5ec778 Jun 17 06:03:39 devstack sudo[111379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:39 devstack sudo[111379]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:39 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-40bfadc5-f33b-4e43-a52f-1add3ac36c21 tempest-VolumeDependencyTests-1046372343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b06a460e-45f4-4bde-af43-3638d5cd2511.55f3f77b-ea1e-4423-92c0-8d6dbd5ec778" returned: 0 in 0.697s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:39 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-40bfadc5-f33b-4e43-a52f-1add3ac36c21 tempest-VolumeDependencyTests-1046372343 None] Lock "cinder-quobyte-55f3f77b-ea1e-4423-92c0-8d6dbd5ec778" released by "_delete_snapshot" :: held 3.696s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:03:39 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-40bfadc5-f33b-4e43-a52f-1add3ac36c21 tempest-VolumeDependencyTests-1046372343 None] Lock "cinder-quobyte-b06a460e-45f4-4bde-af43-3638d5cd2511" released by "delete_snapshot" :: held 3.736s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:03:39 devstack cinder-volume[92083]: DEBUG dbcounter [-] [92083] Writing DB stats cinder:UPDATE=200,cinder:SELECT=145,cinder:DELETE=20,cinder:INSERT=57 {{(pid=92083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 06:03:40 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-40bfadc5-f33b-4e43-a52f-1add3ac36c21 tempest-VolumeDependencyTests-1046372343 None] Created reservations ['31162163-e4c1-497d-aefd-1b5bdc988aa0', '46041889-8a85-4324-a87d-df42d2f40f1a', '641f8155-5920-4ef4-bffd-6dde2be74f35', '7be684cf-e9e5-4b72-8588-7540fd37ba5a'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 06:03:40 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-40bfadc5-f33b-4e43-a52f-1add3ac36c21 tempest-VolumeDependencyTests-1046372343 None] Delete snapshot completed successfully. Jun 17 06:03:40 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-40bfadc5-f33b-4e43-a52f-1add3ac36c21 tempest-VolumeDependencyTests-1046372343 None] Lock "cinder-55f3f77b-ea1e-4423-92c0-8d6dbd5ec778-delete_snapshot" released by "delete_snapshot" :: held 3.896s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:03:40 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-fbabb244-292c-4148-b9d6-706810125879 tempest-VolumeDependencyTests-1046372343 None] Acquiring lock "cinder-b06a460e-45f4-4bde-af43-3638d5cd2511-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:03:40 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-fbabb244-292c-4148-b9d6-706810125879 tempest-VolumeDependencyTests-1046372343 None] Lock "cinder-b06a460e-45f4-4bde-af43-3638d5cd2511-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:03:40 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-fbabb244-292c-4148-b9d6-706810125879 tempest-VolumeDependencyTests-1046372343 None] Acquiring lock "cinder-quobyte-b06a460e-45f4-4bde-af43-3638d5cd2511" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:03:40 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-fbabb244-292c-4148-b9d6-706810125879 tempest-VolumeDependencyTests-1046372343 None] Lock "cinder-quobyte-b06a460e-45f4-4bde-af43-3638d5cd2511" acquired by "delete_volume" :: waited 0.023s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:03:40 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a19c1a3-3638-4527-aee6-68a31be0bf67]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 06:03:40 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-fbabb244-292c-4148-b9d6-706810125879 tempest-VolumeDependencyTests-1046372343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b06a460e-45f4-4bde-af43-3638d5cd2511 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:40 devstack sudo[111383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b06a460e-45f4-4bde-af43-3638d5cd2511 Jun 17 06:03:40 devstack sudo[111383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:41 devstack sudo[111383]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:41 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-fbabb244-292c-4148-b9d6-706810125879 tempest-VolumeDependencyTests-1046372343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b06a460e-45f4-4bde-af43-3638d5cd2511" returned: 0 in 0.845s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:41 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-fbabb244-292c-4148-b9d6-706810125879 tempest-VolumeDependencyTests-1046372343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b06a460e-45f4-4bde-af43-3638d5cd2511 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:41 devstack sudo[111388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b06a460e-45f4-4bde-af43-3638d5cd2511 Jun 17 06:03:41 devstack sudo[111388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:42 devstack sudo[111388]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-fbabb244-292c-4148-b9d6-706810125879 tempest-VolumeDependencyTests-1046372343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-b06a460e-45f4-4bde-af43-3638d5cd2511" returned: 0 in 0.788s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:42 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-fbabb244-292c-4148-b9d6-706810125879 tempest-VolumeDependencyTests-1046372343 None] Lock "cinder-quobyte-b06a460e-45f4-4bde-af43-3638d5cd2511" released by "delete_volume" :: held 1.715s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:03:42 devstack cinder-volume[92083]: DEBUG dbcounter [-] [92083] Writing DB stats cinder:SELECT=150,cinder:UPDATE=186,cinder:INSERT=53,cinder:DELETE=15 {{(pid=92083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 06:03:42 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-fbabb244-292c-4148-b9d6-706810125879 tempest-VolumeDependencyTests-1046372343 None] Created reservations ['c66fd684-b380-401d-b798-338913e8e3be', 'bb0bf98e-c78f-478c-a402-2d8973b39b60', '813f6630-adf2-4d44-823d-a7e402a71055', '4fcdfc46-51a1-45d3-8f11-af7279eb5bfe'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 06:03:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-fbabb244-292c-4148-b9d6-706810125879 tempest-VolumeDependencyTests-1046372343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:03:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-fbabb244-292c-4148-b9d6-706810125879 tempest-VolumeDependencyTests-1046372343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:03:42 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-fbabb244-292c-4148-b9d6-706810125879 tempest-VolumeDependencyTests-1046372343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 06:03:42 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-fbabb244-292c-4148-b9d6-706810125879 tempest-VolumeDependencyTests-1046372343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 06:03:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-fbabb244-292c-4148-b9d6-706810125879 tempest-VolumeDependencyTests-1046372343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:03:42 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-fbabb244-292c-4148-b9d6-706810125879 tempest-VolumeDependencyTests-1046372343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:42 devstack sudo[111391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 06:03:42 devstack sudo[111391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:42 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-1e403f54-5403-43ce-9f3e-9ec05c304d57 tempest-VolumeDependencyTests-1046372343 None] Acquiring lock "cinder-135d30a5-df59-4e44-b0e5-8f4f15c2722b-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:03:42 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-1e403f54-5403-43ce-9f3e-9ec05c304d57 tempest-VolumeDependencyTests-1046372343 None] Lock "cinder-135d30a5-df59-4e44-b0e5-8f4f15c2722b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:03:42 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-1e403f54-5403-43ce-9f3e-9ec05c304d57 tempest-VolumeDependencyTests-1046372343 None] Acquiring lock "cinder-quobyte-135d30a5-df59-4e44-b0e5-8f4f15c2722b" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:03:42 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-1e403f54-5403-43ce-9f3e-9ec05c304d57 tempest-VolumeDependencyTests-1046372343 None] Lock "cinder-quobyte-135d30a5-df59-4e44-b0e5-8f4f15c2722b" acquired by "delete_volume" :: waited 0.032s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:03:43 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e681fdb-a40a-4473-bbcb-7daca0daa2b0]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 06:03:43 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1e403f54-5403-43ce-9f3e-9ec05c304d57 tempest-VolumeDependencyTests-1046372343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-135d30a5-df59-4e44-b0e5-8f4f15c2722b {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:43 devstack sudo[111393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-135d30a5-df59-4e44-b0e5-8f4f15c2722b Jun 17 06:03:43 devstack sudo[111393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:43 devstack sudo[111391]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:43 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-fbabb244-292c-4148-b9d6-706810125879 tempest-VolumeDependencyTests-1046372343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.967s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:43 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-fbabb244-292c-4148-b9d6-706810125879 tempest-VolumeDependencyTests-1046372343 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 06:03:43 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-fbabb244-292c-4148-b9d6-706810125879 tempest-VolumeDependencyTests-1046372343 None] Deleted volume successfully. Jun 17 06:03:43 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-fbabb244-292c-4148-b9d6-706810125879 tempest-VolumeDependencyTests-1046372343 None] Lock "cinder-b06a460e-45f4-4bde-af43-3638d5cd2511-delete_volume" released by "delete_volume" :: held 3.003s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:03:44 devstack sudo[111393]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:44 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1e403f54-5403-43ce-9f3e-9ec05c304d57 tempest-VolumeDependencyTests-1046372343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-135d30a5-df59-4e44-b0e5-8f4f15c2722b" returned: 0 in 1.076s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:44 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1e403f54-5403-43ce-9f3e-9ec05c304d57 tempest-VolumeDependencyTests-1046372343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-135d30a5-df59-4e44-b0e5-8f4f15c2722b {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:44 devstack sudo[111399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-135d30a5-df59-4e44-b0e5-8f4f15c2722b Jun 17 06:03:44 devstack sudo[111399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:44 devstack sudo[111399]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:44 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1e403f54-5403-43ce-9f3e-9ec05c304d57 tempest-VolumeDependencyTests-1046372343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-135d30a5-df59-4e44-b0e5-8f4f15c2722b" returned: 0 in 0.719s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:44 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-1e403f54-5403-43ce-9f3e-9ec05c304d57 tempest-VolumeDependencyTests-1046372343 None] Lock "cinder-quobyte-135d30a5-df59-4e44-b0e5-8f4f15c2722b" released by "delete_volume" :: held 1.865s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:03:44 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-1e403f54-5403-43ce-9f3e-9ec05c304d57 tempest-VolumeDependencyTests-1046372343 None] Created reservations ['9a300ab8-4a27-4b01-8f5f-d0f35cf23547', 'f48c2308-2968-4085-a5fa-7e20d1221752', '1c9d898d-5796-4970-9d80-ee2738240880', 'a1dcf9af-3a8b-4549-8924-3a9da87d8320'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 06:03:44 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-e32d73ea-0154-4fa1-9668-b19a335097f2 tempest-SnapshotDependencyTests-1805412700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 06:03:44 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e32d73ea-0154-4fa1-9668-b19a335097f2 tempest-SnapshotDependencyTests-1805412700 None] Flow 'volume_create_manager' (da801adc-93f5-4570-8f65-aab664cbd3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 06:03:44 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e32d73ea-0154-4fa1-9668-b19a335097f2 tempest-SnapshotDependencyTests-1805412700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d62bb2f-fe2c-445e-b868-2167e744a7bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:45 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e32d73ea-0154-4fa1-9668-b19a335097f2 tempest-SnapshotDependencyTests-1805412700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d62bb2f-fe2c-445e-b868-2167e744a7bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T04:03:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-529840039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=881929da-16c9-4978-b3bf-89a3504d1465,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d636428239b1459081c7f4e376bf5f7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T04:03:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T04:03:45Z,use_quota=True,user_id='947a897ef71f4d1982920fe6e6e2277b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:45 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e32d73ea-0154-4fa1-9668-b19a335097f2 tempest-SnapshotDependencyTests-1805412700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c565f03d-5546-44aa-8fb0-f8a497b0ad68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:45 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e32d73ea-0154-4fa1-9668-b19a335097f2 tempest-SnapshotDependencyTests-1805412700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c565f03d-5546-44aa-8fb0-f8a497b0ad68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:45 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e32d73ea-0154-4fa1-9668-b19a335097f2 tempest-SnapshotDependencyTests-1805412700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e20c30a-4dac-42f4-91b7-390db6fc9074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:45 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e32d73ea-0154-4fa1-9668-b19a335097f2 tempest-SnapshotDependencyTests-1805412700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e20c30a-4dac-42f4-91b7-390db6fc9074) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '881929da-16c9-4978-b3bf-89a3504d1465', 'volume_name': 'volume-881929da-16c9-4978-b3bf-89a3504d1465', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:45 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e32d73ea-0154-4fa1-9668-b19a335097f2 tempest-SnapshotDependencyTests-1805412700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (531520b4-10ab-4ec2-84d6-774e2536ecc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:45 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e32d73ea-0154-4fa1-9668-b19a335097f2 tempest-SnapshotDependencyTests-1805412700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (531520b4-10ab-4ec2-84d6-774e2536ecc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:45 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e32d73ea-0154-4fa1-9668-b19a335097f2 tempest-SnapshotDependencyTests-1805412700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d664c869-338e-4e35-a22b-2e5fab8af7c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:45 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-e32d73ea-0154-4fa1-9668-b19a335097f2 tempest-SnapshotDependencyTests-1805412700 None] Volume 881929da-16c9-4978-b3bf-89a3504d1465: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-881929da-16c9-4978-b3bf-89a3504d1465', 'volume_size': 1} Jun 17 06:03:45 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e32d73ea-0154-4fa1-9668-b19a335097f2 tempest-SnapshotDependencyTests-1805412700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:03:45 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e32d73ea-0154-4fa1-9668-b19a335097f2 tempest-SnapshotDependencyTests-1805412700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:03:45 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-e32d73ea-0154-4fa1-9668-b19a335097f2 tempest-SnapshotDependencyTests-1805412700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T04:03:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-529840039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=881929da-16c9-4978-b3bf-89a3504d1465,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d636428239b1459081c7f4e376bf5f7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T04:03:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T04:03:45Z,use_quota=True,user_id='947a897ef71f4d1982920fe6e6e2277b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 06:03:45 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-e32d73ea-0154-4fa1-9668-b19a335097f2 tempest-SnapshotDependencyTests-1805412700 None] Creating volume 881929da-16c9-4978-b3bf-89a3504d1465 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 06:03:45 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e32d73ea-0154-4fa1-9668-b19a335097f2 tempest-SnapshotDependencyTests-1805412700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:03:45 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e32d73ea-0154-4fa1-9668-b19a335097f2 tempest-SnapshotDependencyTests-1805412700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:03:45 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-e32d73ea-0154-4fa1-9668-b19a335097f2 tempest-SnapshotDependencyTests-1805412700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 06:03:45 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-e32d73ea-0154-4fa1-9668-b19a335097f2 tempest-SnapshotDependencyTests-1805412700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 06:03:45 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e32d73ea-0154-4fa1-9668-b19a335097f2 tempest-SnapshotDependencyTests-1805412700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:03:45 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-e32d73ea-0154-4fa1-9668-b19a335097f2 tempest-SnapshotDependencyTests-1805412700 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 06:03:45 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-e32d73ea-0154-4fa1-9668-b19a335097f2 tempest-SnapshotDependencyTests-1805412700 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 06:03:45 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e32d73ea-0154-4fa1-9668-b19a335097f2 tempest-SnapshotDependencyTests-1805412700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-881929da-16c9-4978-b3bf-89a3504d1465 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:45 devstack sudo[111403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-881929da-16c9-4978-b3bf-89a3504d1465 1073741824 Jun 17 06:03:45 devstack sudo[111403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:45 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-1e403f54-5403-43ce-9f3e-9ec05c304d57 tempest-VolumeDependencyTests-1046372343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:03:45 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-1e403f54-5403-43ce-9f3e-9ec05c304d57 tempest-VolumeDependencyTests-1046372343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:03:45 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-1e403f54-5403-43ce-9f3e-9ec05c304d57 tempest-VolumeDependencyTests-1046372343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 06:03:45 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-1e403f54-5403-43ce-9f3e-9ec05c304d57 tempest-VolumeDependencyTests-1046372343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 06:03:45 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-1e403f54-5403-43ce-9f3e-9ec05c304d57 tempest-VolumeDependencyTests-1046372343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:03:45 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1e403f54-5403-43ce-9f3e-9ec05c304d57 tempest-VolumeDependencyTests-1046372343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:45 devstack sudo[111405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 06:03:45 devstack sudo[111405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:45 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-d16f55b6-e097-43d6-b7d0-523ef81aedd7 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 06:03:45 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-d16f55b6-e097-43d6-b7d0-523ef81aedd7 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Flow 'volume_create_manager' (f33660e8-d6d0-43a5-8d51-79113676ff9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 06:03:45 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-d16f55b6-e097-43d6-b7d0-523ef81aedd7 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5165d07-0fb3-4d6e-b660-b8fac4079e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:45 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-d16f55b6-e097-43d6-b7d0-523ef81aedd7 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5165d07-0fb3-4d6e-b660-b8fac4079e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T04:03:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-809726010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d1857a4-ed81-44c6-975d-7ad67c61ed25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdd16c48196349779d65f5601a0692b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T04:03:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T04:03:45Z,use_quota=True,user_id='feb6d30c959346489c5a09aa3db73c86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:45 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-d16f55b6-e097-43d6-b7d0-523ef81aedd7 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67df4bda-7b74-42d2-91c7-f1a71e594798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:45 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-d16f55b6-e097-43d6-b7d0-523ef81aedd7 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67df4bda-7b74-42d2-91c7-f1a71e594798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:45 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-d16f55b6-e097-43d6-b7d0-523ef81aedd7 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d69981a-35c9-45aa-a146-686ef6e76bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:45 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-d16f55b6-e097-43d6-b7d0-523ef81aedd7 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d69981a-35c9-45aa-a146-686ef6e76bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d1857a4-ed81-44c6-975d-7ad67c61ed25', 'volume_name': 'volume-0d1857a4-ed81-44c6-975d-7ad67c61ed25', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:45 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-d16f55b6-e097-43d6-b7d0-523ef81aedd7 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9658ffff-387d-4952-ab78-6d7a5149c586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:45 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-d16f55b6-e097-43d6-b7d0-523ef81aedd7 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9658ffff-387d-4952-ab78-6d7a5149c586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:45 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-d16f55b6-e097-43d6-b7d0-523ef81aedd7 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6af2452d-ef97-43aa-a26c-75ca42abdc33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:45 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-d16f55b6-e097-43d6-b7d0-523ef81aedd7 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Volume 0d1857a4-ed81-44c6-975d-7ad67c61ed25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d1857a4-ed81-44c6-975d-7ad67c61ed25', 'volume_size': 1} Jun 17 06:03:45 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-d16f55b6-e097-43d6-b7d0-523ef81aedd7 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:03:45 devstack sudo[111405]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:45 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1e403f54-5403-43ce-9f3e-9ec05c304d57 tempest-VolumeDependencyTests-1046372343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.650s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:45 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-1e403f54-5403-43ce-9f3e-9ec05c304d57 tempest-VolumeDependencyTests-1046372343 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 06:03:45 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-1e403f54-5403-43ce-9f3e-9ec05c304d57 tempest-VolumeDependencyTests-1046372343 None] Deleted volume successfully. Jun 17 06:03:45 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-1e403f54-5403-43ce-9f3e-9ec05c304d57 tempest-VolumeDependencyTests-1046372343 None] Lock "cinder-135d30a5-df59-4e44-b0e5-8f4f15c2722b-delete_volume" released by "delete_volume" :: held 2.944s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:03:46 devstack sudo[111403]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e32d73ea-0154-4fa1-9668-b19a335097f2 tempest-SnapshotDependencyTests-1805412700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-881929da-16c9-4978-b3bf-89a3504d1465 1073741824" returned: 0 in 0.954s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e32d73ea-0154-4fa1-9668-b19a335097f2 tempest-SnapshotDependencyTests-1805412700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-881929da-16c9-4978-b3bf-89a3504d1465 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:46 devstack sudo[111413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-881929da-16c9-4978-b3bf-89a3504d1465 Jun 17 06:03:46 devstack sudo[111413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:46 devstack sudo[111413]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e32d73ea-0154-4fa1-9668-b19a335097f2 tempest-SnapshotDependencyTests-1805412700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-881929da-16c9-4978-b3bf-89a3504d1465" returned: 0 in 0.641s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:46 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-e32d73ea-0154-4fa1-9668-b19a335097f2 tempest-SnapshotDependencyTests-1805412700 None] <== create_volume: return (1636ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 06:03:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e32d73ea-0154-4fa1-9668-b19a335097f2 tempest-SnapshotDependencyTests-1805412700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.638s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:03:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-d16f55b6-e097-43d6-b7d0-523ef81aedd7 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.406s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:03:46 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-d16f55b6-e097-43d6-b7d0-523ef81aedd7 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T04:03:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-809726010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d1857a4-ed81-44c6-975d-7ad67c61ed25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdd16c48196349779d65f5601a0692b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T04:03:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T04:03:45Z,use_quota=True,user_id='feb6d30c959346489c5a09aa3db73c86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 06:03:46 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-d16f55b6-e097-43d6-b7d0-523ef81aedd7 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Creating volume 0d1857a4-ed81-44c6-975d-7ad67c61ed25 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 06:03:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-d16f55b6-e097-43d6-b7d0-523ef81aedd7 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:03:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-d16f55b6-e097-43d6-b7d0-523ef81aedd7 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:03:46 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-d16f55b6-e097-43d6-b7d0-523ef81aedd7 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 06:03:46 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-d16f55b6-e097-43d6-b7d0-523ef81aedd7 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 06:03:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-d16f55b6-e097-43d6-b7d0-523ef81aedd7 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:03:46 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-d16f55b6-e097-43d6-b7d0-523ef81aedd7 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 06:03:46 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-d16f55b6-e097-43d6-b7d0-523ef81aedd7 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 06:03:46 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-d16f55b6-e097-43d6-b7d0-523ef81aedd7 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0d1857a4-ed81-44c6-975d-7ad67c61ed25 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:46 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e32d73ea-0154-4fa1-9668-b19a335097f2 tempest-SnapshotDependencyTests-1805412700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d664c869-338e-4e35-a22b-2e5fab8af7c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-881929da-16c9-4978-b3bf-89a3504d1465', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:46 devstack sudo[111416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0d1857a4-ed81-44c6-975d-7ad67c61ed25 1073741824 Jun 17 06:03:46 devstack sudo[111416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:46 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e32d73ea-0154-4fa1-9668-b19a335097f2 tempest-SnapshotDependencyTests-1805412700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71f5c235-93ba-4a59-9ec0-f5413b0f3c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:46 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-e32d73ea-0154-4fa1-9668-b19a335097f2 tempest-SnapshotDependencyTests-1805412700 None] Volume volume-881929da-16c9-4978-b3bf-89a3504d1465 (881929da-16c9-4978-b3bf-89a3504d1465): created successfully Jun 17 06:03:46 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e32d73ea-0154-4fa1-9668-b19a335097f2 tempest-SnapshotDependencyTests-1805412700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71f5c235-93ba-4a59-9ec0-f5413b0f3c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:46 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e32d73ea-0154-4fa1-9668-b19a335097f2 tempest-SnapshotDependencyTests-1805412700 None] Flow 'volume_create_manager' (da801adc-93f5-4570-8f65-aab664cbd3e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 06:03:46 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-e32d73ea-0154-4fa1-9668-b19a335097f2 tempest-SnapshotDependencyTests-1805412700 None] Created volume successfully. Jun 17 06:03:47 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-b960473c-443c-4f13-af2a-8ddb7a3b3184 tempest-SnapshotDependencyTests-1805412700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:03:47 devstack sudo[111416]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:47 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-d16f55b6-e097-43d6-b7d0-523ef81aedd7 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0d1857a4-ed81-44c6-975d-7ad67c61ed25 1073741824" returned: 0 in 0.831s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:47 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-d16f55b6-e097-43d6-b7d0-523ef81aedd7 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0d1857a4-ed81-44c6-975d-7ad67c61ed25 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:47 devstack sudo[111422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0d1857a4-ed81-44c6-975d-7ad67c61ed25 Jun 17 06:03:47 devstack sudo[111422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:48 devstack sudo[111422]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:48 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-d16f55b6-e097-43d6-b7d0-523ef81aedd7 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0d1857a4-ed81-44c6-975d-7ad67c61ed25" returned: 0 in 0.585s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:48 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-d16f55b6-e097-43d6-b7d0-523ef81aedd7 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] <== create_volume: return (1458ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 06:03:48 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-d16f55b6-e097-43d6-b7d0-523ef81aedd7 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.462s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:03:48 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-b960473c-443c-4f13-af2a-8ddb7a3b3184 tempest-SnapshotDependencyTests-1805412700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.790s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:03:48 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-d16f55b6-e097-43d6-b7d0-523ef81aedd7 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6af2452d-ef97-43aa-a26c-75ca42abdc33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d1857a4-ed81-44c6-975d-7ad67c61ed25', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:48 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-d16f55b6-e097-43d6-b7d0-523ef81aedd7 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a1d5166-bd20-44c5-b258-a6c208c6e376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:48 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-b960473c-443c-4f13-af2a-8ddb7a3b3184 tempest-SnapshotDependencyTests-1805412700 None] Creating offline snapshot f87a1a60-ee78-473d-92c6-a6b48d907358 of volume 881929da-16c9-4978-b3bf-89a3504d1465 {{(pid=92083) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 17 06:03:48 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-d16f55b6-e097-43d6-b7d0-523ef81aedd7 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Volume volume-0d1857a4-ed81-44c6-975d-7ad67c61ed25 (0d1857a4-ed81-44c6-975d-7ad67c61ed25): created successfully Jun 17 06:03:48 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-d16f55b6-e097-43d6-b7d0-523ef81aedd7 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a1d5166-bd20-44c5-b258-a6c208c6e376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:48 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-d16f55b6-e097-43d6-b7d0-523ef81aedd7 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Flow 'volume_create_manager' (f33660e8-d6d0-43a5-8d51-79113676ff9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 06:03:48 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ed45f5-df89-4c14-9c59-2e9542c2a2a6]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 06:03:48 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b960473c-443c-4f13-af2a-8ddb7a3b3184 tempest-SnapshotDependencyTests-1805412700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-881929da-16c9-4978-b3bf-89a3504d1465 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:48 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-d16f55b6-e097-43d6-b7d0-523ef81aedd7 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Created volume successfully. Jun 17 06:03:48 devstack sudo[111425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-881929da-16c9-4978-b3bf-89a3504d1465 Jun 17 06:03:48 devstack sudo[111425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:48 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2ed2018-01fb-4553-901e-8a75b847d907 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 06:03:48 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e2ed2018-01fb-4553-901e-8a75b847d907 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Flow 'volume_create_manager' (df1dd105-0f43-451e-bfe7-d01e73de4a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 06:03:48 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e2ed2018-01fb-4553-901e-8a75b847d907 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2848d441-1e6f-4cc0-bf80-b3d387ff0a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:48 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e2ed2018-01fb-4553-901e-8a75b847d907 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2848d441-1e6f-4cc0-bf80-b3d387ff0a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T04:03:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1627189328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31d19cf4-be8b-4614-b78e-53f40f11caf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdd16c48196349779d65f5601a0692b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T04:03:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T04:03:49Z,use_quota=True,user_id='feb6d30c959346489c5a09aa3db73c86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:48 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e2ed2018-01fb-4553-901e-8a75b847d907 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8cf0a6d-3c26-4da3-a21a-8412c13858a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:48 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e2ed2018-01fb-4553-901e-8a75b847d907 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8cf0a6d-3c26-4da3-a21a-8412c13858a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:48 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e2ed2018-01fb-4553-901e-8a75b847d907 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b614c85c-94ca-43ea-9370-33c243c794b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:48 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e2ed2018-01fb-4553-901e-8a75b847d907 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b614c85c-94ca-43ea-9370-33c243c794b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31d19cf4-be8b-4614-b78e-53f40f11caf0', 'volume_name': 'volume-31d19cf4-be8b-4614-b78e-53f40f11caf0', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:48 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e2ed2018-01fb-4553-901e-8a75b847d907 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (296d62ac-a8df-4114-9857-5b54e0942bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:48 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e2ed2018-01fb-4553-901e-8a75b847d907 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (296d62ac-a8df-4114-9857-5b54e0942bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:48 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e2ed2018-01fb-4553-901e-8a75b847d907 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84e87b81-0e61-442a-a115-74e2508e8265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:48 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-e2ed2018-01fb-4553-901e-8a75b847d907 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Volume 31d19cf4-be8b-4614-b78e-53f40f11caf0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31d19cf4-be8b-4614-b78e-53f40f11caf0', 'volume_size': 1} Jun 17 06:03:48 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e2ed2018-01fb-4553-901e-8a75b847d907 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:03:48 devstack sudo[111425]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:48 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b960473c-443c-4f13-af2a-8ddb7a3b3184 tempest-SnapshotDependencyTests-1805412700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-881929da-16c9-4978-b3bf-89a3504d1465" returned: 0 in 0.729s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:48 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b960473c-443c-4f13-af2a-8ddb7a3b3184 tempest-SnapshotDependencyTests-1805412700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-881929da-16c9-4978-b3bf-89a3504d1465,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-881929da-16c9-4978-b3bf-89a3504d1465.f87a1a60-ee78-473d-92c6-a6b48d907358 1G {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:48 devstack sudo[111430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-881929da-16c9-4978-b3bf-89a3504d1465,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-881929da-16c9-4978-b3bf-89a3504d1465.f87a1a60-ee78-473d-92c6-a6b48d907358 1G Jun 17 06:03:48 devstack sudo[111430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:49 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8f13310-4a06-459b-b3ea-287779164996 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 06:03:49 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a8f13310-4a06-459b-b3ea-287779164996 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Flow 'volume_create_manager' (71c76f49-3251-4336-b16c-3552f4bfaedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 06:03:49 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a8f13310-4a06-459b-b3ea-287779164996 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5e04607-394e-4571-8e4f-219d0f0376b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:49 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a8f13310-4a06-459b-b3ea-287779164996 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5e04607-394e-4571-8e4f-219d0f0376b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T04:03:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-535777476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=619c7aa8-161f-494d-9d90-32206d349ae5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdd16c48196349779d65f5601a0692b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T04:03:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T04:03:49Z,use_quota=True,user_id='feb6d30c959346489c5a09aa3db73c86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:49 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a8f13310-4a06-459b-b3ea-287779164996 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b313ff9-db34-48ab-bedd-13423239a93e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:49 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a8f13310-4a06-459b-b3ea-287779164996 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b313ff9-db34-48ab-bedd-13423239a93e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:49 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a8f13310-4a06-459b-b3ea-287779164996 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08da1fc5-c827-4989-9f06-1a172f350c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:49 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a8f13310-4a06-459b-b3ea-287779164996 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08da1fc5-c827-4989-9f06-1a172f350c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '619c7aa8-161f-494d-9d90-32206d349ae5', 'volume_name': 'volume-619c7aa8-161f-494d-9d90-32206d349ae5', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:49 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a8f13310-4a06-459b-b3ea-287779164996 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95726500-f9d2-4663-adee-598f0ec605da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:49 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a8f13310-4a06-459b-b3ea-287779164996 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95726500-f9d2-4663-adee-598f0ec605da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:49 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a8f13310-4a06-459b-b3ea-287779164996 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (218ba64f-c615-495a-869d-af2f4ab7c70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:49 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-a8f13310-4a06-459b-b3ea-287779164996 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Volume 619c7aa8-161f-494d-9d90-32206d349ae5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-619c7aa8-161f-494d-9d90-32206d349ae5', 'volume_size': 1} Jun 17 06:03:49 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-a8f13310-4a06-459b-b3ea-287779164996 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:03:49 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-6166379a-2a7a-46d5-986f-4b8356abc090 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 06:03:49 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6166379a-2a7a-46d5-986f-4b8356abc090 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Flow 'volume_create_manager' (96fef5db-f415-4b0c-9ab0-51a13e3caeab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 06:03:49 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6166379a-2a7a-46d5-986f-4b8356abc090 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a51fd9b-5637-4dcc-afd0-18d3b050d48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:49 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6166379a-2a7a-46d5-986f-4b8356abc090 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a51fd9b-5637-4dcc-afd0-18d3b050d48b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T04:03:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-483852974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82a8db46-9d0e-4484-bbe9-b8ab00cc8256,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdd16c48196349779d65f5601a0692b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T04:03:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T04:03:49Z,use_quota=True,user_id='feb6d30c959346489c5a09aa3db73c86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:49 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6166379a-2a7a-46d5-986f-4b8356abc090 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc0f6193-1bb9-445b-9d6f-9b0d7f046174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:49 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6166379a-2a7a-46d5-986f-4b8356abc090 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc0f6193-1bb9-445b-9d6f-9b0d7f046174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:49 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6166379a-2a7a-46d5-986f-4b8356abc090 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a36d327b-cf34-47c9-a132-4c7ee8ece14f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:49 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6166379a-2a7a-46d5-986f-4b8356abc090 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a36d327b-cf34-47c9-a132-4c7ee8ece14f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82a8db46-9d0e-4484-bbe9-b8ab00cc8256', 'volume_name': 'volume-82a8db46-9d0e-4484-bbe9-b8ab00cc8256', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:49 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6166379a-2a7a-46d5-986f-4b8356abc090 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2a15503-dcea-4626-a282-c3a8afd8f365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:49 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6166379a-2a7a-46d5-986f-4b8356abc090 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2a15503-dcea-4626-a282-c3a8afd8f365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:49 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6166379a-2a7a-46d5-986f-4b8356abc090 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed97793c-2719-4ff1-a7a5-074e4cc3eb93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:49 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-6166379a-2a7a-46d5-986f-4b8356abc090 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Volume 82a8db46-9d0e-4484-bbe9-b8ab00cc8256: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82a8db46-9d0e-4484-bbe9-b8ab00cc8256', 'volume_size': 1} Jun 17 06:03:49 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-6166379a-2a7a-46d5-986f-4b8356abc090 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:03:49 devstack sudo[111430]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:49 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b960473c-443c-4f13-af2a-8ddb7a3b3184 tempest-SnapshotDependencyTests-1805412700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-881929da-16c9-4978-b3bf-89a3504d1465,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-881929da-16c9-4978-b3bf-89a3504d1465.f87a1a60-ee78-473d-92c6-a6b48d907358 1G" returned: 0 in 0.832s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:49 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b960473c-443c-4f13-af2a-8ddb7a3b3184 tempest-SnapshotDependencyTests-1805412700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-881929da-16c9-4978-b3bf-89a3504d1465 -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-881929da-16c9-4978-b3bf-89a3504d1465.f87a1a60-ee78-473d-92c6-a6b48d907358 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:49 devstack sudo[111437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-881929da-16c9-4978-b3bf-89a3504d1465 -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-881929da-16c9-4978-b3bf-89a3504d1465.f87a1a60-ee78-473d-92c6-a6b48d907358 Jun 17 06:03:49 devstack sudo[111437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:49 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d929575-1a40-4fe2-a17b-b511489d6abe tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 06:03:49 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4d929575-1a40-4fe2-a17b-b511489d6abe tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Flow 'volume_create_manager' (74dc8117-320d-4b02-986b-19c4e3c3431d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 06:03:49 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4d929575-1a40-4fe2-a17b-b511489d6abe tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9a16ba5-59ec-4fd4-96b1-6c88327f41d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:49 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4d929575-1a40-4fe2-a17b-b511489d6abe tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9a16ba5-59ec-4fd4-96b1-6c88327f41d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T04:03:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-374380057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4271d0fb-3587-4848-9f96-731834fb13f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdd16c48196349779d65f5601a0692b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T04:03:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T04:03:50Z,use_quota=True,user_id='feb6d30c959346489c5a09aa3db73c86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:49 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4d929575-1a40-4fe2-a17b-b511489d6abe tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4f4a70c-53cb-471c-ad51-7ebcfd7a72a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:49 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4d929575-1a40-4fe2-a17b-b511489d6abe tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4f4a70c-53cb-471c-ad51-7ebcfd7a72a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:49 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4d929575-1a40-4fe2-a17b-b511489d6abe tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8aee428b-e013-41e5-bd50-ff4aee547db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:49 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4d929575-1a40-4fe2-a17b-b511489d6abe tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8aee428b-e013-41e5-bd50-ff4aee547db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4271d0fb-3587-4848-9f96-731834fb13f1', 'volume_name': 'volume-4271d0fb-3587-4848-9f96-731834fb13f1', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:49 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4d929575-1a40-4fe2-a17b-b511489d6abe tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80d201f6-19d8-407e-95d6-5b353cdbdab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:49 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4d929575-1a40-4fe2-a17b-b511489d6abe tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80d201f6-19d8-407e-95d6-5b353cdbdab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:49 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4d929575-1a40-4fe2-a17b-b511489d6abe tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90442fdd-c3a7-482b-b1d3-4d58fbe2f35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:49 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-4d929575-1a40-4fe2-a17b-b511489d6abe tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Volume 4271d0fb-3587-4848-9f96-731834fb13f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4271d0fb-3587-4848-9f96-731834fb13f1', 'volume_size': 1} Jun 17 06:03:49 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-4d929575-1a40-4fe2-a17b-b511489d6abe tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:03:50 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-676cc60a-5d72-42cd-90f9-5db56d698b59 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 06:03:50 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-676cc60a-5d72-42cd-90f9-5db56d698b59 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Flow 'volume_create_manager' (3c4a5423-564e-41dc-ae5e-194b82e1ec10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 06:03:50 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-676cc60a-5d72-42cd-90f9-5db56d698b59 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3eb7e76-ff10-478c-874c-78ec3b2bb1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:50 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-676cc60a-5d72-42cd-90f9-5db56d698b59 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3eb7e76-ff10-478c-874c-78ec3b2bb1d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T04:03:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1254508824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34f55c12-6126-4366-823c-1493c897259e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdd16c48196349779d65f5601a0692b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T04:03:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T04:03:50Z,use_quota=True,user_id='feb6d30c959346489c5a09aa3db73c86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:50 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-676cc60a-5d72-42cd-90f9-5db56d698b59 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae992e00-fd57-4ea0-87ed-37a3bf46eb29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:50 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-676cc60a-5d72-42cd-90f9-5db56d698b59 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae992e00-fd57-4ea0-87ed-37a3bf46eb29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:50 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-676cc60a-5d72-42cd-90f9-5db56d698b59 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cb8907e-c6c8-4cc2-a3e2-17ffedfe7885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:50 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-676cc60a-5d72-42cd-90f9-5db56d698b59 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cb8907e-c6c8-4cc2-a3e2-17ffedfe7885) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34f55c12-6126-4366-823c-1493c897259e', 'volume_name': 'volume-34f55c12-6126-4366-823c-1493c897259e', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:50 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-676cc60a-5d72-42cd-90f9-5db56d698b59 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9599fc48-c648-4913-8e9e-e2e470f8cd6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:50 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-676cc60a-5d72-42cd-90f9-5db56d698b59 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9599fc48-c648-4913-8e9e-e2e470f8cd6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:50 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-676cc60a-5d72-42cd-90f9-5db56d698b59 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7209af6-de55-48ab-a027-3cceb2a7712b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:50 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-676cc60a-5d72-42cd-90f9-5db56d698b59 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Volume 34f55c12-6126-4366-823c-1493c897259e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34f55c12-6126-4366-823c-1493c897259e', 'volume_size': 1} Jun 17 06:03:50 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-676cc60a-5d72-42cd-90f9-5db56d698b59 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:03:50 devstack sudo[111437]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:50 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b960473c-443c-4f13-af2a-8ddb7a3b3184 tempest-SnapshotDependencyTests-1805412700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-881929da-16c9-4978-b3bf-89a3504d1465 -F qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-881929da-16c9-4978-b3bf-89a3504d1465.f87a1a60-ee78-473d-92c6-a6b48d907358" returned: 0 in 0.660s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:50 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [None req-b960473c-443c-4f13-af2a-8ddb7a3b3184 tempest-SnapshotDependencyTests-1805412700 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-881929da-16c9-4978-b3bf-89a3504d1465.f87a1a60-ee78-473d-92c6-a6b48d907358 is being set with open permissions: ugo+rw Jun 17 06:03:50 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b960473c-443c-4f13-af2a-8ddb7a3b3184 tempest-SnapshotDependencyTests-1805412700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-881929da-16c9-4978-b3bf-89a3504d1465.f87a1a60-ee78-473d-92c6-a6b48d907358 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:50 devstack sudo[111442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-881929da-16c9-4978-b3bf-89a3504d1465.f87a1a60-ee78-473d-92c6-a6b48d907358 Jun 17 06:03:50 devstack sudo[111442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:51 devstack sudo[111442]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:51 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b960473c-443c-4f13-af2a-8ddb7a3b3184 tempest-SnapshotDependencyTests-1805412700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-881929da-16c9-4978-b3bf-89a3504d1465.f87a1a60-ee78-473d-92c6-a6b48d907358" returned: 0 in 0.590s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:51 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b960473c-443c-4f13-af2a-8ddb7a3b3184 tempest-SnapshotDependencyTests-1805412700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-881929da-16c9-4978-b3bf-89a3504d1465.info {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:51 devstack sudo[111445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-881929da-16c9-4978-b3bf-89a3504d1465.info Jun 17 06:03:51 devstack sudo[111445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:51 devstack sudo[111445]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:51 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b960473c-443c-4f13-af2a-8ddb7a3b3184 tempest-SnapshotDependencyTests-1805412700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-881929da-16c9-4978-b3bf-89a3504d1465.info" returned: 0 in 0.617s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:51 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [None req-b960473c-443c-4f13-af2a-8ddb7a3b3184 tempest-SnapshotDependencyTests-1805412700 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-881929da-16c9-4978-b3bf-89a3504d1465.info is being set with open permissions: ugo+rw Jun 17 06:03:51 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b960473c-443c-4f13-af2a-8ddb7a3b3184 tempest-SnapshotDependencyTests-1805412700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-881929da-16c9-4978-b3bf-89a3504d1465.info {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:51 devstack sudo[111448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-881929da-16c9-4978-b3bf-89a3504d1465.info Jun 17 06:03:51 devstack sudo[111448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:52 devstack sudo[111448]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-b960473c-443c-4f13-af2a-8ddb7a3b3184 tempest-SnapshotDependencyTests-1805412700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-881929da-16c9-4978-b3bf-89a3504d1465.info" returned: 0 in 0.602s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-b960473c-443c-4f13-af2a-8ddb7a3b3184 tempest-SnapshotDependencyTests-1805412700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.135s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:03:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e2ed2018-01fb-4553-901e-8a75b847d907 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.457s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:03:52 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-e2ed2018-01fb-4553-901e-8a75b847d907 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T04:03:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1627189328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31d19cf4-be8b-4614-b78e-53f40f11caf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdd16c48196349779d65f5601a0692b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T04:03:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T04:03:49Z,use_quota=True,user_id='feb6d30c959346489c5a09aa3db73c86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 06:03:52 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-e2ed2018-01fb-4553-901e-8a75b847d907 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Creating volume 31d19cf4-be8b-4614-b78e-53f40f11caf0 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 06:03:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e2ed2018-01fb-4553-901e-8a75b847d907 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:03:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e2ed2018-01fb-4553-901e-8a75b847d907 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:03:52 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-e2ed2018-01fb-4553-901e-8a75b847d907 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 06:03:52 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-e2ed2018-01fb-4553-901e-8a75b847d907 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 06:03:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e2ed2018-01fb-4553-901e-8a75b847d907 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:03:52 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-e2ed2018-01fb-4553-901e-8a75b847d907 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 06:03:52 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-e2ed2018-01fb-4553-901e-8a75b847d907 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 06:03:52 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e2ed2018-01fb-4553-901e-8a75b847d907 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-31d19cf4-be8b-4614-b78e-53f40f11caf0 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:52 devstack sudo[111451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-31d19cf4-be8b-4614-b78e-53f40f11caf0 1073741824 Jun 17 06:03:52 devstack sudo[111451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:52 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-b960473c-443c-4f13-af2a-8ddb7a3b3184 tempest-SnapshotDependencyTests-1805412700 None] Create snapshot completed successfully Jun 17 06:03:53 devstack cinder-volume[92083]: DEBUG cinder.volume.flows.manager.create_volume [None req-680ec917-97ac-425f-8470-b56af11985d6 tempest-SnapshotDependencyTests-1805412700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92083) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 06:03:53 devstack sudo[111451]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:53 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-680ec917-97ac-425f-8470-b56af11985d6 tempest-SnapshotDependencyTests-1805412700 None] Flow 'volume_create_manager' (8e54c902-2413-4f6f-a5d9-227b305dbd5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 06:03:53 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-680ec917-97ac-425f-8470-b56af11985d6 tempest-SnapshotDependencyTests-1805412700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (148f71ad-2e71-4ba3-aeef-9ff98fd0aae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:53 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e2ed2018-01fb-4553-901e-8a75b847d907 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-31d19cf4-be8b-4614-b78e-53f40f11caf0 1073741824" returned: 0 in 0.830s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:53 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-680ec917-97ac-425f-8470-b56af11985d6 tempest-SnapshotDependencyTests-1805412700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (148f71ad-2e71-4ba3-aeef-9ff98fd0aae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T04:03:53Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f102cde-8bd3-4566-9556-006303ff7326,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d636428239b1459081c7f4e376bf5f7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T04:03:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f87a1a60-ee78-473d-92c6-a6b48d907358,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T04:03:53Z,use_quota=True,user_id='947a897ef71f4d1982920fe6e6e2277b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:53 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-680ec917-97ac-425f-8470-b56af11985d6 tempest-SnapshotDependencyTests-1805412700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2d96f9c-2ee6-40d7-9140-abf4d10a1962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:53 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-680ec917-97ac-425f-8470-b56af11985d6 tempest-SnapshotDependencyTests-1805412700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2d96f9c-2ee6-40d7-9140-abf4d10a1962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:53 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-680ec917-97ac-425f-8470-b56af11985d6 tempest-SnapshotDependencyTests-1805412700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6c22452-7738-4b98-9e75-804b94c7386f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:53 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-680ec917-97ac-425f-8470-b56af11985d6 tempest-SnapshotDependencyTests-1805412700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6c22452-7738-4b98-9e75-804b94c7386f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3f102cde-8bd3-4566-9556-006303ff7326', 'volume_name': 'volume-3f102cde-8bd3-4566-9556-006303ff7326', 'volume_size': 1, 'snapshot_id': 'f87a1a60-ee78-473d-92c6-a6b48d907358'}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:53 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-680ec917-97ac-425f-8470-b56af11985d6 tempest-SnapshotDependencyTests-1805412700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32805afc-1766-417b-9731-3c85bb98648a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:53 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-680ec917-97ac-425f-8470-b56af11985d6 tempest-SnapshotDependencyTests-1805412700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32805afc-1766-417b-9731-3c85bb98648a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:53 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-680ec917-97ac-425f-8470-b56af11985d6 tempest-SnapshotDependencyTests-1805412700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de305262-add2-4ca2-8f98-454657973611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:53 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-680ec917-97ac-425f-8470-b56af11985d6 tempest-SnapshotDependencyTests-1805412700 None] Volume 3f102cde-8bd3-4566-9556-006303ff7326: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3f102cde-8bd3-4566-9556-006303ff7326', 'volume_size': 1, 'snapshot_id': 'f87a1a60-ee78-473d-92c6-a6b48d907358'} Jun 17 06:03:53 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-680ec917-97ac-425f-8470-b56af11985d6 tempest-SnapshotDependencyTests-1805412700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:03:53 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e2ed2018-01fb-4553-901e-8a75b847d907 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-31d19cf4-be8b-4614-b78e-53f40f11caf0 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:53 devstack sudo[111457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-31d19cf4-be8b-4614-b78e-53f40f11caf0 Jun 17 06:03:53 devstack sudo[111457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:53 devstack sudo[111457]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:53 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e2ed2018-01fb-4553-901e-8a75b847d907 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-31d19cf4-be8b-4614-b78e-53f40f11caf0" returned: 0 in 0.579s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:53 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-e2ed2018-01fb-4553-901e-8a75b847d907 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] <== create_volume: return (1491ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 06:03:53 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e2ed2018-01fb-4553-901e-8a75b847d907 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.493s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:03:53 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-a8f13310-4a06-459b-b3ea-287779164996 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.607s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:03:53 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-a8f13310-4a06-459b-b3ea-287779164996 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T04:03:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-535777476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=619c7aa8-161f-494d-9d90-32206d349ae5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdd16c48196349779d65f5601a0692b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T04:03:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T04:03:49Z,use_quota=True,user_id='feb6d30c959346489c5a09aa3db73c86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 06:03:53 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-a8f13310-4a06-459b-b3ea-287779164996 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Creating volume 619c7aa8-161f-494d-9d90-32206d349ae5 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 06:03:53 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-a8f13310-4a06-459b-b3ea-287779164996 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:03:53 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-a8f13310-4a06-459b-b3ea-287779164996 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:03:53 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-a8f13310-4a06-459b-b3ea-287779164996 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 06:03:53 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-a8f13310-4a06-459b-b3ea-287779164996 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 06:03:53 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-a8f13310-4a06-459b-b3ea-287779164996 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:03:53 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-a8f13310-4a06-459b-b3ea-287779164996 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 06:03:53 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-a8f13310-4a06-459b-b3ea-287779164996 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 06:03:53 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a8f13310-4a06-459b-b3ea-287779164996 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-619c7aa8-161f-494d-9d90-32206d349ae5 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:53 devstack sudo[111460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-619c7aa8-161f-494d-9d90-32206d349ae5 1073741824 Jun 17 06:03:53 devstack sudo[111460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:53 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e2ed2018-01fb-4553-901e-8a75b847d907 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84e87b81-0e61-442a-a115-74e2508e8265) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31d19cf4-be8b-4614-b78e-53f40f11caf0', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:53 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e2ed2018-01fb-4553-901e-8a75b847d907 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c99d544b-67ac-47b6-a3da-d9a4c28f08b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:53 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-e2ed2018-01fb-4553-901e-8a75b847d907 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Volume volume-31d19cf4-be8b-4614-b78e-53f40f11caf0 (31d19cf4-be8b-4614-b78e-53f40f11caf0): created successfully Jun 17 06:03:53 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e2ed2018-01fb-4553-901e-8a75b847d907 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c99d544b-67ac-47b6-a3da-d9a4c28f08b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:53 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-e2ed2018-01fb-4553-901e-8a75b847d907 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Flow 'volume_create_manager' (df1dd105-0f43-451e-bfe7-d01e73de4a31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 06:03:53 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-e2ed2018-01fb-4553-901e-8a75b847d907 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Created volume successfully. Jun 17 06:03:54 devstack sudo[111460]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a8f13310-4a06-459b-b3ea-287779164996 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-619c7aa8-161f-494d-9d90-32206d349ae5 1073741824" returned: 0 in 0.765s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:54 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a8f13310-4a06-459b-b3ea-287779164996 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-619c7aa8-161f-494d-9d90-32206d349ae5 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:54 devstack sudo[111465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-619c7aa8-161f-494d-9d90-32206d349ae5 Jun 17 06:03:54 devstack sudo[111465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:55 devstack sudo[111465]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-a8f13310-4a06-459b-b3ea-287779164996 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-619c7aa8-161f-494d-9d90-32206d349ae5" returned: 0 in 0.606s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:55 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-a8f13310-4a06-459b-b3ea-287779164996 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] <== create_volume: return (1405ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 06:03:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-a8f13310-4a06-459b-b3ea-287779164996 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.408s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:03:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-6166379a-2a7a-46d5-986f-4b8356abc090 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.650s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:03:55 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-6166379a-2a7a-46d5-986f-4b8356abc090 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T04:03:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-483852974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82a8db46-9d0e-4484-bbe9-b8ab00cc8256,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdd16c48196349779d65f5601a0692b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T04:03:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T04:03:49Z,use_quota=True,user_id='feb6d30c959346489c5a09aa3db73c86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 06:03:55 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-6166379a-2a7a-46d5-986f-4b8356abc090 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Creating volume 82a8db46-9d0e-4484-bbe9-b8ab00cc8256 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 06:03:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-6166379a-2a7a-46d5-986f-4b8356abc090 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:03:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-6166379a-2a7a-46d5-986f-4b8356abc090 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:03:55 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-6166379a-2a7a-46d5-986f-4b8356abc090 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 06:03:55 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-6166379a-2a7a-46d5-986f-4b8356abc090 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 06:03:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-6166379a-2a7a-46d5-986f-4b8356abc090 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:03:55 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-6166379a-2a7a-46d5-986f-4b8356abc090 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 06:03:55 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-6166379a-2a7a-46d5-986f-4b8356abc090 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 06:03:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6166379a-2a7a-46d5-986f-4b8356abc090 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-82a8db46-9d0e-4484-bbe9-b8ab00cc8256 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:55 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a8f13310-4a06-459b-b3ea-287779164996 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (218ba64f-c615-495a-869d-af2f4ab7c70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-619c7aa8-161f-494d-9d90-32206d349ae5', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:55 devstack sudo[111468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-82a8db46-9d0e-4484-bbe9-b8ab00cc8256 1073741824 Jun 17 06:03:55 devstack sudo[111468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:55 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a8f13310-4a06-459b-b3ea-287779164996 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (347eff42-fefe-44ca-8847-c5f65e23d300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:55 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-a8f13310-4a06-459b-b3ea-287779164996 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Volume volume-619c7aa8-161f-494d-9d90-32206d349ae5 (619c7aa8-161f-494d-9d90-32206d349ae5): created successfully Jun 17 06:03:55 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a8f13310-4a06-459b-b3ea-287779164996 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (347eff42-fefe-44ca-8847-c5f65e23d300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:55 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-a8f13310-4a06-459b-b3ea-287779164996 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Flow 'volume_create_manager' (71c76f49-3251-4336-b16c-3552f4bfaedd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 06:03:55 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-a8f13310-4a06-459b-b3ea-287779164996 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Created volume successfully. Jun 17 06:03:55 devstack sudo[111468]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:55 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6166379a-2a7a-46d5-986f-4b8356abc090 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-82a8db46-9d0e-4484-bbe9-b8ab00cc8256 1073741824" returned: 0 in 0.767s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:56 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6166379a-2a7a-46d5-986f-4b8356abc090 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-82a8db46-9d0e-4484-bbe9-b8ab00cc8256 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:56 devstack sudo[111473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-82a8db46-9d0e-4484-bbe9-b8ab00cc8256 Jun 17 06:03:56 devstack sudo[111473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:56 devstack sudo[111473]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:56 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6166379a-2a7a-46d5-986f-4b8356abc090 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-82a8db46-9d0e-4484-bbe9-b8ab00cc8256" returned: 0 in 0.589s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:56 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-6166379a-2a7a-46d5-986f-4b8356abc090 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] <== create_volume: return (1391ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 06:03:56 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-6166379a-2a7a-46d5-986f-4b8356abc090 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.394s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:03:56 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-4d929575-1a40-4fe2-a17b-b511489d6abe tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.679s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:03:56 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-4d929575-1a40-4fe2-a17b-b511489d6abe tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T04:03:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-374380057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4271d0fb-3587-4848-9f96-731834fb13f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdd16c48196349779d65f5601a0692b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T04:03:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T04:03:50Z,use_quota=True,user_id='feb6d30c959346489c5a09aa3db73c86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 06:03:56 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-4d929575-1a40-4fe2-a17b-b511489d6abe tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Creating volume 4271d0fb-3587-4848-9f96-731834fb13f1 {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 06:03:56 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-4d929575-1a40-4fe2-a17b-b511489d6abe tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:03:56 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-4d929575-1a40-4fe2-a17b-b511489d6abe tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:03:56 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-4d929575-1a40-4fe2-a17b-b511489d6abe tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 06:03:56 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-4d929575-1a40-4fe2-a17b-b511489d6abe tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 06:03:56 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-4d929575-1a40-4fe2-a17b-b511489d6abe tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:03:56 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-4d929575-1a40-4fe2-a17b-b511489d6abe tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 06:03:56 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-4d929575-1a40-4fe2-a17b-b511489d6abe tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 06:03:56 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4d929575-1a40-4fe2-a17b-b511489d6abe tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4271d0fb-3587-4848-9f96-731834fb13f1 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:56 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6166379a-2a7a-46d5-986f-4b8356abc090 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed97793c-2719-4ff1-a7a5-074e4cc3eb93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82a8db46-9d0e-4484-bbe9-b8ab00cc8256', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:56 devstack sudo[111476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4271d0fb-3587-4848-9f96-731834fb13f1 1073741824 Jun 17 06:03:56 devstack sudo[111476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:56 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6166379a-2a7a-46d5-986f-4b8356abc090 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50104a17-9d87-4640-b404-d001c68f00be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:56 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-6166379a-2a7a-46d5-986f-4b8356abc090 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Volume volume-82a8db46-9d0e-4484-bbe9-b8ab00cc8256 (82a8db46-9d0e-4484-bbe9-b8ab00cc8256): created successfully Jun 17 06:03:56 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6166379a-2a7a-46d5-986f-4b8356abc090 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50104a17-9d87-4640-b404-d001c68f00be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:56 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-6166379a-2a7a-46d5-986f-4b8356abc090 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Flow 'volume_create_manager' (96fef5db-f415-4b0c-9ab0-51a13e3caeab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 06:03:56 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-6166379a-2a7a-46d5-986f-4b8356abc090 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Created volume successfully. Jun 17 06:03:57 devstack sudo[111476]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4d929575-1a40-4fe2-a17b-b511489d6abe tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4271d0fb-3587-4848-9f96-731834fb13f1 1073741824" returned: 0 in 0.801s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:57 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4d929575-1a40-4fe2-a17b-b511489d6abe tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4271d0fb-3587-4848-9f96-731834fb13f1 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:57 devstack sudo[111482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4271d0fb-3587-4848-9f96-731834fb13f1 Jun 17 06:03:57 devstack sudo[111482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:58 devstack sudo[111482]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:58 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-4d929575-1a40-4fe2-a17b-b511489d6abe tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4271d0fb-3587-4848-9f96-731834fb13f1" returned: 0 in 0.596s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:58 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-4d929575-1a40-4fe2-a17b-b511489d6abe tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] <== create_volume: return (1435ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 06:03:58 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-4d929575-1a40-4fe2-a17b-b511489d6abe tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.437s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:03:58 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-676cc60a-5d72-42cd-90f9-5db56d698b59 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.812s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:03:58 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-676cc60a-5d72-42cd-90f9-5db56d698b59 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T04:03:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1254508824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34f55c12-6126-4366-823c-1493c897259e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdd16c48196349779d65f5601a0692b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T04:03:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T04:03:50Z,use_quota=True,user_id='feb6d30c959346489c5a09aa3db73c86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e6ae74-908b-4b29-919c-987d8839d7e9),volume_type_id=f6e6ae74-908b-4b29-919c-987d8839d7e9)}" {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 06:03:58 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-676cc60a-5d72-42cd-90f9-5db56d698b59 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Creating volume 34f55c12-6126-4366-823c-1493c897259e {{(pid=92083) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 06:03:58 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-676cc60a-5d72-42cd-90f9-5db56d698b59 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:03:58 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-676cc60a-5d72-42cd-90f9-5db56d698b59 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:03:58 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-676cc60a-5d72-42cd-90f9-5db56d698b59 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 06:03:58 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-676cc60a-5d72-42cd-90f9-5db56d698b59 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 06:03:58 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-676cc60a-5d72-42cd-90f9-5db56d698b59 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:03:58 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-676cc60a-5d72-42cd-90f9-5db56d698b59 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 06:03:58 devstack cinder-volume[92083]: INFO cinder.volume.drivers.remotefs [None req-676cc60a-5d72-42cd-90f9-5db56d698b59 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] casted to osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f Jun 17 06:03:58 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-676cc60a-5d72-42cd-90f9-5db56d698b59 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-34f55c12-6126-4366-823c-1493c897259e 1073741824 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:58 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4d929575-1a40-4fe2-a17b-b511489d6abe tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90442fdd-c3a7-482b-b1d3-4d58fbe2f35d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4271d0fb-3587-4848-9f96-731834fb13f1', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:58 devstack sudo[111485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-34f55c12-6126-4366-823c-1493c897259e 1073741824 Jun 17 06:03:58 devstack sudo[111485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:58 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4d929575-1a40-4fe2-a17b-b511489d6abe tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89579e1b-94ed-4a72-9a06-df62d6342c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:58 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-4d929575-1a40-4fe2-a17b-b511489d6abe tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Volume volume-4271d0fb-3587-4848-9f96-731834fb13f1 (4271d0fb-3587-4848-9f96-731834fb13f1): created successfully Jun 17 06:03:58 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4d929575-1a40-4fe2-a17b-b511489d6abe tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89579e1b-94ed-4a72-9a06-df62d6342c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:58 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-4d929575-1a40-4fe2-a17b-b511489d6abe tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Flow 'volume_create_manager' (74dc8117-320d-4b02-986b-19c4e3c3431d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 06:03:58 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-4d929575-1a40-4fe2-a17b-b511489d6abe tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Created volume successfully. Jun 17 06:03:58 devstack sudo[111485]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:58 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-676cc60a-5d72-42cd-90f9-5db56d698b59 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-34f55c12-6126-4366-823c-1493c897259e 1073741824" returned: 0 in 0.763s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:58 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-676cc60a-5d72-42cd-90f9-5db56d698b59 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-34f55c12-6126-4366-823c-1493c897259e {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:58 devstack sudo[111491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-34f55c12-6126-4366-823c-1493c897259e Jun 17 06:03:58 devstack sudo[111491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:59 devstack sudo[111491]: pam_unix(sudo:session): session closed for user root Jun 17 06:03:59 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-676cc60a-5d72-42cd-90f9-5db56d698b59 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-34f55c12-6126-4366-823c-1493c897259e" returned: 0 in 0.599s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:03:59 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-676cc60a-5d72-42cd-90f9-5db56d698b59 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] <== create_volume: return (1399ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'} {{(pid=92083) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 06:03:59 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-676cc60a-5d72-42cd-90f9-5db56d698b59 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.402s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:03:59 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-680ec917-97ac-425f-8470-b56af11985d6 tempest-SnapshotDependencyTests-1805412700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 6.253s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:03:59 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-680ec917-97ac-425f-8470-b56af11985d6 tempest-SnapshotDependencyTests-1805412700 None] Acquiring lock "cinder-quobyte-f87a1a60-ee78-473d-92c6-a6b48d907358-3f102cde-8bd3-4566-9556-006303ff7326" by "_create_volume_from_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:03:59 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-676cc60a-5d72-42cd-90f9-5db56d698b59 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7209af6-de55-48ab-a027-3cceb2a7712b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34f55c12-6126-4366-823c-1493c897259e', 'volume_size': 1}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:59 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-676cc60a-5d72-42cd-90f9-5db56d698b59 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72700723-556d-442b-a590-7f5a41b0f093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:03:59 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-680ec917-97ac-425f-8470-b56af11985d6 tempest-SnapshotDependencyTests-1805412700 None] Lock "cinder-quobyte-f87a1a60-ee78-473d-92c6-a6b48d907358-3f102cde-8bd3-4566-9556-006303ff7326" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:03:59 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-680ec917-97ac-425f-8470-b56af11985d6 tempest-SnapshotDependencyTests-1805412700 None] Creating volume 3f102cde-8bd3-4566-9556-006303ff7326 from snapshot f87a1a60-ee78-473d-92c6-a6b48d907358 {{(pid=92083) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 17 06:03:59 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-680ec917-97ac-425f-8470-b56af11985d6 tempest-SnapshotDependencyTests-1805412700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:03:59 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-680ec917-97ac-425f-8470-b56af11985d6 tempest-SnapshotDependencyTests-1805412700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:03:59 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-680ec917-97ac-425f-8470-b56af11985d6 tempest-SnapshotDependencyTests-1805412700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 06:03:59 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-680ec917-97ac-425f-8470-b56af11985d6 tempest-SnapshotDependencyTests-1805412700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 06:03:59 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-680ec917-97ac-425f-8470-b56af11985d6 tempest-SnapshotDependencyTests-1805412700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:03:59 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-680ec917-97ac-425f-8470-b56af11985d6 tempest-SnapshotDependencyTests-1805412700 None] Selected osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f as target Quobyte volume. {{(pid=92083) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 06:03:59 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-680ec917-97ac-425f-8470-b56af11985d6 tempest-SnapshotDependencyTests-1805412700 None] Acquiring lock "cinder-quobyte-3f102cde-8bd3-4566-9556-006303ff7326" by "_copy_volume_from_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:03:59 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-676cc60a-5d72-42cd-90f9-5db56d698b59 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Volume volume-34f55c12-6126-4366-823c-1493c897259e (34f55c12-6126-4366-823c-1493c897259e): created successfully Jun 17 06:03:59 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-676cc60a-5d72-42cd-90f9-5db56d698b59 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72700723-556d-442b-a590-7f5a41b0f093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:03:59 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-676cc60a-5d72-42cd-90f9-5db56d698b59 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Flow 'volume_create_manager' (3c4a5423-564e-41dc-ae5e-194b82e1ec10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 06:03:59 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-680ec917-97ac-425f-8470-b56af11985d6 tempest-SnapshotDependencyTests-1805412700 None] Lock "cinder-quobyte-3f102cde-8bd3-4566-9556-006303ff7326" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:03:59 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-680ec917-97ac-425f-8470-b56af11985d6 tempest-SnapshotDependencyTests-1805412700 None] snapshot: f87a1a60-ee78-473d-92c6-a6b48d907358, volume: 3f102cde-8bd3-4566-9556-006303ff7326, {{(pid=92083) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 17 06:03:59 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-676cc60a-5d72-42cd-90f9-5db56d698b59 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Created volume successfully. Jun 17 06:03:59 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-680ec917-97ac-425f-8470-b56af11985d6 tempest-SnapshotDependencyTests-1805412700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:03:59 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-680ec917-97ac-425f-8470-b56af11985d6 tempest-SnapshotDependencyTests-1805412700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:03:59 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-680ec917-97ac-425f-8470-b56af11985d6 tempest-SnapshotDependencyTests-1805412700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 06:03:59 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-680ec917-97ac-425f-8470-b56af11985d6 tempest-SnapshotDependencyTests-1805412700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 06:03:59 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-680ec917-97ac-425f-8470-b56af11985d6 tempest-SnapshotDependencyTests-1805412700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:03:59 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[1879530b-f225-4ebf-8539-96c5a81b6262]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 06:03:59 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-680ec917-97ac-425f-8470-b56af11985d6 tempest-SnapshotDependencyTests-1805412700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-881929da-16c9-4978-b3bf-89a3504d1465.f87a1a60-ee78-473d-92c6-a6b48d907358 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:03:59 devstack sudo[111495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-881929da-16c9-4978-b3bf-89a3504d1465.f87a1a60-ee78-473d-92c6-a6b48d907358 Jun 17 06:03:59 devstack sudo[111495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:03:59 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-dfc2f182-d82a-4285-aedf-2de710a572f2 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Acquiring lock "cinder-34f55c12-6126-4366-823c-1493c897259e-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:03:59 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-dfc2f182-d82a-4285-aedf-2de710a572f2 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Lock "cinder-34f55c12-6126-4366-823c-1493c897259e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:03:59 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-dfc2f182-d82a-4285-aedf-2de710a572f2 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Acquiring lock "cinder-quobyte-34f55c12-6126-4366-823c-1493c897259e" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:03:59 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-dfc2f182-d82a-4285-aedf-2de710a572f2 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Lock "cinder-quobyte-34f55c12-6126-4366-823c-1493c897259e" acquired by "delete_volume" :: waited 0.017s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:04:00 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[813d2fa8-ed1a-4f52-8f4f-79dde17ea98a]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 06:04:00 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-dfc2f182-d82a-4285-aedf-2de710a572f2 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-34f55c12-6126-4366-823c-1493c897259e {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:04:00 devstack sudo[111497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-34f55c12-6126-4366-823c-1493c897259e Jun 17 06:04:00 devstack sudo[111497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:04:00 devstack sudo[111495]: pam_unix(sudo:session): session closed for user root Jun 17 06:04:00 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-680ec917-97ac-425f-8470-b56af11985d6 tempest-SnapshotDependencyTests-1805412700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-881929da-16c9-4978-b3bf-89a3504d1465.f87a1a60-ee78-473d-92c6-a6b48d907358" returned: 0 in 0.715s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:04:00 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-680ec917-97ac-425f-8470-b56af11985d6 tempest-SnapshotDependencyTests-1805412700 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-881929da-16c9-4978-b3bf-89a3504d1465(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92083) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 06:04:00 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-680ec917-97ac-425f-8470-b56af11985d6 tempest-SnapshotDependencyTests-1805412700 None] will copy from snapshot at /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-881929da-16c9-4978-b3bf-89a3504d1465 {{(pid=92083) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 17 06:04:00 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-680ec917-97ac-425f-8470-b56af11985d6 tempest-SnapshotDependencyTests-1805412700 None] Creating direct copy from snapshot {{(pid=92083) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 17 06:04:00 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[362273ad-2ffe-47bb-b5b4-f9d7c8d6ab42]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 06:04:00 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-680ec917-97ac-425f-8470-b56af11985d6 tempest-SnapshotDependencyTests-1805412700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-881929da-16c9-4978-b3bf-89a3504d1465 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:04:00 devstack sudo[111502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-881929da-16c9-4978-b3bf-89a3504d1465 Jun 17 06:04:00 devstack sudo[111502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:04:00 devstack sudo[111497]: pam_unix(sudo:session): session closed for user root Jun 17 06:04:00 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-dfc2f182-d82a-4285-aedf-2de710a572f2 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-34f55c12-6126-4366-823c-1493c897259e" returned: 0 in 0.730s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:04:00 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-dfc2f182-d82a-4285-aedf-2de710a572f2 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-34f55c12-6126-4366-823c-1493c897259e {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:04:00 devstack sudo[111507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-34f55c12-6126-4366-823c-1493c897259e Jun 17 06:04:00 devstack sudo[111507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:04:01 devstack sudo[111502]: pam_unix(sudo:session): session closed for user root Jun 17 06:04:01 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-680ec917-97ac-425f-8470-b56af11985d6 tempest-SnapshotDependencyTests-1805412700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-881929da-16c9-4978-b3bf-89a3504d1465" returned: 0 in 0.735s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:04:01 devstack cinder-volume[92083]: DEBUG cinder.utils [None req-680ec917-97ac-425f-8470-b56af11985d6 tempest-SnapshotDependencyTests-1805412700 None] Path /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-3f102cde-8bd3-4566-9556-006303ff7326 not found in is_blk_device check {{(pid=92083) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 17 06:04:01 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-680ec917-97ac-425f-8470-b56af11985d6 tempest-SnapshotDependencyTests-1805412700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-881929da-16c9-4978-b3bf-89a3504d1465 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-3f102cde-8bd3-4566-9556-006303ff7326 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:04:01 devstack sudo[111512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-881929da-16c9-4978-b3bf-89a3504d1465 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-3f102cde-8bd3-4566-9556-006303ff7326 Jun 17 06:04:01 devstack sudo[111512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:04:01 devstack sudo[111507]: pam_unix(sudo:session): session closed for user root Jun 17 06:04:01 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-dfc2f182-d82a-4285-aedf-2de710a572f2 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-34f55c12-6126-4366-823c-1493c897259e" returned: 0 in 0.603s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:04:01 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-dfc2f182-d82a-4285-aedf-2de710a572f2 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Lock "cinder-quobyte-34f55c12-6126-4366-823c-1493c897259e" released by "delete_volume" :: held 1.387s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:04:01 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-dfc2f182-d82a-4285-aedf-2de710a572f2 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Created reservations ['0fc9cd35-f02e-437f-b94c-722f4469be5c', 'bf2f9637-d6f8-4bae-81db-c526a1ca5442', '630d89db-dc90-4f26-9421-f3156276cea4', 'fbc1d3eb-dc07-4848-b710-e6beb1368a13'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 06:04:01 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-dfc2f182-d82a-4285-aedf-2de710a572f2 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:04:01 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-dfc2f182-d82a-4285-aedf-2de710a572f2 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:04:01 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-dfc2f182-d82a-4285-aedf-2de710a572f2 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 06:04:01 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-dfc2f182-d82a-4285-aedf-2de710a572f2 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 06:04:01 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-dfc2f182-d82a-4285-aedf-2de710a572f2 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:04:01 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-dfc2f182-d82a-4285-aedf-2de710a572f2 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:04:01 devstack sudo[111515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 06:04:01 devstack sudo[111515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:04:02 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-6c8e7d7f-54d2-4632-a653-2313e8cbbc03 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Acquiring lock "cinder-4271d0fb-3587-4848-9f96-731834fb13f1-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:04:02 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-6c8e7d7f-54d2-4632-a653-2313e8cbbc03 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Lock "cinder-4271d0fb-3587-4848-9f96-731834fb13f1-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:04:02 devstack sudo[111515]: pam_unix(sudo:session): session closed for user root Jun 17 06:04:02 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-dfc2f182-d82a-4285-aedf-2de710a572f2 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.955s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:04:02 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-dfc2f182-d82a-4285-aedf-2de710a572f2 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 06:04:02 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-dfc2f182-d82a-4285-aedf-2de710a572f2 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Deleted volume successfully. Jun 17 06:04:02 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-6c8e7d7f-54d2-4632-a653-2313e8cbbc03 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Acquiring lock "cinder-quobyte-4271d0fb-3587-4848-9f96-731834fb13f1" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:04:02 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-dfc2f182-d82a-4285-aedf-2de710a572f2 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Lock "cinder-34f55c12-6126-4366-823c-1493c897259e-delete_volume" released by "delete_volume" :: held 2.613s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:04:02 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-6c8e7d7f-54d2-4632-a653-2313e8cbbc03 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Lock "cinder-quobyte-4271d0fb-3587-4848-9f96-731834fb13f1" acquired by "delete_volume" :: waited 0.042s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:04:02 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da60033-34f1-4a6d-a9a5-9bbbca3580b6]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 06:04:02 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6c8e7d7f-54d2-4632-a653-2313e8cbbc03 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4271d0fb-3587-4848-9f96-731834fb13f1 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:04:02 devstack sudo[111529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4271d0fb-3587-4848-9f96-731834fb13f1 Jun 17 06:04:02 devstack sudo[111529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:04:04 devstack sudo[111529]: pam_unix(sudo:session): session closed for user root Jun 17 06:04:04 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6c8e7d7f-54d2-4632-a653-2313e8cbbc03 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4271d0fb-3587-4848-9f96-731834fb13f1" returned: 0 in 1.738s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:04:04 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6c8e7d7f-54d2-4632-a653-2313e8cbbc03 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4271d0fb-3587-4848-9f96-731834fb13f1 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:04:04 devstack sudo[111535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4271d0fb-3587-4848-9f96-731834fb13f1 Jun 17 06:04:04 devstack sudo[111535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:04:05 devstack sudo[111535]: pam_unix(sudo:session): session closed for user root Jun 17 06:04:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6c8e7d7f-54d2-4632-a653-2313e8cbbc03 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-4271d0fb-3587-4848-9f96-731834fb13f1" returned: 0 in 1.219s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:04:05 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-6c8e7d7f-54d2-4632-a653-2313e8cbbc03 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Lock "cinder-quobyte-4271d0fb-3587-4848-9f96-731834fb13f1" released by "delete_volume" :: held 3.084s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:04:05 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-6c8e7d7f-54d2-4632-a653-2313e8cbbc03 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Created reservations ['23979a4e-8ab4-443a-8d74-df7a6607af70', '76c601c4-a707-4e17-a1fe-5af3c2749a66', 'e85b7261-c068-4fdf-8e8b-d5ac03c59e92', '756c9071-cecf-4ceb-93e7-2fada394a86a'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 06:04:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-6c8e7d7f-54d2-4632-a653-2313e8cbbc03 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:04:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-6c8e7d7f-54d2-4632-a653-2313e8cbbc03 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:04:05 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-6c8e7d7f-54d2-4632-a653-2313e8cbbc03 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 06:04:05 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-6c8e7d7f-54d2-4632-a653-2313e8cbbc03 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 06:04:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-6c8e7d7f-54d2-4632-a653-2313e8cbbc03 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:04:05 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6c8e7d7f-54d2-4632-a653-2313e8cbbc03 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:04:06 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-1274ac9f-a75c-41dc-a76a-5e8020be9380 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Acquiring lock "cinder-82a8db46-9d0e-4484-bbe9-b8ab00cc8256-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:04:06 devstack sudo[111538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 06:04:06 devstack sudo[111538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:04:06 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-1274ac9f-a75c-41dc-a76a-5e8020be9380 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Lock "cinder-82a8db46-9d0e-4484-bbe9-b8ab00cc8256-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:04:06 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-1274ac9f-a75c-41dc-a76a-5e8020be9380 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Acquiring lock "cinder-quobyte-82a8db46-9d0e-4484-bbe9-b8ab00cc8256" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:04:06 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-1274ac9f-a75c-41dc-a76a-5e8020be9380 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Lock "cinder-quobyte-82a8db46-9d0e-4484-bbe9-b8ab00cc8256" acquired by "delete_volume" :: waited 0.033s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:04:06 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[afca4531-65ed-407b-8adb-7c3adf5f3736]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 06:04:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1274ac9f-a75c-41dc-a76a-5e8020be9380 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-82a8db46-9d0e-4484-bbe9-b8ab00cc8256 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:04:06 devstack sudo[111540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-82a8db46-9d0e-4484-bbe9-b8ab00cc8256 Jun 17 06:04:06 devstack sudo[111540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:04:06 devstack sudo[111512]: pam_unix(sudo:session): session closed for user root Jun 17 06:04:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-680ec917-97ac-425f-8470-b56af11985d6 tempest-SnapshotDependencyTests-1805412700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-881929da-16c9-4978-b3bf-89a3504d1465 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-3f102cde-8bd3-4566-9556-006303ff7326" returned: 0 in 5.536s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:04:06 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f8d466-45d9-4bfe-8bc5-80316b44538e]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 06:04:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-680ec917-97ac-425f-8470-b56af11985d6 tempest-SnapshotDependencyTests-1805412700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-881929da-16c9-4978-b3bf-89a3504d1465 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:04:06 devstack sudo[111542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-881929da-16c9-4978-b3bf-89a3504d1465 Jun 17 06:04:06 devstack sudo[111542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:04:06 devstack sudo[111538]: pam_unix(sudo:session): session closed for user root Jun 17 06:04:06 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6c8e7d7f-54d2-4632-a653-2313e8cbbc03 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.992s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:04:06 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-6c8e7d7f-54d2-4632-a653-2313e8cbbc03 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 06:04:06 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-6c8e7d7f-54d2-4632-a653-2313e8cbbc03 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Deleted volume successfully. Jun 17 06:04:06 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-6c8e7d7f-54d2-4632-a653-2313e8cbbc03 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Lock "cinder-4271d0fb-3587-4848-9f96-731834fb13f1-delete_volume" released by "delete_volume" :: held 4.617s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:04:07 devstack sudo[111540]: pam_unix(sudo:session): session closed for user root Jun 17 06:04:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1274ac9f-a75c-41dc-a76a-5e8020be9380 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-82a8db46-9d0e-4484-bbe9-b8ab00cc8256" returned: 0 in 0.798s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:04:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1274ac9f-a75c-41dc-a76a-5e8020be9380 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-82a8db46-9d0e-4484-bbe9-b8ab00cc8256 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:04:07 devstack sudo[111548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-82a8db46-9d0e-4484-bbe9-b8ab00cc8256 Jun 17 06:04:07 devstack sudo[111548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:04:07 devstack sudo[111542]: pam_unix(sudo:session): session closed for user root Jun 17 06:04:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-680ec917-97ac-425f-8470-b56af11985d6 tempest-SnapshotDependencyTests-1805412700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-881929da-16c9-4978-b3bf-89a3504d1465" returned: 0 in 0.891s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:04:07 devstack cinder-volume[92083]: DEBUG cinder.image.image_utils [None req-680ec917-97ac-425f-8470-b56af11985d6 tempest-SnapshotDependencyTests-1805412700 None] Image conversion details: src /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-881929da-16c9-4978-b3bf-89a3504d1465, size 1024.00 MB, duration 5.54 sec, destination /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-3f102cde-8bd3-4566-9556-006303ff7326 {{(pid=92083) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 17 06:04:07 devstack cinder-volume[92083]: INFO cinder.image.image_utils [None req-680ec917-97ac-425f-8470-b56af11985d6 tempest-SnapshotDependencyTests-1805412700 None] Converted 1024.00 MB image at 184.92 MB/s Jun 17 06:04:07 devstack cinder-volume[92083]: WARNING cinder.volume.drivers.remotefs [None req-680ec917-97ac-425f-8470-b56af11985d6 tempest-SnapshotDependencyTests-1805412700 None] /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-3f102cde-8bd3-4566-9556-006303ff7326 is being set with open permissions: ugo+rw Jun 17 06:04:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-680ec917-97ac-425f-8470-b56af11985d6 tempest-SnapshotDependencyTests-1805412700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-3f102cde-8bd3-4566-9556-006303ff7326 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:04:07 devstack sudo[111553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-3f102cde-8bd3-4566-9556-006303ff7326 Jun 17 06:04:07 devstack sudo[111553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:04:07 devstack sudo[111548]: pam_unix(sudo:session): session closed for user root Jun 17 06:04:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1274ac9f-a75c-41dc-a76a-5e8020be9380 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-82a8db46-9d0e-4484-bbe9-b8ab00cc8256" returned: 0 in 0.584s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:04:07 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-1274ac9f-a75c-41dc-a76a-5e8020be9380 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Lock "cinder-quobyte-82a8db46-9d0e-4484-bbe9-b8ab00cc8256" released by "delete_volume" :: held 1.455s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:04:07 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-1274ac9f-a75c-41dc-a76a-5e8020be9380 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Created reservations ['465e3e85-9398-48c5-b3a4-4db8e06987c8', 'c28e34b1-dae2-4f16-ae28-90ff542630b1', 'cf7d300f-4a70-477f-a0bc-e3fbcaed3d1e', '5c99dc5b-b9f8-435b-ace8-007c8bc5cd34'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 06:04:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-1274ac9f-a75c-41dc-a76a-5e8020be9380 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:04:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-1274ac9f-a75c-41dc-a76a-5e8020be9380 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:04:07 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-1274ac9f-a75c-41dc-a76a-5e8020be9380 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 06:04:07 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-1274ac9f-a75c-41dc-a76a-5e8020be9380 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 06:04:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-1274ac9f-a75c-41dc-a76a-5e8020be9380 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:04:07 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1274ac9f-a75c-41dc-a76a-5e8020be9380 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:04:07 devstack sudo[111556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 06:04:07 devstack sudo[111556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:04:08 devstack sudo[111553]: pam_unix(sudo:session): session closed for user root Jun 17 06:04:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-680ec917-97ac-425f-8470-b56af11985d6 tempest-SnapshotDependencyTests-1805412700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-3f102cde-8bd3-4566-9556-006303ff7326" returned: 0 in 0.588s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:04:08 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-680ec917-97ac-425f-8470-b56af11985d6 tempest-SnapshotDependencyTests-1805412700 None] Lock "cinder-quobyte-3f102cde-8bd3-4566-9556-006303ff7326" released by "_copy_volume_from_snapshot" :: held 8.556s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:04:08 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-680ec917-97ac-425f-8470-b56af11985d6 tempest-SnapshotDependencyTests-1805412700 None] Lock "cinder-quobyte-f87a1a60-ee78-473d-92c6-a6b48d907358-3f102cde-8bd3-4566-9556-006303ff7326" released by "_create_volume_from_snapshot" :: held 8.603s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:04:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-680ec917-97ac-425f-8470-b56af11985d6 tempest-SnapshotDependencyTests-1805412700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.638s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:04:08 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-680ec917-97ac-425f-8470-b56af11985d6 tempest-SnapshotDependencyTests-1805412700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de305262-add2-4ca2-8f98-454657973611) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f102cde-8bd3-4566-9556-006303ff7326', 'volume_size': 1, 'snapshot_id': 'f87a1a60-ee78-473d-92c6-a6b48d907358'}' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:04:08 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-680ec917-97ac-425f-8470-b56af11985d6 tempest-SnapshotDependencyTests-1805412700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b4024d2-bb04-4332-8a57-eb78a0567c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 06:04:08 devstack cinder-volume[92083]: INFO cinder.volume.flows.manager.create_volume [None req-680ec917-97ac-425f-8470-b56af11985d6 tempest-SnapshotDependencyTests-1805412700 None] Volume volume-3f102cde-8bd3-4566-9556-006303ff7326 (3f102cde-8bd3-4566-9556-006303ff7326): created successfully Jun 17 06:04:08 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-680ec917-97ac-425f-8470-b56af11985d6 tempest-SnapshotDependencyTests-1805412700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b4024d2-bb04-4332-8a57-eb78a0567c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92083) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 06:04:08 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-680ec917-97ac-425f-8470-b56af11985d6 tempest-SnapshotDependencyTests-1805412700 None] Flow 'volume_create_manager' (8e54c902-2413-4f6f-a5d9-227b305dbd5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92083) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 06:04:08 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-680ec917-97ac-425f-8470-b56af11985d6 tempest-SnapshotDependencyTests-1805412700 None] Created volume successfully. Jun 17 06:04:08 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-6a8a6fa0-0235-4818-bef5-cde940972307 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Acquiring lock "cinder-619c7aa8-161f-494d-9d90-32206d349ae5-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:04:08 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-6a8a6fa0-0235-4818-bef5-cde940972307 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Lock "cinder-619c7aa8-161f-494d-9d90-32206d349ae5-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:04:08 devstack sudo[111556]: pam_unix(sudo:session): session closed for user root Jun 17 06:04:08 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-325d5f82-a397-41f4-a70e-97ab250ad059 tempest-SnapshotDependencyTests-1805412700 None] Acquiring lock "cinder-f87a1a60-ee78-473d-92c6-a6b48d907358-delete_snapshot" by "delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:04:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-1274ac9f-a75c-41dc-a76a-5e8020be9380 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.610s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:04:08 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-1274ac9f-a75c-41dc-a76a-5e8020be9380 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 06:04:08 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-6a8a6fa0-0235-4818-bef5-cde940972307 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Acquiring lock "cinder-quobyte-619c7aa8-161f-494d-9d90-32206d349ae5" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:04:08 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-1274ac9f-a75c-41dc-a76a-5e8020be9380 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Deleted volume successfully. Jun 17 06:04:08 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-325d5f82-a397-41f4-a70e-97ab250ad059 tempest-SnapshotDependencyTests-1805412700 None] Lock "cinder-f87a1a60-ee78-473d-92c6-a6b48d907358-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:04:08 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-325d5f82-a397-41f4-a70e-97ab250ad059 tempest-SnapshotDependencyTests-1805412700 None] Acquiring lock "cinder-quobyte-881929da-16c9-4978-b3bf-89a3504d1465" by "delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:04:08 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-6a8a6fa0-0235-4818-bef5-cde940972307 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Lock "cinder-quobyte-619c7aa8-161f-494d-9d90-32206d349ae5" acquired by "delete_volume" :: waited 0.030s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:04:08 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-1274ac9f-a75c-41dc-a76a-5e8020be9380 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Lock "cinder-82a8db46-9d0e-4484-bbe9-b8ab00cc8256-delete_volume" released by "delete_volume" :: held 2.380s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:04:08 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-325d5f82-a397-41f4-a70e-97ab250ad059 tempest-SnapshotDependencyTests-1805412700 None] Lock "cinder-quobyte-881929da-16c9-4978-b3bf-89a3504d1465" acquired by "delete_snapshot" :: waited 0.035s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:04:08 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-325d5f82-a397-41f4-a70e-97ab250ad059 tempest-SnapshotDependencyTests-1805412700 None] Acquiring lock "cinder-quobyte-f87a1a60-ee78-473d-92c6-a6b48d907358" by "_delete_snapshot" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:04:08 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d41e29-cf6e-4a7c-8f7c-8c994fedc91b]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 06:04:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6a8a6fa0-0235-4818-bef5-cde940972307 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-619c7aa8-161f-494d-9d90-32206d349ae5 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:04:08 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-325d5f82-a397-41f4-a70e-97ab250ad059 tempest-SnapshotDependencyTests-1805412700 None] Lock "cinder-quobyte-f87a1a60-ee78-473d-92c6-a6b48d907358" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:04:08 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-325d5f82-a397-41f4-a70e-97ab250ad059 tempest-SnapshotDependencyTests-1805412700 None] Deleting offline snapshot f87a1a60-ee78-473d-92c6-a6b48d907358 of volume 881929da-16c9-4978-b3bf-89a3504d1465 {{(pid=92083) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 17 06:04:08 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-325d5f82-a397-41f4-a70e-97ab250ad059 tempest-SnapshotDependencyTests-1805412700 None] snapshot_file for this snap is: volume-881929da-16c9-4978-b3bf-89a3504d1465.f87a1a60-ee78-473d-92c6-a6b48d907358 {{(pid=92083) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 17 06:04:08 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c7472b-caa2-450e-a1ed-1e3c49e54283]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 06:04:08 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-325d5f82-a397-41f4-a70e-97ab250ad059 tempest-SnapshotDependencyTests-1805412700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-881929da-16c9-4978-b3bf-89a3504d1465.f87a1a60-ee78-473d-92c6-a6b48d907358 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:04:08 devstack sudo[111560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-619c7aa8-161f-494d-9d90-32206d349ae5 Jun 17 06:04:08 devstack sudo[111560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:04:08 devstack sudo[111561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-881929da-16c9-4978-b3bf-89a3504d1465.f87a1a60-ee78-473d-92c6-a6b48d907358 Jun 17 06:04:08 devstack sudo[111561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:04:09 devstack sudo[111560]: pam_unix(sudo:session): session closed for user root Jun 17 06:04:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6a8a6fa0-0235-4818-bef5-cde940972307 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-619c7aa8-161f-494d-9d90-32206d349ae5" returned: 0 in 0.740s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:04:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6a8a6fa0-0235-4818-bef5-cde940972307 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-619c7aa8-161f-494d-9d90-32206d349ae5 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:04:09 devstack sudo[111572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-619c7aa8-161f-494d-9d90-32206d349ae5 Jun 17 06:04:09 devstack sudo[111572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:04:09 devstack sudo[111561]: pam_unix(sudo:session): session closed for user root Jun 17 06:04:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-325d5f82-a397-41f4-a70e-97ab250ad059 tempest-SnapshotDependencyTests-1805412700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-881929da-16c9-4978-b3bf-89a3504d1465.f87a1a60-ee78-473d-92c6-a6b48d907358" returned: 0 in 0.750s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:04:09 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.remotefs [None req-325d5f82-a397-41f4-a70e-97ab250ad059 tempest-SnapshotDependencyTests-1805412700 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-881929da-16c9-4978-b3bf-89a3504d1465(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92083) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 06:04:09 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d97e32-beb3-40ea-aeef-e1dd5ffdc811]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 06:04:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-325d5f82-a397-41f4-a70e-97ab250ad059 tempest-SnapshotDependencyTests-1805412700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-881929da-16c9-4978-b3bf-89a3504d1465 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:04:09 devstack sudo[111574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-881929da-16c9-4978-b3bf-89a3504d1465 Jun 17 06:04:09 devstack sudo[111574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:04:09 devstack sudo[111572]: pam_unix(sudo:session): session closed for user root Jun 17 06:04:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6a8a6fa0-0235-4818-bef5-cde940972307 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-619c7aa8-161f-494d-9d90-32206d349ae5" returned: 0 in 0.599s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:04:09 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-6a8a6fa0-0235-4818-bef5-cde940972307 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Lock "cinder-quobyte-619c7aa8-161f-494d-9d90-32206d349ae5" released by "delete_volume" :: held 1.381s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:04:09 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-6a8a6fa0-0235-4818-bef5-cde940972307 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Created reservations ['4b672252-93eb-40f0-b8ad-7f393e5ba79f', '09a359c6-21f8-4462-930f-3fdad3826d9c', 'f36fd3ff-5a81-4123-b0c9-10f7b5f36307', 'dcb6a0b9-79a5-4e18-8c6c-ef2e3823a50a'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 06:04:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-6a8a6fa0-0235-4818-bef5-cde940972307 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:04:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-6a8a6fa0-0235-4818-bef5-cde940972307 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:04:09 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-6a8a6fa0-0235-4818-bef5-cde940972307 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 06:04:09 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-6a8a6fa0-0235-4818-bef5-cde940972307 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 06:04:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-6a8a6fa0-0235-4818-bef5-cde940972307 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:04:09 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6a8a6fa0-0235-4818-bef5-cde940972307 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:04:10 devstack sudo[111581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 06:04:10 devstack sudo[111581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:04:10 devstack sudo[111574]: pam_unix(sudo:session): session closed for user root Jun 17 06:04:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-325d5f82-a397-41f4-a70e-97ab250ad059 tempest-SnapshotDependencyTests-1805412700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-881929da-16c9-4978-b3bf-89a3504d1465" returned: 0 in 0.735s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:04:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-325d5f82-a397-41f4-a70e-97ab250ad059 tempest-SnapshotDependencyTests-1805412700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-881929da-16c9-4978-b3bf-89a3504d1465.f87a1a60-ee78-473d-92c6-a6b48d907358 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:04:10 devstack sudo[111583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-881929da-16c9-4978-b3bf-89a3504d1465.f87a1a60-ee78-473d-92c6-a6b48d907358 Jun 17 06:04:10 devstack sudo[111583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:04:10 devstack sudo[111581]: pam_unix(sudo:session): session closed for user root Jun 17 06:04:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-6a8a6fa0-0235-4818-bef5-cde940972307 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.629s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:04:10 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-6a8a6fa0-0235-4818-bef5-cde940972307 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 06:04:10 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-6a8a6fa0-0235-4818-bef5-cde940972307 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Deleted volume successfully. Jun 17 06:04:10 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-092f6e11-c7d9-4ca4-9d3d-47701694388a tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Acquiring lock "cinder-31d19cf4-be8b-4614-b78e-53f40f11caf0-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:04:10 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-6a8a6fa0-0235-4818-bef5-cde940972307 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Lock "cinder-619c7aa8-161f-494d-9d90-32206d349ae5-delete_volume" released by "delete_volume" :: held 2.258s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:04:10 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-092f6e11-c7d9-4ca4-9d3d-47701694388a tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Lock "cinder-31d19cf4-be8b-4614-b78e-53f40f11caf0-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:04:10 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-092f6e11-c7d9-4ca4-9d3d-47701694388a tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Acquiring lock "cinder-quobyte-31d19cf4-be8b-4614-b78e-53f40f11caf0" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:04:10 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-092f6e11-c7d9-4ca4-9d3d-47701694388a tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Lock "cinder-quobyte-31d19cf4-be8b-4614-b78e-53f40f11caf0" acquired by "delete_volume" :: waited 0.018s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:04:10 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd061c4e-e536-4584-8ab5-ce40802e3ece]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 06:04:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-092f6e11-c7d9-4ca4-9d3d-47701694388a tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-31d19cf4-be8b-4614-b78e-53f40f11caf0 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:04:10 devstack sudo[111583]: pam_unix(sudo:session): session closed for user root Jun 17 06:04:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-325d5f82-a397-41f4-a70e-97ab250ad059 tempest-SnapshotDependencyTests-1805412700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-881929da-16c9-4978-b3bf-89a3504d1465.f87a1a60-ee78-473d-92c6-a6b48d907358" returned: 0 in 0.752s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:04:10 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-325d5f82-a397-41f4-a70e-97ab250ad059 tempest-SnapshotDependencyTests-1805412700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-881929da-16c9-4978-b3bf-89a3504d1465.f87a1a60-ee78-473d-92c6-a6b48d907358 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:04:10 devstack sudo[111590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-881929da-16c9-4978-b3bf-89a3504d1465.f87a1a60-ee78-473d-92c6-a6b48d907358 Jun 17 06:04:10 devstack sudo[111590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:04:10 devstack sudo[111589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-31d19cf4-be8b-4614-b78e-53f40f11caf0 Jun 17 06:04:10 devstack sudo[111589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:04:11 devstack sudo[111590]: pam_unix(sudo:session): session closed for user root Jun 17 06:04:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-325d5f82-a397-41f4-a70e-97ab250ad059 tempest-SnapshotDependencyTests-1805412700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-881929da-16c9-4978-b3bf-89a3504d1465.f87a1a60-ee78-473d-92c6-a6b48d907358" returned: 0 in 0.603s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:04:11 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-325d5f82-a397-41f4-a70e-97ab250ad059 tempest-SnapshotDependencyTests-1805412700 None] Lock "cinder-quobyte-f87a1a60-ee78-473d-92c6-a6b48d907358" released by "_delete_snapshot" :: held 2.944s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:04:11 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-325d5f82-a397-41f4-a70e-97ab250ad059 tempest-SnapshotDependencyTests-1805412700 None] Lock "cinder-quobyte-881929da-16c9-4978-b3bf-89a3504d1465" released by "delete_snapshot" :: held 2.975s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:04:11 devstack sudo[111589]: pam_unix(sudo:session): session closed for user root Jun 17 06:04:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-092f6e11-c7d9-4ca4-9d3d-47701694388a tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-31d19cf4-be8b-4614-b78e-53f40f11caf0" returned: 0 in 0.732s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:04:11 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-092f6e11-c7d9-4ca4-9d3d-47701694388a tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-31d19cf4-be8b-4614-b78e-53f40f11caf0 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:04:11 devstack sudo[111597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-31d19cf4-be8b-4614-b78e-53f40f11caf0 Jun 17 06:04:11 devstack sudo[111597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:04:11 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-325d5f82-a397-41f4-a70e-97ab250ad059 tempest-SnapshotDependencyTests-1805412700 None] Created reservations ['265c2159-39b0-4244-87ff-cc22b52b6f4d', '6027dbb7-c423-412a-a90d-6ce9bf904bb1', '0ee72a4c-f3d3-4c00-b96e-3c77e79ec058', 'e62f8635-b50f-4dc9-b16d-733e12c1975e'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 06:04:11 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-325d5f82-a397-41f4-a70e-97ab250ad059 tempest-SnapshotDependencyTests-1805412700 None] Delete snapshot completed successfully. Jun 17 06:04:11 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-325d5f82-a397-41f4-a70e-97ab250ad059 tempest-SnapshotDependencyTests-1805412700 None] Lock "cinder-f87a1a60-ee78-473d-92c6-a6b48d907358-delete_snapshot" released by "delete_snapshot" :: held 3.151s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:04:12 devstack sudo[111597]: pam_unix(sudo:session): session closed for user root Jun 17 06:04:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-092f6e11-c7d9-4ca4-9d3d-47701694388a tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-31d19cf4-be8b-4614-b78e-53f40f11caf0" returned: 0 in 0.613s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:04:12 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-092f6e11-c7d9-4ca4-9d3d-47701694388a tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Lock "cinder-quobyte-31d19cf4-be8b-4614-b78e-53f40f11caf0" released by "delete_volume" :: held 1.388s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:04:12 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-092f6e11-c7d9-4ca4-9d3d-47701694388a tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Created reservations ['63c4dbbf-da6f-4ef2-ac79-255f4a5f8896', '1bc4d571-af71-44d7-aa50-8f48b98246ac', 'd9ebcf12-5ec7-442b-b5c4-66b947ee31d9', '9c847703-0b58-4229-a5b5-cdd59904874c'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 06:04:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-092f6e11-c7d9-4ca4-9d3d-47701694388a tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:04:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-092f6e11-c7d9-4ca4-9d3d-47701694388a tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:04:12 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-092f6e11-c7d9-4ca4-9d3d-47701694388a tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 06:04:12 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-092f6e11-c7d9-4ca4-9d3d-47701694388a tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 06:04:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-092f6e11-c7d9-4ca4-9d3d-47701694388a tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:04:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-092f6e11-c7d9-4ca4-9d3d-47701694388a tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:04:12 devstack sudo[111600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 06:04:12 devstack sudo[111600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:04:12 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-d91ccae1-eccc-45e7-a43c-0fc76bdcf7b8 tempest-SnapshotDependencyTests-1805412700 None] Acquiring lock "cinder-881929da-16c9-4978-b3bf-89a3504d1465-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:04:12 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-d91ccae1-eccc-45e7-a43c-0fc76bdcf7b8 tempest-SnapshotDependencyTests-1805412700 None] Lock "cinder-881929da-16c9-4978-b3bf-89a3504d1465-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:04:12 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-d91ccae1-eccc-45e7-a43c-0fc76bdcf7b8 tempest-SnapshotDependencyTests-1805412700 None] Acquiring lock "cinder-quobyte-881929da-16c9-4978-b3bf-89a3504d1465" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:04:12 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-d91ccae1-eccc-45e7-a43c-0fc76bdcf7b8 tempest-SnapshotDependencyTests-1805412700 None] Lock "cinder-quobyte-881929da-16c9-4978-b3bf-89a3504d1465" acquired by "delete_volume" :: waited 0.016s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:04:12 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[972f4502-0eeb-4098-8465-dc286e0d0d96]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 06:04:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-d91ccae1-eccc-45e7-a43c-0fc76bdcf7b8 tempest-SnapshotDependencyTests-1805412700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-881929da-16c9-4978-b3bf-89a3504d1465 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:04:12 devstack sudo[111600]: pam_unix(sudo:session): session closed for user root Jun 17 06:04:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-092f6e11-c7d9-4ca4-9d3d-47701694388a tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.633s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:04:12 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-092f6e11-c7d9-4ca4-9d3d-47701694388a tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 06:04:12 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-092f6e11-c7d9-4ca4-9d3d-47701694388a tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Deleted volume successfully. Jun 17 06:04:12 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-13c77c22-2feb-4fcc-b8fd-fdf9519c2e56 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Acquiring lock "cinder-0d1857a4-ed81-44c6-975d-7ad67c61ed25-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:04:12 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-13c77c22-2feb-4fcc-b8fd-fdf9519c2e56 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Lock "cinder-0d1857a4-ed81-44c6-975d-7ad67c61ed25-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:04:12 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-092f6e11-c7d9-4ca4-9d3d-47701694388a tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Lock "cinder-31d19cf4-be8b-4614-b78e-53f40f11caf0-delete_volume" released by "delete_volume" :: held 2.236s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:04:12 devstack sudo[111603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-881929da-16c9-4978-b3bf-89a3504d1465 Jun 17 06:04:12 devstack sudo[111603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:04:12 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-13c77c22-2feb-4fcc-b8fd-fdf9519c2e56 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Acquiring lock "cinder-quobyte-0d1857a4-ed81-44c6-975d-7ad67c61ed25" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:04:12 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-13c77c22-2feb-4fcc-b8fd-fdf9519c2e56 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Lock "cinder-quobyte-0d1857a4-ed81-44c6-975d-7ad67c61ed25" acquired by "delete_volume" :: waited 0.023s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:04:12 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[d02b9996-173d-4f56-86a9-c309bc896d2b]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 06:04:12 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-13c77c22-2feb-4fcc-b8fd-fdf9519c2e56 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0d1857a4-ed81-44c6-975d-7ad67c61ed25 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:04:13 devstack sudo[111605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0d1857a4-ed81-44c6-975d-7ad67c61ed25 Jun 17 06:04:13 devstack sudo[111605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:04:13 devstack sudo[111603]: pam_unix(sudo:session): session closed for user root Jun 17 06:04:13 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-d91ccae1-eccc-45e7-a43c-0fc76bdcf7b8 tempest-SnapshotDependencyTests-1805412700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-881929da-16c9-4978-b3bf-89a3504d1465" returned: 0 in 0.759s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:04:13 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-d91ccae1-eccc-45e7-a43c-0fc76bdcf7b8 tempest-SnapshotDependencyTests-1805412700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-881929da-16c9-4978-b3bf-89a3504d1465 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:04:13 devstack sudo[111611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-881929da-16c9-4978-b3bf-89a3504d1465 Jun 17 06:04:13 devstack sudo[111611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:04:13 devstack sudo[111605]: pam_unix(sudo:session): session closed for user root Jun 17 06:04:13 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-13c77c22-2feb-4fcc-b8fd-fdf9519c2e56 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0d1857a4-ed81-44c6-975d-7ad67c61ed25" returned: 0 in 0.716s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:04:13 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-13c77c22-2feb-4fcc-b8fd-fdf9519c2e56 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0d1857a4-ed81-44c6-975d-7ad67c61ed25 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:04:13 devstack sudo[111615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0d1857a4-ed81-44c6-975d-7ad67c61ed25 Jun 17 06:04:13 devstack sudo[111615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:04:14 devstack sudo[111611]: pam_unix(sudo:session): session closed for user root Jun 17 06:04:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-d91ccae1-eccc-45e7-a43c-0fc76bdcf7b8 tempest-SnapshotDependencyTests-1805412700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-881929da-16c9-4978-b3bf-89a3504d1465" returned: 0 in 0.615s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:04:14 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-d91ccae1-eccc-45e7-a43c-0fc76bdcf7b8 tempest-SnapshotDependencyTests-1805412700 None] Lock "cinder-quobyte-881929da-16c9-4978-b3bf-89a3504d1465" released by "delete_volume" :: held 1.450s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:04:14 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-d91ccae1-eccc-45e7-a43c-0fc76bdcf7b8 tempest-SnapshotDependencyTests-1805412700 None] Created reservations ['27aace66-c330-45ba-ae3d-7c782a90c1ef', 'da8701f8-46c7-48d8-9ba0-5da7070ace4f', '05d14f23-8995-4aca-b352-50e3118172cf', '96ad8422-9ab1-44de-b05d-104ea1db937b'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 06:04:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-d91ccae1-eccc-45e7-a43c-0fc76bdcf7b8 tempest-SnapshotDependencyTests-1805412700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:04:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-d91ccae1-eccc-45e7-a43c-0fc76bdcf7b8 tempest-SnapshotDependencyTests-1805412700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:04:14 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-d91ccae1-eccc-45e7-a43c-0fc76bdcf7b8 tempest-SnapshotDependencyTests-1805412700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 06:04:14 devstack sudo[111615]: pam_unix(sudo:session): session closed for user root Jun 17 06:04:14 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-d91ccae1-eccc-45e7-a43c-0fc76bdcf7b8 tempest-SnapshotDependencyTests-1805412700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 06:04:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-d91ccae1-eccc-45e7-a43c-0fc76bdcf7b8 tempest-SnapshotDependencyTests-1805412700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:04:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-d91ccae1-eccc-45e7-a43c-0fc76bdcf7b8 tempest-SnapshotDependencyTests-1805412700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:04:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-13c77c22-2feb-4fcc-b8fd-fdf9519c2e56 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-0d1857a4-ed81-44c6-975d-7ad67c61ed25" returned: 0 in 0.614s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:04:14 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-13c77c22-2feb-4fcc-b8fd-fdf9519c2e56 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Lock "cinder-quobyte-0d1857a4-ed81-44c6-975d-7ad67c61ed25" released by "delete_volume" :: held 1.371s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:04:14 devstack sudo[111619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 06:04:14 devstack sudo[111619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:04:14 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-13c77c22-2feb-4fcc-b8fd-fdf9519c2e56 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Created reservations ['592a527c-60df-4d69-8210-3372d800dc3a', 'a7709ca9-63cd-486b-83d2-47fea844a169', '690cdaa9-d8b9-48da-a838-9a02f5f36771', '11106ca7-1656-499d-a708-7b71b3f2f984'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 06:04:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-13c77c22-2feb-4fcc-b8fd-fdf9519c2e56 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:04:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-13c77c22-2feb-4fcc-b8fd-fdf9519c2e56 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:04:14 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-13c77c22-2feb-4fcc-b8fd-fdf9519c2e56 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 06:04:14 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-13c77c22-2feb-4fcc-b8fd-fdf9519c2e56 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 06:04:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-13c77c22-2feb-4fcc-b8fd-fdf9519c2e56 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:04:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-13c77c22-2feb-4fcc-b8fd-fdf9519c2e56 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:04:14 devstack sudo[111621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 06:04:14 devstack sudo[111621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:04:14 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-e4b826d6-98ab-42e1-9640-da87370ecf03 tempest-SnapshotDependencyTests-1805412700 None] Acquiring lock "cinder-3f102cde-8bd3-4566-9556-006303ff7326-delete_volume" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:04:14 devstack sudo[111619]: pam_unix(sudo:session): session closed for user root Jun 17 06:04:14 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-e4b826d6-98ab-42e1-9640-da87370ecf03 tempest-SnapshotDependencyTests-1805412700 None] Lock "cinder-3f102cde-8bd3-4566-9556-006303ff7326-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:04:14 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-d91ccae1-eccc-45e7-a43c-0fc76bdcf7b8 tempest-SnapshotDependencyTests-1805412700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.612s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:04:14 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-d91ccae1-eccc-45e7-a43c-0fc76bdcf7b8 tempest-SnapshotDependencyTests-1805412700 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 06:04:14 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-d91ccae1-eccc-45e7-a43c-0fc76bdcf7b8 tempest-SnapshotDependencyTests-1805412700 None] Deleted volume successfully. Jun 17 06:04:14 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-e4b826d6-98ab-42e1-9640-da87370ecf03 tempest-SnapshotDependencyTests-1805412700 None] Acquiring lock "cinder-quobyte-3f102cde-8bd3-4566-9556-006303ff7326" by "delete_volume" {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 06:04:14 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-d91ccae1-eccc-45e7-a43c-0fc76bdcf7b8 tempest-SnapshotDependencyTests-1805412700 None] Lock "cinder-881929da-16c9-4978-b3bf-89a3504d1465-delete_volume" released by "delete_volume" :: held 2.288s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:04:14 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-e4b826d6-98ab-42e1-9640-da87370ecf03 tempest-SnapshotDependencyTests-1805412700 None] Lock "cinder-quobyte-3f102cde-8bd3-4566-9556-006303ff7326" acquired by "delete_volume" :: waited 0.021s {{(pid=92083) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 06:04:15 devstack cinder-volume[92083]: DEBUG oslo.privsep.daemon [-] privsep: reply[53929620-764c-4cf8-bb29-227230fb0d0a]: (4, 'qcow2') {{(pid=92963) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 06:04:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e4b826d6-98ab-42e1-9640-da87370ecf03 tempest-SnapshotDependencyTests-1805412700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-3f102cde-8bd3-4566-9556-006303ff7326 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:04:15 devstack sudo[111621]: pam_unix(sudo:session): session closed for user root Jun 17 06:04:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-13c77c22-2feb-4fcc-b8fd-fdf9519c2e56 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.633s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:04:15 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-13c77c22-2feb-4fcc-b8fd-fdf9519c2e56 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 06:04:15 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-13c77c22-2feb-4fcc-b8fd-fdf9519c2e56 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Deleted volume successfully. Jun 17 06:04:15 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-13c77c22-2feb-4fcc-b8fd-fdf9519c2e56 tempest-CreateVolumesFromSourceVolumeTest-1459503579 None] Lock "cinder-0d1857a4-ed81-44c6-975d-7ad67c61ed25-delete_volume" released by "delete_volume" :: held 2.205s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:04:15 devstack sudo[111625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-3f102cde-8bd3-4566-9556-006303ff7326 Jun 17 06:04:15 devstack sudo[111625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:04:15 devstack sudo[111625]: pam_unix(sudo:session): session closed for user root Jun 17 06:04:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e4b826d6-98ab-42e1-9640-da87370ecf03 tempest-SnapshotDependencyTests-1805412700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-3f102cde-8bd3-4566-9556-006303ff7326" returned: 0 in 0.735s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:04:15 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e4b826d6-98ab-42e1-9640-da87370ecf03 tempest-SnapshotDependencyTests-1805412700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-3f102cde-8bd3-4566-9556-006303ff7326 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:04:15 devstack sudo[111630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-3f102cde-8bd3-4566-9556-006303ff7326 Jun 17 06:04:15 devstack sudo[111630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:04:16 devstack sudo[111630]: pam_unix(sudo:session): session closed for user root Jun 17 06:04:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e4b826d6-98ab-42e1-9640-da87370ecf03 tempest-SnapshotDependencyTests-1805412700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7/volume-3f102cde-8bd3-4566-9556-006303ff7326" returned: 0 in 0.616s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:04:16 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-e4b826d6-98ab-42e1-9640-da87370ecf03 tempest-SnapshotDependencyTests-1805412700 None] Lock "cinder-quobyte-3f102cde-8bd3-4566-9556-006303ff7326" released by "delete_volume" :: held 1.396s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:04:16 devstack cinder-volume[92083]: DEBUG cinder.quota [None req-e4b826d6-98ab-42e1-9640-da87370ecf03 tempest-SnapshotDependencyTests-1805412700 None] Created reservations ['f6fe9571-a7e0-434e-a65c-ab4f7045ff77', '611773fe-ee80-4099-8b78-4675002e589d', '68858cd0-502f-43cc-8a59-bd3026bc3dcc', '3d845c0d-cb9b-4ab8-87b5-3181f27175f2'] {{(pid=92083) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 06:04:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e4b826d6-98ab-42e1-9640-da87370ecf03 tempest-SnapshotDependencyTests-1805412700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:04:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e4b826d6-98ab-42e1-9640-da87370ecf03 tempest-SnapshotDependencyTests-1805412700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:04:16 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-e4b826d6-98ab-42e1-9640-da87370ecf03 tempest-SnapshotDependencyTests-1805412700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 06:04:16 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-e4b826d6-98ab-42e1-9640-da87370ecf03 tempest-SnapshotDependencyTests-1805412700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 06:04:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-e4b826d6-98ab-42e1-9640-da87370ecf03 tempest-SnapshotDependencyTests-1805412700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:04:16 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e4b826d6-98ab-42e1-9640-da87370ecf03 tempest-SnapshotDependencyTests-1805412700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:04:16 devstack sudo[111633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 06:04:16 devstack sudo[111633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:04:17 devstack sudo[111633]: pam_unix(sudo:session): session closed for user root Jun 17 06:04:17 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-e4b826d6-98ab-42e1-9640-da87370ecf03 tempest-SnapshotDependencyTests-1805412700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.611s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:04:17 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-e4b826d6-98ab-42e1-9640-da87370ecf03 tempest-SnapshotDependencyTests-1805412700 None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 06:04:17 devstack cinder-volume[92083]: INFO cinder.volume.manager [None req-e4b826d6-98ab-42e1-9640-da87370ecf03 tempest-SnapshotDependencyTests-1805412700 None] Deleted volume successfully. Jun 17 06:04:17 devstack cinder-volume[92083]: DEBUG cinder.coordination [None req-e4b826d6-98ab-42e1-9640-da87370ecf03 tempest-SnapshotDependencyTests-1805412700 None] Lock "cinder-3f102cde-8bd3-4566-9556-006303ff7326-delete_volume" released by "delete_volume" :: held 2.216s {{(pid=92083) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 06:04:26 devstack cinder-volume[92083]: DEBUG dbcounter [-] [92083] Writing DB stats cinder:SELECT=76,cinder:UPDATE=110,cinder:INSERT=26,cinder:DELETE=8 {{(pid=92083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 06:04:27 devstack cinder-volume[92083]: DEBUG dbcounter [-] [92083] Writing DB stats cinder:SELECT=77,cinder:INSERT=26,cinder:UPDATE=113,cinder:DELETE=11 {{(pid=92083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 06:04:27 devstack cinder-volume[92083]: DEBUG oslo_service.periodic_task [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92083) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 06:04:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 06:04:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 06:04:27 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f': None} {{(pid=92083) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 06:04:27 devstack cinder-volume[92083]: DEBUG cinder.volume.drivers.quobyte [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab5b2642-3b0a-4ce7-9002-fd9d9f9d5a0f'] {{(pid=92083) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 06:04:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.lockutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92083) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 06:04:27 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 06:04:27 devstack sudo[111652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7 Jun 17 06:04:27 devstack sudo[111652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 06:04:28 devstack sudo[111652]: pam_unix(sudo:session): session closed for user root Jun 17 06:04:28 devstack cinder-volume[92083]: DEBUG oslo_concurrency.processutils [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/79011e3549e7401e5bf5735ea72b5af7" returned: 0 in 0.596s {{(pid=92083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 06:04:28 devstack cinder-volume[92083]: DEBUG cinder.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Notifying Schedulers of capabilities ... {{(pid=92083) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 06:04:28 devstack cinder-volume[92083]: DEBUG oslo_service.periodic_task [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] Running periodic task VolumeManager._thread_info {{(pid=92083) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 06:04:28 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] thread count: 28 {{(pid=92083) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 17 06:04:28 devstack cinder-volume[92083]: DEBUG cinder.volume.manager [None req-ebe4de75-ee49-4e65-bffb-f126da23d882 None None] thread info: [<_MainThread(MainThread, started 133483869905024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92083) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}